Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
3.431340284s
FAIL (2025-08-11 15:54:28 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 3.431376465s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
837.5758ms
FAIL (2025-08-11 15:54:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 837.609158ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
1.05300349s
FAIL (2025-08-11 15:54:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.053034199s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
3.343441824s
FAIL (2025-08-11 15:53:42 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 3.343474469s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........X..X.....................................X...X....] duration:
2.520413026s
FAIL (2025-08-11 15:53:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:50:42.906151185 (70h25m4.865248454s) [upload=73375]: Starting upload Aug 11 15:50:42.906231802 (70h25m4.865329054s) [upload=73375]: Done starting upload Aug 11 15:50:42.906372273 (70h25m4.865469538s) [upload=73375]: Uploading segments... Aug 11 15:50:42.906538489 (70h25m4.865635726s) [upload=73375]: Got next segment. Inline: false Aug 11 15:50:42.906591251 (70h25m4.865688486s) [upload=73375]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:50:42.906599040 (70h25m4.865696281s) [upload=73375]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 15:50:42.995591137 (70h25m4.954688373s) [upload=73375]: Next segment err: metaclient: Too Many Requests Aug 11 15:50:42.995638106 (70h25m4.954735352s) [upload=73375]: Done uploading segments... Aug 11 15:50:42.995655809 (70h25m4.954753056s) [upload=73375]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.520462767s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........X..X.....................................X...X...] duration:
2.591303124s
FAIL (2025-08-11 15:53:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:50:42.906151185 (70h25m4.865248454s) [upload=73375]: Starting upload Aug 11 15:50:42.906231802 (70h25m4.865329054s) [upload=73375]: Done starting upload Aug 11 15:50:42.906372273 (70h25m4.865469538s) [upload=73375]: Uploading segments... Aug 11 15:50:42.906538489 (70h25m4.865635726s) [upload=73375]: Got next segment. Inline: false Aug 11 15:50:42.906591251 (70h25m4.865688486s) [upload=73375]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:50:42.906599040 (70h25m4.865696281s) [upload=73375]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 15:50:42.995591137 (70h25m4.954688373s) [upload=73375]: Next segment err: metaclient: Too Many Requests Aug 11 15:50:42.995638106 (70h25m4.954735352s) [upload=73375]: Done uploading segments... Aug 11 15:50:42.995655809 (70h25m4.954753056s) [upload=73375]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.591326294s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
879.423746ms
FAIL (2025-08-11 15:52:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 879.451112ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [............X..X.....................................X...X..] duration:
2.376888827s
FAIL (2025-08-11 15:52:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:50:42.906151185 (70h25m4.865248454s) [upload=73375]: Starting upload Aug 11 15:50:42.906231802 (70h25m4.865329054s) [upload=73375]: Done starting upload Aug 11 15:50:42.906372273 (70h25m4.865469538s) [upload=73375]: Uploading segments... Aug 11 15:50:42.906538489 (70h25m4.865635726s) [upload=73375]: Got next segment. Inline: false Aug 11 15:50:42.906591251 (70h25m4.865688486s) [upload=73375]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:50:42.906599040 (70h25m4.865696281s) [upload=73375]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 15:50:42.995591137 (70h25m4.954688373s) [upload=73375]: Next segment err: metaclient: Too Many Requests Aug 11 15:50:42.995638106 (70h25m4.954735352s) [upload=73375]: Done uploading segments... Aug 11 15:50:42.995655809 (70h25m4.954753056s) [upload=73375]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.376918489s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
3.122712834s
FAIL (2025-08-11 15:52:36 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 3.12274383s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
888.184868ms
FAIL (2025-08-11 15:52:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 888.226358ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
882.527403ms
FAIL (2025-08-11 15:51:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 882.55737ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.............X..X.....................................X...X.] duration:
2.451133512s
FAIL (2025-08-11 15:51:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:50:42.906151185 (70h25m4.865248454s) [upload=73375]: Starting upload Aug 11 15:50:42.906231802 (70h25m4.865329054s) [upload=73375]: Done starting upload Aug 11 15:50:42.906372273 (70h25m4.865469538s) [upload=73375]: Uploading segments... Aug 11 15:50:42.906538489 (70h25m4.865635726s) [upload=73375]: Got next segment. Inline: false Aug 11 15:50:42.906591251 (70h25m4.865688486s) [upload=73375]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:50:42.906599040 (70h25m4.865696281s) [upload=73375]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 15:50:42.995591137 (70h25m4.954688373s) [upload=73375]: Next segment err: metaclient: Too Many Requests Aug 11 15:50:42.995638106 (70h25m4.954735352s) [upload=73375]: Done uploading segments... Aug 11 15:50:42.995655809 (70h25m4.954753056s) [upload=73375]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.451165925s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
3.536011655s
FAIL (2025-08-11 15:51:23 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 3.536050394s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
955.350772ms
FAIL (2025-08-11 15:51:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 955.385793ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
3.07712145s
FAIL (2025-08-11 15:50:51 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 3.077248721s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..............X..X.....................................X...X] duration:
361.366418ms
FAIL (2025-08-11 15:50:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:50:42.906151185 (70h25m4.865248454s) [upload=73375]: Starting upload Aug 11 15:50:42.906231802 (70h25m4.865329054s) [upload=73375]: Done starting upload Aug 11 15:50:42.906372273 (70h25m4.865469538s) [upload=73375]: Uploading segments... Aug 11 15:50:42.906538489 (70h25m4.865635726s) [upload=73375]: Got next segment. Inline: false Aug 11 15:50:42.906591251 (70h25m4.865688486s) [upload=73375]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:50:42.906599040 (70h25m4.865696281s) [upload=73375]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 15:50:42.995591137 (70h25m4.954688373s) [upload=73375]: Next segment err: metaclient: Too Many Requests Aug 11 15:50:42.995638106 (70h25m4.954735352s) [upload=73375]: Done uploading segments... Aug 11 15:50:42.995655809 (70h25m4.954753056s) [upload=73375]: Upload finished. err: metaclient: Too Many Requests
Duration: 361.393268ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.052944532s
FAIL (2025-08-11 15:50:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.052973606s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X..X.....................................X...] duration:
2.466973026s
FAIL (2025-08-11 15:50:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 15:48:11.459693623 (70h22m33.418790859s) [upload=73330]: Starting upload
Aug 11 15:48:11.459765839 (70h22m33.418863085s) [upload=73330]: Done starting upload
Aug 11 15:48:11.459836267 (70h22m33.418933511s) [upload=73330]: Uploading segments...
Aug 11 15:48:11.460115676 (70h22m33.419212923s) [upload=73330]: Got next segment. Inline: false
Aug 11 15:48:11.460173954 (70h22m33.4192712s) [upload=73330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 15:48:11.460180066 (70h22m33.419277311s) [upload=73330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 15:48:11.662539822 (70h22m33.621637069s) [seg_pos={0 0}, upload=73330]: Begin upload segment...
Aug 11 15:48:11.662600813 (70h22m33.621698052s) [seg_pos={0 0}, upload=73330]: Done begin upload segment.
Aug 11 15:48:11.662641225 (70h22m33.621738668s) [noise=true , address=104.36.82.58:4297 , piece_id=COX2NAIRGIZEV2CXPRBIN53E7XG7BBQIEN37DOQKXVTIFOKCYWDQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.662670807 (70h22m33.621768054s) [noise=true , address=64.49.13.139:4469 , piece_id=3NAXYOLQ2AZYMPFC73EEK4UWAOZDTZ4ITORQLAYOJO4ZQKMUGLHQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663084803 (70h22m33.622182067s) [noise=true , address=79.127.201.215:4350 , piece_id=YPM7M435J7RKS7OZAQTETPIZWRGRO2OLHRK4GQPY5P7ARN4M6TIA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663350372 (70h22m33.622447626s) [noise=true , address=45.91.116.14:4199 , piece_id=MY2OA5RYBXNWT6UXDLBPUZNDKTYZSHBJZD7K5ZNA66FOFB4UUDTQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663622292 (70h22m33.622719547s) [noise=true , address=79.127.219.48:4086 , piece_id=OHMKGVAIQUNDMEO6LABSZO3WO4IJVX6KYJGACTYUSM2EVN3XKVWQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663834852 (70h22m33.622932097s) [noise=true , address=104.36.82.19:4407 , piece_id=2623QHC3GBGRZTWUS2D7U7W2JP56EJVKK5HJUP4BZU5ESUNVYKKQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663983153 (70h22m33.623080407s) [noise=true , address=104.36.82.36:4648 , piece_id=MZ56B7JUHGQV7R5IHPISRUZ5SHHQ6RQPRNLHPF2JZVN7HZH2U4GA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664205831 (70h22m33.623303086s) [noise=true , address=104.36.82.44:4886 , piece_id=CS5F3FSFCGIV56CGKB32S5PCSXYNNF3ZMY4RSDRNRKU3OEBFCABQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664279956 (70h22m33.623377205s) [noise=true , address=104.36.82.60:4345 , piece_id=EZYVWABIRABD6DBBVFEB4AUMBCOUMH2BHZIXXRILE75JZXYDMFTA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664603129 (70h22m33.623700381s) [noise=true , address=104.36.82.20:4442 , piece_id=564U3VID25TET26K2CUVMNJACKYN7G3HMHKYRCYJYSKFCEOIGO3Q, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664615102 (70h22m33.62371235s) [noise=true , address=79.127.205.234:4595 , piece_id=T6UCZXLI6WSYTOC42NAEVN4VQ3ZYXRSE2LNSXD2TMBGLSUM2QX6Q, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664917644 (70h22m33.624014896s) [noise=true , address=104.36.82.5:4855 , piece_id=NL5YRMWVCMJJNPILE22G4GDHDUCPTC33MVSQQ33ZUPJ65TMJVQVQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664980167 (70h22m33.624077415s) [noise=true , address=77.90.31.18:4834 , piece_id=U74G4KGOORHSJEY7OPO2DWLRYU55XQ7VUSUTQWKLPLRJIDFPRJXA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.665234383 (70h22m33.624331631s) [noise=true , address=77.90.31.10:4547 , piece_id=2CM7IMERAYUNPKZWLU7VCYOQXQDVQK6TC5EGURI7VFLRAFA5LOTQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.665310119 (70h22m33.624407365s) [noise=true , address=45.91.116.12:4248 , piece_id=W2MFQD2ON4TOEYMEC3QE54ITH2CCTLNAY3QQJ6XJKKWMZ6UY6CEQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.665523740 (70h22m33.624620989s) [noise=true , address=104.36.82.59:4332 , piece_id=TBRPFFNJ6SSFHYPPAS4UAYZLVW5M3ZCCFLTO4ZEFXKNJC5L2AONA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.665675954 (70h22m33.624773248s) [noise=true , address=104.36.82.37:4676 , piece_id=TQSWTZGOZ3O277GGVUPSW3JBSKMXJNBC3QBZM27RU5HY3AQMB56A, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.666053127 (70h22m33.625150373s) [noise=true , address=104.36.82.60:4356 , piece_id=URFFFCRGO5G3VNYXJ4MXHOXJIRWHZISZKXSHD23RUGIGNTWZM3JQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:12.235046037 (70h22m34.194143275s) [upload=73330]: Next returned nil segment
Aug 11 15:48:12.235066257 (70h22m34.194163539s) [upload=73330]: Waiting for error group managing segments...
Aug 11 15:48:12.367097666 (70h22m34.326194898s) [noise=true , address=45.91.116.12:4248 , piece_id=W2MFQD2ON4TOEYMEC3QE54ITH2CCTLNAY3QQJ6XJKKWMZ6UY6CEQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.368825191 (70h22m34.32792243s) [noise=true , address=77.90.31.18:4834 , piece_id=U74G4KGOORHSJEY7OPO2DWLRYU55XQ7VUSUTQWKLPLRJIDFPRJXA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.369318887 (70h22m34.328416133s) [noise=true , address=45.91.116.14:4199 , piece_id=MY2OA5RYBXNWT6UXDLBPUZNDKTYZSHBJZD7K5ZNA66FOFB4UUDTQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.380500910 (70h22m34.339598141s) [noise=true , address=77.90.31.10:4547 , piece_id=2CM7IMERAYUNPKZWLU7VCYOQXQDVQK6TC5EGURI7VFLRAFA5LOTQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.386692990 (70h22m34.345790229s) [noise=true , address=104.36.82.44:4886 , piece_id=CS5F3FSFCGIV56CGKB32S5PCSXYNNF3ZMY4RSDRNRKU3OEBFCABQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.387288251 (70h22m34.346385489s) [noise=true , address=104.36.82.60:4345 , piece_id=EZYVWABIRABD6DBBVFEB4AUMBCOUMH2BHZIXXRILE75JZXYDMFTA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.387372711 (70h22m34.346469957s) [noise=true , address=104.36.82.20:4442 , piece_id=564U3VID25TET26K2CUVMNJACKYN7G3HMHKYRCYJYSKFCEOIGO3Q, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.392570699 (70h22m34.351668069s) [noise=true , address=104.36.82.19:4407 , piece_id=2623QHC3GBGRZTWUS2D7U7W2JP56EJVKK5HJUP4BZU5ESUNVYKKQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.408416886 (70h22m34.367514139s) [noise=true , address=104.36.82.58:4297 , piece_id=COX2NAIRGIZEV2CXPRBIN53E7XG7BBQIEN37DOQKXVTIFOKCYWDQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.409115758 (70h22m34.368212997s) [noise=true , address=104.36.82.59:4332 , piece_id=TBRPFFNJ6SSFHYPPAS4UAYZLVW5M3ZCCFLTO4ZEFXKNJC5L2AONA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.409576124 (70h22m34.368673363s) [noise=true , address=104.36.82.37:4676 , piece_id=TQSWTZGOZ3O277GGVUPSW3JBSKMXJNBC3QBZM27RU5HY3AQMB56A, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.423105512 (70h22m34.382202762s) [noise=true , address=104.36.82.60:4356 , piece_id=URFFFCRGO5G3VNYXJ4MXHOXJIRWHZISZKXSHD23RUGIGNTWZM3JQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.435430991 (70h22m34.394528229s) [noise=true , address=79.127.219.48:4086 , piece_id=OHMKGVAIQUNDMEO6LABSZO3WO4IJVX6KYJGACTYUSM2EVN3XKVWQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.482793318 (70h22m34.441890564s) [noise=true , address=104.36.82.36:4648 , piece_id=MZ56B7JUHGQV7R5IHPISRUZ5SHHQ6RQPRNLHPF2JZVN7HZH2U4GA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.482829523 (70h22m34.441926771s) [seg_pos={0 0}, upload=73330]: Segment reached optimal threshold of 14 pieces.
Aug 11 15:48:12.483026376 (70h22m34.442123612s) [noise=true , address=79.127.201.215:4350 , piece_id=YPM7M435J7RKS7OZAQTETPIZWRGRO2OLHRK4GQPY5P7ARN4M6TIA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 11 15:48:12.483394844 (70h22m34.442492098s) [noise=true , address=64.49.13.139:4469 , piece_id=3NAXYOLQ2AZYMPFC73EEK4UWAOZDTZ4ITORQLAYOJO4ZQKMUGLHQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:54052->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:54052->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54052->64.49.13.139:4469: use of closed network connection
Aug 11 15:48:12.483489616 (70h22m34.442586865s) [noise=true , address=79.127.205.234:4595 , piece_id=T6UCZXLI6WSYTOC42NAEVN4VQ3ZYXRSE2LNSXD2TMBGLSUM2QX6Q, seg_pos={0 0}, upload=73330]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:42198->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:42198->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42198->79.127.205.234:4595: use of closed network connection
Aug 11 15:48:12.483517372 (70h22m34.442614605s) [noise=true , address=104.36.82.5:4855 , piece_id=NL5YRMWVCMJJNPILE22G4GDHDUCPTC33MVSQQ33ZUPJ65TMJVQVQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 139.59.144.22:40876->104.36.82.5:4855: use of closed network connection; write tcp 139.59.144.22:40876->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40876->104.36.82.5:4855: use of closed network connection
Aug 11 15:48:12.483558773 (70h22m34.442656017s) [seg_pos={0 0}, upload=73330]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 15:48:12.483653891 (70h22m34.442751137s) [upload=73330]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 15:48:12.483659147 (70h22m34.442756392s) [upload=73330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 15:48:13.234763150 (70h22m35.193860401s) [upload=73330]: Done uploading segments...
Aug 11 15:48:13.234789105 (70h22m35.19388634s) [upload=73330]: Upload finished. err: <nil>
Duration: 2.466998448s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
880.339538ms
FAIL (2025-08-11 15:50:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 880.385813ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X..X.....................................X..] duration:
2.569615065s
FAIL (2025-08-11 15:49:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 15:48:11.459693623 (70h22m33.418790859s) [upload=73330]: Starting upload
Aug 11 15:48:11.459765839 (70h22m33.418863085s) [upload=73330]: Done starting upload
Aug 11 15:48:11.459836267 (70h22m33.418933511s) [upload=73330]: Uploading segments...
Aug 11 15:48:11.460115676 (70h22m33.419212923s) [upload=73330]: Got next segment. Inline: false
Aug 11 15:48:11.460173954 (70h22m33.4192712s) [upload=73330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 15:48:11.460180066 (70h22m33.419277311s) [upload=73330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 15:48:11.662539822 (70h22m33.621637069s) [seg_pos={0 0}, upload=73330]: Begin upload segment...
Aug 11 15:48:11.662600813 (70h22m33.621698052s) [seg_pos={0 0}, upload=73330]: Done begin upload segment.
Aug 11 15:48:11.662641225 (70h22m33.621738668s) [noise=true , address=104.36.82.58:4297 , piece_id=COX2NAIRGIZEV2CXPRBIN53E7XG7BBQIEN37DOQKXVTIFOKCYWDQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.662670807 (70h22m33.621768054s) [noise=true , address=64.49.13.139:4469 , piece_id=3NAXYOLQ2AZYMPFC73EEK4UWAOZDTZ4ITORQLAYOJO4ZQKMUGLHQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663084803 (70h22m33.622182067s) [noise=true , address=79.127.201.215:4350 , piece_id=YPM7M435J7RKS7OZAQTETPIZWRGRO2OLHRK4GQPY5P7ARN4M6TIA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663350372 (70h22m33.622447626s) [noise=true , address=45.91.116.14:4199 , piece_id=MY2OA5RYBXNWT6UXDLBPUZNDKTYZSHBJZD7K5ZNA66FOFB4UUDTQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663622292 (70h22m33.622719547s) [noise=true , address=79.127.219.48:4086 , piece_id=OHMKGVAIQUNDMEO6LABSZO3WO4IJVX6KYJGACTYUSM2EVN3XKVWQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663834852 (70h22m33.622932097s) [noise=true , address=104.36.82.19:4407 , piece_id=2623QHC3GBGRZTWUS2D7U7W2JP56EJVKK5HJUP4BZU5ESUNVYKKQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663983153 (70h22m33.623080407s) [noise=true , address=104.36.82.36:4648 , piece_id=MZ56B7JUHGQV7R5IHPISRUZ5SHHQ6RQPRNLHPF2JZVN7HZH2U4GA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664205831 (70h22m33.623303086s) [noise=true , address=104.36.82.44:4886 , piece_id=CS5F3FSFCGIV56CGKB32S5PCSXYNNF3ZMY4RSDRNRKU3OEBFCABQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664279956 (70h22m33.623377205s) [noise=true , address=104.36.82.60:4345 , piece_id=EZYVWABIRABD6DBBVFEB4AUMBCOUMH2BHZIXXRILE75JZXYDMFTA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664603129 (70h22m33.623700381s) [noise=true , address=104.36.82.20:4442 , piece_id=564U3VID25TET26K2CUVMNJACKYN7G3HMHKYRCYJYSKFCEOIGO3Q, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664615102 (70h22m33.62371235s) [noise=true , address=79.127.205.234:4595 , piece_id=T6UCZXLI6WSYTOC42NAEVN4VQ3ZYXRSE2LNSXD2TMBGLSUM2QX6Q, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664917644 (70h22m33.624014896s) [noise=true , address=104.36.82.5:4855 , piece_id=NL5YRMWVCMJJNPILE22G4GDHDUCPTC33MVSQQ33ZUPJ65TMJVQVQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664980167 (70h22m33.624077415s) [noise=true , address=77.90.31.18:4834 , piece_id=U74G4KGOORHSJEY7OPO2DWLRYU55XQ7VUSUTQWKLPLRJIDFPRJXA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.665234383 (70h22m33.624331631s) [noise=true , address=77.90.31.10:4547 , piece_id=2CM7IMERAYUNPKZWLU7VCYOQXQDVQK6TC5EGURI7VFLRAFA5LOTQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.665310119 (70h22m33.624407365s) [noise=true , address=45.91.116.12:4248 , piece_id=W2MFQD2ON4TOEYMEC3QE54ITH2CCTLNAY3QQJ6XJKKWMZ6UY6CEQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.665523740 (70h22m33.624620989s) [noise=true , address=104.36.82.59:4332 , piece_id=TBRPFFNJ6SSFHYPPAS4UAYZLVW5M3ZCCFLTO4ZEFXKNJC5L2AONA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.665675954 (70h22m33.624773248s) [noise=true , address=104.36.82.37:4676 , piece_id=TQSWTZGOZ3O277GGVUPSW3JBSKMXJNBC3QBZM27RU5HY3AQMB56A, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.666053127 (70h22m33.625150373s) [noise=true , address=104.36.82.60:4356 , piece_id=URFFFCRGO5G3VNYXJ4MXHOXJIRWHZISZKXSHD23RUGIGNTWZM3JQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:12.235046037 (70h22m34.194143275s) [upload=73330]: Next returned nil segment
Aug 11 15:48:12.235066257 (70h22m34.194163539s) [upload=73330]: Waiting for error group managing segments...
Aug 11 15:48:12.367097666 (70h22m34.326194898s) [noise=true , address=45.91.116.12:4248 , piece_id=W2MFQD2ON4TOEYMEC3QE54ITH2CCTLNAY3QQJ6XJKKWMZ6UY6CEQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.368825191 (70h22m34.32792243s) [noise=true , address=77.90.31.18:4834 , piece_id=U74G4KGOORHSJEY7OPO2DWLRYU55XQ7VUSUTQWKLPLRJIDFPRJXA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.369318887 (70h22m34.328416133s) [noise=true , address=45.91.116.14:4199 , piece_id=MY2OA5RYBXNWT6UXDLBPUZNDKTYZSHBJZD7K5ZNA66FOFB4UUDTQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.380500910 (70h22m34.339598141s) [noise=true , address=77.90.31.10:4547 , piece_id=2CM7IMERAYUNPKZWLU7VCYOQXQDVQK6TC5EGURI7VFLRAFA5LOTQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.386692990 (70h22m34.345790229s) [noise=true , address=104.36.82.44:4886 , piece_id=CS5F3FSFCGIV56CGKB32S5PCSXYNNF3ZMY4RSDRNRKU3OEBFCABQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.387288251 (70h22m34.346385489s) [noise=true , address=104.36.82.60:4345 , piece_id=EZYVWABIRABD6DBBVFEB4AUMBCOUMH2BHZIXXRILE75JZXYDMFTA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.387372711 (70h22m34.346469957s) [noise=true , address=104.36.82.20:4442 , piece_id=564U3VID25TET26K2CUVMNJACKYN7G3HMHKYRCYJYSKFCEOIGO3Q, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.392570699 (70h22m34.351668069s) [noise=true , address=104.36.82.19:4407 , piece_id=2623QHC3GBGRZTWUS2D7U7W2JP56EJVKK5HJUP4BZU5ESUNVYKKQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.408416886 (70h22m34.367514139s) [noise=true , address=104.36.82.58:4297 , piece_id=COX2NAIRGIZEV2CXPRBIN53E7XG7BBQIEN37DOQKXVTIFOKCYWDQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.409115758 (70h22m34.368212997s) [noise=true , address=104.36.82.59:4332 , piece_id=TBRPFFNJ6SSFHYPPAS4UAYZLVW5M3ZCCFLTO4ZEFXKNJC5L2AONA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.409576124 (70h22m34.368673363s) [noise=true , address=104.36.82.37:4676 , piece_id=TQSWTZGOZ3O277GGVUPSW3JBSKMXJNBC3QBZM27RU5HY3AQMB56A, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.423105512 (70h22m34.382202762s) [noise=true , address=104.36.82.60:4356 , piece_id=URFFFCRGO5G3VNYXJ4MXHOXJIRWHZISZKXSHD23RUGIGNTWZM3JQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.435430991 (70h22m34.394528229s) [noise=true , address=79.127.219.48:4086 , piece_id=OHMKGVAIQUNDMEO6LABSZO3WO4IJVX6KYJGACTYUSM2EVN3XKVWQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.482793318 (70h22m34.441890564s) [noise=true , address=104.36.82.36:4648 , piece_id=MZ56B7JUHGQV7R5IHPISRUZ5SHHQ6RQPRNLHPF2JZVN7HZH2U4GA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.482829523 (70h22m34.441926771s) [seg_pos={0 0}, upload=73330]: Segment reached optimal threshold of 14 pieces.
Aug 11 15:48:12.483026376 (70h22m34.442123612s) [noise=true , address=79.127.201.215:4350 , piece_id=YPM7M435J7RKS7OZAQTETPIZWRGRO2OLHRK4GQPY5P7ARN4M6TIA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 11 15:48:12.483394844 (70h22m34.442492098s) [noise=true , address=64.49.13.139:4469 , piece_id=3NAXYOLQ2AZYMPFC73EEK4UWAOZDTZ4ITORQLAYOJO4ZQKMUGLHQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:54052->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:54052->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54052->64.49.13.139:4469: use of closed network connection
Aug 11 15:48:12.483489616 (70h22m34.442586865s) [noise=true , address=79.127.205.234:4595 , piece_id=T6UCZXLI6WSYTOC42NAEVN4VQ3ZYXRSE2LNSXD2TMBGLSUM2QX6Q, seg_pos={0 0}, upload=73330]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:42198->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:42198->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42198->79.127.205.234:4595: use of closed network connection
Aug 11 15:48:12.483517372 (70h22m34.442614605s) [noise=true , address=104.36.82.5:4855 , piece_id=NL5YRMWVCMJJNPILE22G4GDHDUCPTC33MVSQQ33ZUPJ65TMJVQVQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 139.59.144.22:40876->104.36.82.5:4855: use of closed network connection; write tcp 139.59.144.22:40876->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40876->104.36.82.5:4855: use of closed network connection
Aug 11 15:48:12.483558773 (70h22m34.442656017s) [seg_pos={0 0}, upload=73330]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 15:48:12.483653891 (70h22m34.442751137s) [upload=73330]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 15:48:12.483659147 (70h22m34.442756392s) [upload=73330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 15:48:13.234763150 (70h22m35.193860401s) [upload=73330]: Done uploading segments...
Aug 11 15:48:13.234789105 (70h22m35.19388634s) [upload=73330]: Upload finished. err: <nil>
Duration: 2.569651828s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
983.862849ms
FAIL (2025-08-11 15:49:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 983.894719ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
3.146838282s
FAIL (2025-08-11 15:49:44 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 3.146868344s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
864.238593ms
FAIL (2025-08-11 15:49:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.27092ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001356508s
FAIL (2025-08-11 15:48:57 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 30.001381813s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X..X.....................................X.] duration:
2.48734641s
FAIL (2025-08-11 15:48:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 15:48:11.459693623 (70h22m33.418790859s) [upload=73330]: Starting upload
Aug 11 15:48:11.459765839 (70h22m33.418863085s) [upload=73330]: Done starting upload
Aug 11 15:48:11.459836267 (70h22m33.418933511s) [upload=73330]: Uploading segments...
Aug 11 15:48:11.460115676 (70h22m33.419212923s) [upload=73330]: Got next segment. Inline: false
Aug 11 15:48:11.460173954 (70h22m33.4192712s) [upload=73330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 15:48:11.460180066 (70h22m33.419277311s) [upload=73330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 15:48:11.662539822 (70h22m33.621637069s) [seg_pos={0 0}, upload=73330]: Begin upload segment...
Aug 11 15:48:11.662600813 (70h22m33.621698052s) [seg_pos={0 0}, upload=73330]: Done begin upload segment.
Aug 11 15:48:11.662641225 (70h22m33.621738668s) [noise=true , address=104.36.82.58:4297 , piece_id=COX2NAIRGIZEV2CXPRBIN53E7XG7BBQIEN37DOQKXVTIFOKCYWDQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.662670807 (70h22m33.621768054s) [noise=true , address=64.49.13.139:4469 , piece_id=3NAXYOLQ2AZYMPFC73EEK4UWAOZDTZ4ITORQLAYOJO4ZQKMUGLHQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663084803 (70h22m33.622182067s) [noise=true , address=79.127.201.215:4350 , piece_id=YPM7M435J7RKS7OZAQTETPIZWRGRO2OLHRK4GQPY5P7ARN4M6TIA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663350372 (70h22m33.622447626s) [noise=true , address=45.91.116.14:4199 , piece_id=MY2OA5RYBXNWT6UXDLBPUZNDKTYZSHBJZD7K5ZNA66FOFB4UUDTQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663622292 (70h22m33.622719547s) [noise=true , address=79.127.219.48:4086 , piece_id=OHMKGVAIQUNDMEO6LABSZO3WO4IJVX6KYJGACTYUSM2EVN3XKVWQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663834852 (70h22m33.622932097s) [noise=true , address=104.36.82.19:4407 , piece_id=2623QHC3GBGRZTWUS2D7U7W2JP56EJVKK5HJUP4BZU5ESUNVYKKQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663983153 (70h22m33.623080407s) [noise=true , address=104.36.82.36:4648 , piece_id=MZ56B7JUHGQV7R5IHPISRUZ5SHHQ6RQPRNLHPF2JZVN7HZH2U4GA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664205831 (70h22m33.623303086s) [noise=true , address=104.36.82.44:4886 , piece_id=CS5F3FSFCGIV56CGKB32S5PCSXYNNF3ZMY4RSDRNRKU3OEBFCABQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664279956 (70h22m33.623377205s) [noise=true , address=104.36.82.60:4345 , piece_id=EZYVWABIRABD6DBBVFEB4AUMBCOUMH2BHZIXXRILE75JZXYDMFTA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664603129 (70h22m33.623700381s) [noise=true , address=104.36.82.20:4442 , piece_id=564U3VID25TET26K2CUVMNJACKYN7G3HMHKYRCYJYSKFCEOIGO3Q, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664615102 (70h22m33.62371235s) [noise=true , address=79.127.205.234:4595 , piece_id=T6UCZXLI6WSYTOC42NAEVN4VQ3ZYXRSE2LNSXD2TMBGLSUM2QX6Q, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664917644 (70h22m33.624014896s) [noise=true , address=104.36.82.5:4855 , piece_id=NL5YRMWVCMJJNPILE22G4GDHDUCPTC33MVSQQ33ZUPJ65TMJVQVQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664980167 (70h22m33.624077415s) [noise=true , address=77.90.31.18:4834 , piece_id=U74G4KGOORHSJEY7OPO2DWLRYU55XQ7VUSUTQWKLPLRJIDFPRJXA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.665234383 (70h22m33.624331631s) [noise=true , address=77.90.31.10:4547 , piece_id=2CM7IMERAYUNPKZWLU7VCYOQXQDVQK6TC5EGURI7VFLRAFA5LOTQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.665310119 (70h22m33.624407365s) [noise=true , address=45.91.116.12:4248 , piece_id=W2MFQD2ON4TOEYMEC3QE54ITH2CCTLNAY3QQJ6XJKKWMZ6UY6CEQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.665523740 (70h22m33.624620989s) [noise=true , address=104.36.82.59:4332 , piece_id=TBRPFFNJ6SSFHYPPAS4UAYZLVW5M3ZCCFLTO4ZEFXKNJC5L2AONA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.665675954 (70h22m33.624773248s) [noise=true , address=104.36.82.37:4676 , piece_id=TQSWTZGOZ3O277GGVUPSW3JBSKMXJNBC3QBZM27RU5HY3AQMB56A, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.666053127 (70h22m33.625150373s) [noise=true , address=104.36.82.60:4356 , piece_id=URFFFCRGO5G3VNYXJ4MXHOXJIRWHZISZKXSHD23RUGIGNTWZM3JQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:12.235046037 (70h22m34.194143275s) [upload=73330]: Next returned nil segment
Aug 11 15:48:12.235066257 (70h22m34.194163539s) [upload=73330]: Waiting for error group managing segments...
Aug 11 15:48:12.367097666 (70h22m34.326194898s) [noise=true , address=45.91.116.12:4248 , piece_id=W2MFQD2ON4TOEYMEC3QE54ITH2CCTLNAY3QQJ6XJKKWMZ6UY6CEQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.368825191 (70h22m34.32792243s) [noise=true , address=77.90.31.18:4834 , piece_id=U74G4KGOORHSJEY7OPO2DWLRYU55XQ7VUSUTQWKLPLRJIDFPRJXA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.369318887 (70h22m34.328416133s) [noise=true , address=45.91.116.14:4199 , piece_id=MY2OA5RYBXNWT6UXDLBPUZNDKTYZSHBJZD7K5ZNA66FOFB4UUDTQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.380500910 (70h22m34.339598141s) [noise=true , address=77.90.31.10:4547 , piece_id=2CM7IMERAYUNPKZWLU7VCYOQXQDVQK6TC5EGURI7VFLRAFA5LOTQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.386692990 (70h22m34.345790229s) [noise=true , address=104.36.82.44:4886 , piece_id=CS5F3FSFCGIV56CGKB32S5PCSXYNNF3ZMY4RSDRNRKU3OEBFCABQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.387288251 (70h22m34.346385489s) [noise=true , address=104.36.82.60:4345 , piece_id=EZYVWABIRABD6DBBVFEB4AUMBCOUMH2BHZIXXRILE75JZXYDMFTA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.387372711 (70h22m34.346469957s) [noise=true , address=104.36.82.20:4442 , piece_id=564U3VID25TET26K2CUVMNJACKYN7G3HMHKYRCYJYSKFCEOIGO3Q, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.392570699 (70h22m34.351668069s) [noise=true , address=104.36.82.19:4407 , piece_id=2623QHC3GBGRZTWUS2D7U7W2JP56EJVKK5HJUP4BZU5ESUNVYKKQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.408416886 (70h22m34.367514139s) [noise=true , address=104.36.82.58:4297 , piece_id=COX2NAIRGIZEV2CXPRBIN53E7XG7BBQIEN37DOQKXVTIFOKCYWDQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.409115758 (70h22m34.368212997s) [noise=true , address=104.36.82.59:4332 , piece_id=TBRPFFNJ6SSFHYPPAS4UAYZLVW5M3ZCCFLTO4ZEFXKNJC5L2AONA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.409576124 (70h22m34.368673363s) [noise=true , address=104.36.82.37:4676 , piece_id=TQSWTZGOZ3O277GGVUPSW3JBSKMXJNBC3QBZM27RU5HY3AQMB56A, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.423105512 (70h22m34.382202762s) [noise=true , address=104.36.82.60:4356 , piece_id=URFFFCRGO5G3VNYXJ4MXHOXJIRWHZISZKXSHD23RUGIGNTWZM3JQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.435430991 (70h22m34.394528229s) [noise=true , address=79.127.219.48:4086 , piece_id=OHMKGVAIQUNDMEO6LABSZO3WO4IJVX6KYJGACTYUSM2EVN3XKVWQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.482793318 (70h22m34.441890564s) [noise=true , address=104.36.82.36:4648 , piece_id=MZ56B7JUHGQV7R5IHPISRUZ5SHHQ6RQPRNLHPF2JZVN7HZH2U4GA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.482829523 (70h22m34.441926771s) [seg_pos={0 0}, upload=73330]: Segment reached optimal threshold of 14 pieces.
Aug 11 15:48:12.483026376 (70h22m34.442123612s) [noise=true , address=79.127.201.215:4350 , piece_id=YPM7M435J7RKS7OZAQTETPIZWRGRO2OLHRK4GQPY5P7ARN4M6TIA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 11 15:48:12.483394844 (70h22m34.442492098s) [noise=true , address=64.49.13.139:4469 , piece_id=3NAXYOLQ2AZYMPFC73EEK4UWAOZDTZ4ITORQLAYOJO4ZQKMUGLHQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:54052->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:54052->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54052->64.49.13.139:4469: use of closed network connection
Aug 11 15:48:12.483489616 (70h22m34.442586865s) [noise=true , address=79.127.205.234:4595 , piece_id=T6UCZXLI6WSYTOC42NAEVN4VQ3ZYXRSE2LNSXD2TMBGLSUM2QX6Q, seg_pos={0 0}, upload=73330]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:42198->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:42198->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42198->79.127.205.234:4595: use of closed network connection
Aug 11 15:48:12.483517372 (70h22m34.442614605s) [noise=true , address=104.36.82.5:4855 , piece_id=NL5YRMWVCMJJNPILE22G4GDHDUCPTC33MVSQQ33ZUPJ65TMJVQVQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 139.59.144.22:40876->104.36.82.5:4855: use of closed network connection; write tcp 139.59.144.22:40876->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40876->104.36.82.5:4855: use of closed network connection
Aug 11 15:48:12.483558773 (70h22m34.442656017s) [seg_pos={0 0}, upload=73330]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 15:48:12.483653891 (70h22m34.442751137s) [upload=73330]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 15:48:12.483659147 (70h22m34.442756392s) [upload=73330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 15:48:13.234763150 (70h22m35.193860401s) [upload=73330]: Done uploading segments...
Aug 11 15:48:13.234789105 (70h22m35.19388634s) [upload=73330]: Upload finished. err: <nil>
Duration: 2.48738217s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X..X.....................................X] duration:
2.27213087s
FAIL (2025-08-11 15:48:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 15:48:11.459693623 (70h22m33.418790859s) [upload=73330]: Starting upload
Aug 11 15:48:11.459765839 (70h22m33.418863085s) [upload=73330]: Done starting upload
Aug 11 15:48:11.459836267 (70h22m33.418933511s) [upload=73330]: Uploading segments...
Aug 11 15:48:11.460115676 (70h22m33.419212923s) [upload=73330]: Got next segment. Inline: false
Aug 11 15:48:11.460173954 (70h22m33.4192712s) [upload=73330]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 15:48:11.460180066 (70h22m33.419277311s) [upload=73330]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 15:48:11.662539822 (70h22m33.621637069s) [seg_pos={0 0}, upload=73330]: Begin upload segment...
Aug 11 15:48:11.662600813 (70h22m33.621698052s) [seg_pos={0 0}, upload=73330]: Done begin upload segment.
Aug 11 15:48:11.662641225 (70h22m33.621738668s) [noise=true , address=104.36.82.58:4297 , piece_id=COX2NAIRGIZEV2CXPRBIN53E7XG7BBQIEN37DOQKXVTIFOKCYWDQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.662670807 (70h22m33.621768054s) [noise=true , address=64.49.13.139:4469 , piece_id=3NAXYOLQ2AZYMPFC73EEK4UWAOZDTZ4ITORQLAYOJO4ZQKMUGLHQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663084803 (70h22m33.622182067s) [noise=true , address=79.127.201.215:4350 , piece_id=YPM7M435J7RKS7OZAQTETPIZWRGRO2OLHRK4GQPY5P7ARN4M6TIA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663350372 (70h22m33.622447626s) [noise=true , address=45.91.116.14:4199 , piece_id=MY2OA5RYBXNWT6UXDLBPUZNDKTYZSHBJZD7K5ZNA66FOFB4UUDTQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663622292 (70h22m33.622719547s) [noise=true , address=79.127.219.48:4086 , piece_id=OHMKGVAIQUNDMEO6LABSZO3WO4IJVX6KYJGACTYUSM2EVN3XKVWQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663834852 (70h22m33.622932097s) [noise=true , address=104.36.82.19:4407 , piece_id=2623QHC3GBGRZTWUS2D7U7W2JP56EJVKK5HJUP4BZU5ESUNVYKKQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.663983153 (70h22m33.623080407s) [noise=true , address=104.36.82.36:4648 , piece_id=MZ56B7JUHGQV7R5IHPISRUZ5SHHQ6RQPRNLHPF2JZVN7HZH2U4GA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664205831 (70h22m33.623303086s) [noise=true , address=104.36.82.44:4886 , piece_id=CS5F3FSFCGIV56CGKB32S5PCSXYNNF3ZMY4RSDRNRKU3OEBFCABQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664279956 (70h22m33.623377205s) [noise=true , address=104.36.82.60:4345 , piece_id=EZYVWABIRABD6DBBVFEB4AUMBCOUMH2BHZIXXRILE75JZXYDMFTA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664603129 (70h22m33.623700381s) [noise=true , address=104.36.82.20:4442 , piece_id=564U3VID25TET26K2CUVMNJACKYN7G3HMHKYRCYJYSKFCEOIGO3Q, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664615102 (70h22m33.62371235s) [noise=true , address=79.127.205.234:4595 , piece_id=T6UCZXLI6WSYTOC42NAEVN4VQ3ZYXRSE2LNSXD2TMBGLSUM2QX6Q, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664917644 (70h22m33.624014896s) [noise=true , address=104.36.82.5:4855 , piece_id=NL5YRMWVCMJJNPILE22G4GDHDUCPTC33MVSQQ33ZUPJ65TMJVQVQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.664980167 (70h22m33.624077415s) [noise=true , address=77.90.31.18:4834 , piece_id=U74G4KGOORHSJEY7OPO2DWLRYU55XQ7VUSUTQWKLPLRJIDFPRJXA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.665234383 (70h22m33.624331631s) [noise=true , address=77.90.31.10:4547 , piece_id=2CM7IMERAYUNPKZWLU7VCYOQXQDVQK6TC5EGURI7VFLRAFA5LOTQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.665310119 (70h22m33.624407365s) [noise=true , address=45.91.116.12:4248 , piece_id=W2MFQD2ON4TOEYMEC3QE54ITH2CCTLNAY3QQJ6XJKKWMZ6UY6CEQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.665523740 (70h22m33.624620989s) [noise=true , address=104.36.82.59:4332 , piece_id=TBRPFFNJ6SSFHYPPAS4UAYZLVW5M3ZCCFLTO4ZEFXKNJC5L2AONA, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.665675954 (70h22m33.624773248s) [noise=true , address=104.36.82.37:4676 , piece_id=TQSWTZGOZ3O277GGVUPSW3JBSKMXJNBC3QBZM27RU5HY3AQMB56A, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:11.666053127 (70h22m33.625150373s) [noise=true , address=104.36.82.60:4356 , piece_id=URFFFCRGO5G3VNYXJ4MXHOXJIRWHZISZKXSHD23RUGIGNTWZM3JQ, seg_pos={0 0}, upload=73330]: Uploading piece...
Aug 11 15:48:12.235046037 (70h22m34.194143275s) [upload=73330]: Next returned nil segment
Aug 11 15:48:12.235066257 (70h22m34.194163539s) [upload=73330]: Waiting for error group managing segments...
Aug 11 15:48:12.367097666 (70h22m34.326194898s) [noise=true , address=45.91.116.12:4248 , piece_id=W2MFQD2ON4TOEYMEC3QE54ITH2CCTLNAY3QQJ6XJKKWMZ6UY6CEQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.368825191 (70h22m34.32792243s) [noise=true , address=77.90.31.18:4834 , piece_id=U74G4KGOORHSJEY7OPO2DWLRYU55XQ7VUSUTQWKLPLRJIDFPRJXA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.369318887 (70h22m34.328416133s) [noise=true , address=45.91.116.14:4199 , piece_id=MY2OA5RYBXNWT6UXDLBPUZNDKTYZSHBJZD7K5ZNA66FOFB4UUDTQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.380500910 (70h22m34.339598141s) [noise=true , address=77.90.31.10:4547 , piece_id=2CM7IMERAYUNPKZWLU7VCYOQXQDVQK6TC5EGURI7VFLRAFA5LOTQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.386692990 (70h22m34.345790229s) [noise=true , address=104.36.82.44:4886 , piece_id=CS5F3FSFCGIV56CGKB32S5PCSXYNNF3ZMY4RSDRNRKU3OEBFCABQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.387288251 (70h22m34.346385489s) [noise=true , address=104.36.82.60:4345 , piece_id=EZYVWABIRABD6DBBVFEB4AUMBCOUMH2BHZIXXRILE75JZXYDMFTA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.387372711 (70h22m34.346469957s) [noise=true , address=104.36.82.20:4442 , piece_id=564U3VID25TET26K2CUVMNJACKYN7G3HMHKYRCYJYSKFCEOIGO3Q, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.392570699 (70h22m34.351668069s) [noise=true , address=104.36.82.19:4407 , piece_id=2623QHC3GBGRZTWUS2D7U7W2JP56EJVKK5HJUP4BZU5ESUNVYKKQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.408416886 (70h22m34.367514139s) [noise=true , address=104.36.82.58:4297 , piece_id=COX2NAIRGIZEV2CXPRBIN53E7XG7BBQIEN37DOQKXVTIFOKCYWDQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.409115758 (70h22m34.368212997s) [noise=true , address=104.36.82.59:4332 , piece_id=TBRPFFNJ6SSFHYPPAS4UAYZLVW5M3ZCCFLTO4ZEFXKNJC5L2AONA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.409576124 (70h22m34.368673363s) [noise=true , address=104.36.82.37:4676 , piece_id=TQSWTZGOZ3O277GGVUPSW3JBSKMXJNBC3QBZM27RU5HY3AQMB56A, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.423105512 (70h22m34.382202762s) [noise=true , address=104.36.82.60:4356 , piece_id=URFFFCRGO5G3VNYXJ4MXHOXJIRWHZISZKXSHD23RUGIGNTWZM3JQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.435430991 (70h22m34.394528229s) [noise=true , address=79.127.219.48:4086 , piece_id=OHMKGVAIQUNDMEO6LABSZO3WO4IJVX6KYJGACTYUSM2EVN3XKVWQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.482793318 (70h22m34.441890564s) [noise=true , address=104.36.82.36:4648 , piece_id=MZ56B7JUHGQV7R5IHPISRUZ5SHHQ6RQPRNLHPF2JZVN7HZH2U4GA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: <nil>
Aug 11 15:48:12.482829523 (70h22m34.441926771s) [seg_pos={0 0}, upload=73330]: Segment reached optimal threshold of 14 pieces.
Aug 11 15:48:12.483026376 (70h22m34.442123612s) [noise=true , address=79.127.201.215:4350 , piece_id=YPM7M435J7RKS7OZAQTETPIZWRGRO2OLHRK4GQPY5P7ARN4M6TIA, seg_pos={0 0}, upload=73330]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 11 15:48:12.483394844 (70h22m34.442492098s) [noise=true , address=64.49.13.139:4469 , piece_id=3NAXYOLQ2AZYMPFC73EEK4UWAOZDTZ4ITORQLAYOJO4ZQKMUGLHQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:54052->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:54052->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54052->64.49.13.139:4469: use of closed network connection
Aug 11 15:48:12.483489616 (70h22m34.442586865s) [noise=true , address=79.127.205.234:4595 , piece_id=T6UCZXLI6WSYTOC42NAEVN4VQ3ZYXRSE2LNSXD2TMBGLSUM2QX6Q, seg_pos={0 0}, upload=73330]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:42198->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:42198->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42198->79.127.205.234:4595: use of closed network connection
Aug 11 15:48:12.483517372 (70h22m34.442614605s) [noise=true , address=104.36.82.5:4855 , piece_id=NL5YRMWVCMJJNPILE22G4GDHDUCPTC33MVSQQ33ZUPJ65TMJVQVQ, seg_pos={0 0}, upload=73330]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 139.59.144.22:40876->104.36.82.5:4855: use of closed network connection; write tcp 139.59.144.22:40876->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40876->104.36.82.5:4855: use of closed network connection
Aug 11 15:48:12.483558773 (70h22m34.442656017s) [seg_pos={0 0}, upload=73330]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 15:48:12.483653891 (70h22m34.442751137s) [upload=73330]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 15:48:12.483659147 (70h22m34.442756392s) [upload=73330]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 15:48:13.234763150 (70h22m35.193860401s) [upload=73330]: Done uploading segments...
Aug 11 15:48:13.234789105 (70h22m35.19388634s) [upload=73330]: Upload finished. err: <nil>
Duration: 2.272162605s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
1.002081298s
FAIL (2025-08-11 15:48:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.002111686s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X..X.....................................] duration:
2.5059485s
FAIL (2025-08-11 15:47:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 15:18:41.385489772 (69h53m3.344587018s) [upload=72812]: Starting upload
Aug 11 15:18:41.385546881 (69h53m3.344644126s) [upload=72812]: Done starting upload
Aug 11 15:18:41.385719888 (69h53m3.344817125s) [upload=72812]: Uploading segments...
Aug 11 15:18:41.386092473 (69h53m3.345189734s) [upload=72812]: Got next segment. Inline: false
Aug 11 15:18:41.386168354 (69h53m3.345265591s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 15:18:41.386174694 (69h53m3.345271928s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 15:18:41.583934962 (69h53m3.543032215s) [seg_pos={0 0}, upload=72812]: Begin upload segment...
Aug 11 15:18:41.583999395 (69h53m3.543096629s) [seg_pos={0 0}, upload=72812]: Done begin upload segment.
Aug 11 15:18:41.584031343 (69h53m3.543128598s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584464473 (69h53m3.543561719s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584738671 (69h53m3.543835917s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.589970068 (69h53m3.54906737s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.592687997 (69h53m3.551785254s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593409977 (69h53m3.552507231s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593729485 (69h53m3.552826739s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.594271156 (69h53m3.553368404s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.595792287 (69h53m3.554889538s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596487549 (69h53m3.555584795s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596607219 (69h53m3.555704476s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597068576 (69h53m3.556165832s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597775168 (69h53m3.556872418s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.598361262 (69h53m3.557458519s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.599504073 (69h53m3.558601324s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.600941047 (69h53m3.560038299s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601403848 (69h53m3.560501104s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601947525 (69h53m3.561044773s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:42.170396643 (69h53m4.129493891s) [upload=72812]: Next returned nil segment
Aug 11 15:18:42.170418005 (69h53m4.129515261s) [upload=72812]: Waiting for error group managing segments...
Aug 11 15:18:42.307059843 (69h53m4.266157095s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.317570550 (69h53m4.276667789s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.320723102 (69h53m4.279820348s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.323996782 (69h53m4.283094014s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.324515612 (69h53m4.283612843s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.325020330 (69h53m4.284117577s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.326792722 (69h53m4.285889969s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.329895347 (69h53m4.28899258s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.334285876 (69h53m4.293383115s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.337141777 (69h53m4.296239008s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.344384543 (69h53m4.303481789s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.350596582 (69h53m4.309693821s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.353811492 (69h53m4.312908729s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374742854 (69h53m4.333840085s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374768982 (69h53m4.333866229s) [seg_pos={0 0}, upload=72812]: Segment reached optimal threshold of 14 pieces.
Aug 11 15:18:42.374993957 (69h53m4.334091202s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 11 15:18:42.375308925 (69h53m4.334406172s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): internal: context canceled
Aug 11 15:18:42.375386257 (69h53m4.334483504s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection
Aug 11 15:18:42.375492641 (69h53m4.33458989s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection
Aug 11 15:18:42.375523754 (69h53m4.334621006s) [seg_pos={0 0}, upload=72812]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 15:18:42.375660518 (69h53m4.334757773s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 15:18:42.375666576 (69h53m4.334763829s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 15:18:42.524978827 (69h53m4.484076072s) [upload=72812]: Done uploading segments...
Aug 11 15:18:42.525000143 (69h53m4.484097381s) [upload=72812]: Upload finished. err: <nil>
Duration: 2.506073159s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
946.333821ms
FAIL (2025-08-11 15:46:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 946.365427ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X..X....................................] duration:
2.427983467s
FAIL (2025-08-11 15:46:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 15:18:41.385489772 (69h53m3.344587018s) [upload=72812]: Starting upload
Aug 11 15:18:41.385546881 (69h53m3.344644126s) [upload=72812]: Done starting upload
Aug 11 15:18:41.385719888 (69h53m3.344817125s) [upload=72812]: Uploading segments...
Aug 11 15:18:41.386092473 (69h53m3.345189734s) [upload=72812]: Got next segment. Inline: false
Aug 11 15:18:41.386168354 (69h53m3.345265591s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 15:18:41.386174694 (69h53m3.345271928s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 15:18:41.583934962 (69h53m3.543032215s) [seg_pos={0 0}, upload=72812]: Begin upload segment...
Aug 11 15:18:41.583999395 (69h53m3.543096629s) [seg_pos={0 0}, upload=72812]: Done begin upload segment.
Aug 11 15:18:41.584031343 (69h53m3.543128598s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584464473 (69h53m3.543561719s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584738671 (69h53m3.543835917s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.589970068 (69h53m3.54906737s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.592687997 (69h53m3.551785254s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593409977 (69h53m3.552507231s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593729485 (69h53m3.552826739s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.594271156 (69h53m3.553368404s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.595792287 (69h53m3.554889538s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596487549 (69h53m3.555584795s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596607219 (69h53m3.555704476s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597068576 (69h53m3.556165832s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597775168 (69h53m3.556872418s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.598361262 (69h53m3.557458519s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.599504073 (69h53m3.558601324s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.600941047 (69h53m3.560038299s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601403848 (69h53m3.560501104s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601947525 (69h53m3.561044773s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:42.170396643 (69h53m4.129493891s) [upload=72812]: Next returned nil segment
Aug 11 15:18:42.170418005 (69h53m4.129515261s) [upload=72812]: Waiting for error group managing segments...
Aug 11 15:18:42.307059843 (69h53m4.266157095s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.317570550 (69h53m4.276667789s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.320723102 (69h53m4.279820348s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.323996782 (69h53m4.283094014s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.324515612 (69h53m4.283612843s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.325020330 (69h53m4.284117577s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.326792722 (69h53m4.285889969s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.329895347 (69h53m4.28899258s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.334285876 (69h53m4.293383115s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.337141777 (69h53m4.296239008s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.344384543 (69h53m4.303481789s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.350596582 (69h53m4.309693821s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.353811492 (69h53m4.312908729s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374742854 (69h53m4.333840085s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374768982 (69h53m4.333866229s) [seg_pos={0 0}, upload=72812]: Segment reached optimal threshold of 14 pieces.
Aug 11 15:18:42.374993957 (69h53m4.334091202s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 11 15:18:42.375308925 (69h53m4.334406172s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): internal: context canceled
Aug 11 15:18:42.375386257 (69h53m4.334483504s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection
Aug 11 15:18:42.375492641 (69h53m4.33458989s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection
Aug 11 15:18:42.375523754 (69h53m4.334621006s) [seg_pos={0 0}, upload=72812]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 15:18:42.375660518 (69h53m4.334757773s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 15:18:42.375666576 (69h53m4.334763829s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 15:18:42.524978827 (69h53m4.484076072s) [upload=72812]: Done uploading segments...
Aug 11 15:18:42.525000143 (69h53m4.484097381s) [upload=72812]: Upload finished. err: <nil>
Duration: 2.428015782s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
879.940585ms
FAIL (2025-08-11 15:45:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 879.984821ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X..X...................................] duration:
2.491122342s
FAIL (2025-08-11 15:45:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 15:18:41.385489772 (69h53m3.344587018s) [upload=72812]: Starting upload
Aug 11 15:18:41.385546881 (69h53m3.344644126s) [upload=72812]: Done starting upload
Aug 11 15:18:41.385719888 (69h53m3.344817125s) [upload=72812]: Uploading segments...
Aug 11 15:18:41.386092473 (69h53m3.345189734s) [upload=72812]: Got next segment. Inline: false
Aug 11 15:18:41.386168354 (69h53m3.345265591s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 15:18:41.386174694 (69h53m3.345271928s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 15:18:41.583934962 (69h53m3.543032215s) [seg_pos={0 0}, upload=72812]: Begin upload segment...
Aug 11 15:18:41.583999395 (69h53m3.543096629s) [seg_pos={0 0}, upload=72812]: Done begin upload segment.
Aug 11 15:18:41.584031343 (69h53m3.543128598s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584464473 (69h53m3.543561719s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584738671 (69h53m3.543835917s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.589970068 (69h53m3.54906737s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.592687997 (69h53m3.551785254s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593409977 (69h53m3.552507231s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593729485 (69h53m3.552826739s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.594271156 (69h53m3.553368404s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.595792287 (69h53m3.554889538s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596487549 (69h53m3.555584795s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596607219 (69h53m3.555704476s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597068576 (69h53m3.556165832s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597775168 (69h53m3.556872418s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.598361262 (69h53m3.557458519s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.599504073 (69h53m3.558601324s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.600941047 (69h53m3.560038299s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601403848 (69h53m3.560501104s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601947525 (69h53m3.561044773s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:42.170396643 (69h53m4.129493891s) [upload=72812]: Next returned nil segment
Aug 11 15:18:42.170418005 (69h53m4.129515261s) [upload=72812]: Waiting for error group managing segments...
Aug 11 15:18:42.307059843 (69h53m4.266157095s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.317570550 (69h53m4.276667789s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.320723102 (69h53m4.279820348s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.323996782 (69h53m4.283094014s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.324515612 (69h53m4.283612843s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.325020330 (69h53m4.284117577s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.326792722 (69h53m4.285889969s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.329895347 (69h53m4.28899258s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.334285876 (69h53m4.293383115s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.337141777 (69h53m4.296239008s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.344384543 (69h53m4.303481789s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.350596582 (69h53m4.309693821s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.353811492 (69h53m4.312908729s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374742854 (69h53m4.333840085s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374768982 (69h53m4.333866229s) [seg_pos={0 0}, upload=72812]: Segment reached optimal threshold of 14 pieces.
Aug 11 15:18:42.374993957 (69h53m4.334091202s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 11 15:18:42.375308925 (69h53m4.334406172s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): internal: context canceled
Aug 11 15:18:42.375386257 (69h53m4.334483504s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection
Aug 11 15:18:42.375492641 (69h53m4.33458989s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection
Aug 11 15:18:42.375523754 (69h53m4.334621006s) [seg_pos={0 0}, upload=72812]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 15:18:42.375660518 (69h53m4.334757773s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 15:18:42.375666576 (69h53m4.334763829s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 15:18:42.524978827 (69h53m4.484076072s) [upload=72812]: Done uploading segments...
Aug 11 15:18:42.525000143 (69h53m4.484097381s) [upload=72812]: Upload finished. err: <nil>
Duration: 2.491154951s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
827.941186ms
FAIL (2025-08-11 15:44:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 827.973469ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X..X..................................] duration:
2.562501713s
FAIL (2025-08-11 15:44:21 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 15:18:41.385489772 (69h53m3.344587018s) [upload=72812]: Starting upload
Aug 11 15:18:41.385546881 (69h53m3.344644126s) [upload=72812]: Done starting upload
Aug 11 15:18:41.385719888 (69h53m3.344817125s) [upload=72812]: Uploading segments...
Aug 11 15:18:41.386092473 (69h53m3.345189734s) [upload=72812]: Got next segment. Inline: false
Aug 11 15:18:41.386168354 (69h53m3.345265591s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 15:18:41.386174694 (69h53m3.345271928s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 15:18:41.583934962 (69h53m3.543032215s) [seg_pos={0 0}, upload=72812]: Begin upload segment...
Aug 11 15:18:41.583999395 (69h53m3.543096629s) [seg_pos={0 0}, upload=72812]: Done begin upload segment.
Aug 11 15:18:41.584031343 (69h53m3.543128598s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584464473 (69h53m3.543561719s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584738671 (69h53m3.543835917s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.589970068 (69h53m3.54906737s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.592687997 (69h53m3.551785254s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593409977 (69h53m3.552507231s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593729485 (69h53m3.552826739s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.594271156 (69h53m3.553368404s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.595792287 (69h53m3.554889538s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596487549 (69h53m3.555584795s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596607219 (69h53m3.555704476s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597068576 (69h53m3.556165832s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597775168 (69h53m3.556872418s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.598361262 (69h53m3.557458519s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.599504073 (69h53m3.558601324s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.600941047 (69h53m3.560038299s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601403848 (69h53m3.560501104s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601947525 (69h53m3.561044773s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:42.170396643 (69h53m4.129493891s) [upload=72812]: Next returned nil segment
Aug 11 15:18:42.170418005 (69h53m4.129515261s) [upload=72812]: Waiting for error group managing segments...
Aug 11 15:18:42.307059843 (69h53m4.266157095s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.317570550 (69h53m4.276667789s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.320723102 (69h53m4.279820348s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.323996782 (69h53m4.283094014s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.324515612 (69h53m4.283612843s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.325020330 (69h53m4.284117577s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.326792722 (69h53m4.285889969s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.329895347 (69h53m4.28899258s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.334285876 (69h53m4.293383115s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.337141777 (69h53m4.296239008s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.344384543 (69h53m4.303481789s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.350596582 (69h53m4.309693821s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.353811492 (69h53m4.312908729s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374742854 (69h53m4.333840085s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374768982 (69h53m4.333866229s) [seg_pos={0 0}, upload=72812]: Segment reached optimal threshold of 14 pieces.
Aug 11 15:18:42.374993957 (69h53m4.334091202s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 11 15:18:42.375308925 (69h53m4.334406172s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): internal: context canceled
Aug 11 15:18:42.375386257 (69h53m4.334483504s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection
Aug 11 15:18:42.375492641 (69h53m4.33458989s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection
Aug 11 15:18:42.375523754 (69h53m4.334621006s) [seg_pos={0 0}, upload=72812]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 15:18:42.375660518 (69h53m4.334757773s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 15:18:42.375666576 (69h53m4.334763829s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 15:18:42.524978827 (69h53m4.484076072s) [upload=72812]: Done uploading segments...
Aug 11 15:18:42.525000143 (69h53m4.484097381s) [upload=72812]: Upload finished. err: <nil>
Duration: 2.562551261s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
853.135496ms
FAIL (2025-08-11 15:44:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 853.167712ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X..X.................................] duration:
2.375906592s
FAIL (2025-08-11 15:43:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 15:18:41.385489772 (69h53m3.344587018s) [upload=72812]: Starting upload
Aug 11 15:18:41.385546881 (69h53m3.344644126s) [upload=72812]: Done starting upload
Aug 11 15:18:41.385719888 (69h53m3.344817125s) [upload=72812]: Uploading segments...
Aug 11 15:18:41.386092473 (69h53m3.345189734s) [upload=72812]: Got next segment. Inline: false
Aug 11 15:18:41.386168354 (69h53m3.345265591s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 15:18:41.386174694 (69h53m3.345271928s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 15:18:41.583934962 (69h53m3.543032215s) [seg_pos={0 0}, upload=72812]: Begin upload segment...
Aug 11 15:18:41.583999395 (69h53m3.543096629s) [seg_pos={0 0}, upload=72812]: Done begin upload segment.
Aug 11 15:18:41.584031343 (69h53m3.543128598s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584464473 (69h53m3.543561719s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584738671 (69h53m3.543835917s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.589970068 (69h53m3.54906737s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.592687997 (69h53m3.551785254s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593409977 (69h53m3.552507231s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593729485 (69h53m3.552826739s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.594271156 (69h53m3.553368404s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.595792287 (69h53m3.554889538s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596487549 (69h53m3.555584795s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596607219 (69h53m3.555704476s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597068576 (69h53m3.556165832s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597775168 (69h53m3.556872418s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.598361262 (69h53m3.557458519s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.599504073 (69h53m3.558601324s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.600941047 (69h53m3.560038299s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601403848 (69h53m3.560501104s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601947525 (69h53m3.561044773s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:42.170396643 (69h53m4.129493891s) [upload=72812]: Next returned nil segment
Aug 11 15:18:42.170418005 (69h53m4.129515261s) [upload=72812]: Waiting for error group managing segments...
Aug 11 15:18:42.307059843 (69h53m4.266157095s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.317570550 (69h53m4.276667789s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.320723102 (69h53m4.279820348s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.323996782 (69h53m4.283094014s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.324515612 (69h53m4.283612843s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.325020330 (69h53m4.284117577s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.326792722 (69h53m4.285889969s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.329895347 (69h53m4.28899258s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.334285876 (69h53m4.293383115s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.337141777 (69h53m4.296239008s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.344384543 (69h53m4.303481789s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.350596582 (69h53m4.309693821s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.353811492 (69h53m4.312908729s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374742854 (69h53m4.333840085s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374768982 (69h53m4.333866229s) [seg_pos={0 0}, upload=72812]: Segment reached optimal threshold of 14 pieces.
Aug 11 15:18:42.374993957 (69h53m4.334091202s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 11 15:18:42.375308925 (69h53m4.334406172s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): internal: context canceled
Aug 11 15:18:42.375386257 (69h53m4.334483504s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection
Aug 11 15:18:42.375492641 (69h53m4.33458989s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection
Aug 11 15:18:42.375523754 (69h53m4.334621006s) [seg_pos={0 0}, upload=72812]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 15:18:42.375660518 (69h53m4.334757773s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 15:18:42.375666576 (69h53m4.334763829s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 15:18:42.524978827 (69h53m4.484076072s) [upload=72812]: Done uploading segments...
Aug 11 15:18:42.525000143 (69h53m4.484097381s) [upload=72812]: Upload finished. err: <nil>
Duration: 2.375943146s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
864.676316ms
FAIL (2025-08-11 15:43:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.706664ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X..X................................] duration:
2.537075021s
FAIL (2025-08-11 15:43:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 15:18:41.385489772 (69h53m3.344587018s) [upload=72812]: Starting upload
Aug 11 15:18:41.385546881 (69h53m3.344644126s) [upload=72812]: Done starting upload
Aug 11 15:18:41.385719888 (69h53m3.344817125s) [upload=72812]: Uploading segments...
Aug 11 15:18:41.386092473 (69h53m3.345189734s) [upload=72812]: Got next segment. Inline: false
Aug 11 15:18:41.386168354 (69h53m3.345265591s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 15:18:41.386174694 (69h53m3.345271928s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 15:18:41.583934962 (69h53m3.543032215s) [seg_pos={0 0}, upload=72812]: Begin upload segment...
Aug 11 15:18:41.583999395 (69h53m3.543096629s) [seg_pos={0 0}, upload=72812]: Done begin upload segment.
Aug 11 15:18:41.584031343 (69h53m3.543128598s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584464473 (69h53m3.543561719s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584738671 (69h53m3.543835917s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.589970068 (69h53m3.54906737s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.592687997 (69h53m3.551785254s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593409977 (69h53m3.552507231s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593729485 (69h53m3.552826739s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.594271156 (69h53m3.553368404s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.595792287 (69h53m3.554889538s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596487549 (69h53m3.555584795s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596607219 (69h53m3.555704476s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597068576 (69h53m3.556165832s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597775168 (69h53m3.556872418s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.598361262 (69h53m3.557458519s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.599504073 (69h53m3.558601324s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.600941047 (69h53m3.560038299s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601403848 (69h53m3.560501104s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601947525 (69h53m3.561044773s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:42.170396643 (69h53m4.129493891s) [upload=72812]: Next returned nil segment
Aug 11 15:18:42.170418005 (69h53m4.129515261s) [upload=72812]: Waiting for error group managing segments...
Aug 11 15:18:42.307059843 (69h53m4.266157095s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.317570550 (69h53m4.276667789s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.320723102 (69h53m4.279820348s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.323996782 (69h53m4.283094014s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.324515612 (69h53m4.283612843s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.325020330 (69h53m4.284117577s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.326792722 (69h53m4.285889969s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.329895347 (69h53m4.28899258s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.334285876 (69h53m4.293383115s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.337141777 (69h53m4.296239008s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.344384543 (69h53m4.303481789s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.350596582 (69h53m4.309693821s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.353811492 (69h53m4.312908729s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374742854 (69h53m4.333840085s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374768982 (69h53m4.333866229s) [seg_pos={0 0}, upload=72812]: Segment reached optimal threshold of 14 pieces.
Aug 11 15:18:42.374993957 (69h53m4.334091202s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 11 15:18:42.375308925 (69h53m4.334406172s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): internal: context canceled
Aug 11 15:18:42.375386257 (69h53m4.334483504s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection
Aug 11 15:18:42.375492641 (69h53m4.33458989s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection
Aug 11 15:18:42.375523754 (69h53m4.334621006s) [seg_pos={0 0}, upload=72812]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 15:18:42.375660518 (69h53m4.334757773s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 15:18:42.375666576 (69h53m4.334763829s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 15:18:42.524978827 (69h53m4.484076072s) [upload=72812]: Done uploading segments...
Aug 11 15:18:42.525000143 (69h53m4.484097381s) [upload=72812]: Upload finished. err: <nil>
Duration: 2.53710261s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
936.083189ms
FAIL (2025-08-11 15:43:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 936.113911ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
930.679144ms
FAIL (2025-08-11 15:42:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 930.798401ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X..X...............................] duration:
2.416536406s
FAIL (2025-08-11 15:42:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 15:18:41.385489772 (69h53m3.344587018s) [upload=72812]: Starting upload
Aug 11 15:18:41.385546881 (69h53m3.344644126s) [upload=72812]: Done starting upload
Aug 11 15:18:41.385719888 (69h53m3.344817125s) [upload=72812]: Uploading segments...
Aug 11 15:18:41.386092473 (69h53m3.345189734s) [upload=72812]: Got next segment. Inline: false
Aug 11 15:18:41.386168354 (69h53m3.345265591s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 15:18:41.386174694 (69h53m3.345271928s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 15:18:41.583934962 (69h53m3.543032215s) [seg_pos={0 0}, upload=72812]: Begin upload segment...
Aug 11 15:18:41.583999395 (69h53m3.543096629s) [seg_pos={0 0}, upload=72812]: Done begin upload segment.
Aug 11 15:18:41.584031343 (69h53m3.543128598s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584464473 (69h53m3.543561719s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584738671 (69h53m3.543835917s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.589970068 (69h53m3.54906737s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.592687997 (69h53m3.551785254s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593409977 (69h53m3.552507231s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593729485 (69h53m3.552826739s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.594271156 (69h53m3.553368404s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.595792287 (69h53m3.554889538s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596487549 (69h53m3.555584795s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596607219 (69h53m3.555704476s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597068576 (69h53m3.556165832s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597775168 (69h53m3.556872418s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.598361262 (69h53m3.557458519s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.599504073 (69h53m3.558601324s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.600941047 (69h53m3.560038299s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601403848 (69h53m3.560501104s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601947525 (69h53m3.561044773s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:42.170396643 (69h53m4.129493891s) [upload=72812]: Next returned nil segment
Aug 11 15:18:42.170418005 (69h53m4.129515261s) [upload=72812]: Waiting for error group managing segments...
Aug 11 15:18:42.307059843 (69h53m4.266157095s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.317570550 (69h53m4.276667789s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.320723102 (69h53m4.279820348s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.323996782 (69h53m4.283094014s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.324515612 (69h53m4.283612843s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.325020330 (69h53m4.284117577s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.326792722 (69h53m4.285889969s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.329895347 (69h53m4.28899258s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.334285876 (69h53m4.293383115s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.337141777 (69h53m4.296239008s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.344384543 (69h53m4.303481789s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.350596582 (69h53m4.309693821s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.353811492 (69h53m4.312908729s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374742854 (69h53m4.333840085s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374768982 (69h53m4.333866229s) [seg_pos={0 0}, upload=72812]: Segment reached optimal threshold of 14 pieces.
Aug 11 15:18:42.374993957 (69h53m4.334091202s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 11 15:18:42.375308925 (69h53m4.334406172s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): internal: context canceled
Aug 11 15:18:42.375386257 (69h53m4.334483504s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection
Aug 11 15:18:42.375492641 (69h53m4.33458989s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection
Aug 11 15:18:42.375523754 (69h53m4.334621006s) [seg_pos={0 0}, upload=72812]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 15:18:42.375660518 (69h53m4.334757773s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 15:18:42.375666576 (69h53m4.334763829s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 15:18:42.524978827 (69h53m4.484076072s) [upload=72812]: Done uploading segments...
Aug 11 15:18:42.525000143 (69h53m4.484097381s) [upload=72812]: Upload finished. err: <nil>
Duration: 2.416567415s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
871.001836ms
FAIL (2025-08-11 15:42:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 871.028137ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X..X..............................] duration:
2.442331594s
FAIL (2025-08-11 15:42:05 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 15:18:41.385489772 (69h53m3.344587018s) [upload=72812]: Starting upload
Aug 11 15:18:41.385546881 (69h53m3.344644126s) [upload=72812]: Done starting upload
Aug 11 15:18:41.385719888 (69h53m3.344817125s) [upload=72812]: Uploading segments...
Aug 11 15:18:41.386092473 (69h53m3.345189734s) [upload=72812]: Got next segment. Inline: false
Aug 11 15:18:41.386168354 (69h53m3.345265591s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 15:18:41.386174694 (69h53m3.345271928s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 15:18:41.583934962 (69h53m3.543032215s) [seg_pos={0 0}, upload=72812]: Begin upload segment...
Aug 11 15:18:41.583999395 (69h53m3.543096629s) [seg_pos={0 0}, upload=72812]: Done begin upload segment.
Aug 11 15:18:41.584031343 (69h53m3.543128598s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584464473 (69h53m3.543561719s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584738671 (69h53m3.543835917s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.589970068 (69h53m3.54906737s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.592687997 (69h53m3.551785254s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593409977 (69h53m3.552507231s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593729485 (69h53m3.552826739s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.594271156 (69h53m3.553368404s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.595792287 (69h53m3.554889538s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596487549 (69h53m3.555584795s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596607219 (69h53m3.555704476s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597068576 (69h53m3.556165832s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597775168 (69h53m3.556872418s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.598361262 (69h53m3.557458519s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.599504073 (69h53m3.558601324s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.600941047 (69h53m3.560038299s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601403848 (69h53m3.560501104s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601947525 (69h53m3.561044773s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:42.170396643 (69h53m4.129493891s) [upload=72812]: Next returned nil segment
Aug 11 15:18:42.170418005 (69h53m4.129515261s) [upload=72812]: Waiting for error group managing segments...
Aug 11 15:18:42.307059843 (69h53m4.266157095s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.317570550 (69h53m4.276667789s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.320723102 (69h53m4.279820348s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.323996782 (69h53m4.283094014s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.324515612 (69h53m4.283612843s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.325020330 (69h53m4.284117577s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.326792722 (69h53m4.285889969s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.329895347 (69h53m4.28899258s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.334285876 (69h53m4.293383115s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.337141777 (69h53m4.296239008s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.344384543 (69h53m4.303481789s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.350596582 (69h53m4.309693821s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.353811492 (69h53m4.312908729s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374742854 (69h53m4.333840085s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374768982 (69h53m4.333866229s) [seg_pos={0 0}, upload=72812]: Segment reached optimal threshold of 14 pieces.
Aug 11 15:18:42.374993957 (69h53m4.334091202s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 11 15:18:42.375308925 (69h53m4.334406172s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): internal: context canceled
Aug 11 15:18:42.375386257 (69h53m4.334483504s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection
Aug 11 15:18:42.375492641 (69h53m4.33458989s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection
Aug 11 15:18:42.375523754 (69h53m4.334621006s) [seg_pos={0 0}, upload=72812]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 15:18:42.375660518 (69h53m4.334757773s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 15:18:42.375666576 (69h53m4.334763829s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 15:18:42.524978827 (69h53m4.484076072s) [upload=72812]: Done uploading segments...
Aug 11 15:18:42.525000143 (69h53m4.484097381s) [upload=72812]: Upload finished. err: <nil>
Duration: 2.442361902s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X..X.............................] duration:
2.440867809s
FAIL (2025-08-11 15:41:35 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 15:18:41.385489772 (69h53m3.344587018s) [upload=72812]: Starting upload
Aug 11 15:18:41.385546881 (69h53m3.344644126s) [upload=72812]: Done starting upload
Aug 11 15:18:41.385719888 (69h53m3.344817125s) [upload=72812]: Uploading segments...
Aug 11 15:18:41.386092473 (69h53m3.345189734s) [upload=72812]: Got next segment. Inline: false
Aug 11 15:18:41.386168354 (69h53m3.345265591s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 15:18:41.386174694 (69h53m3.345271928s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 15:18:41.583934962 (69h53m3.543032215s) [seg_pos={0 0}, upload=72812]: Begin upload segment...
Aug 11 15:18:41.583999395 (69h53m3.543096629s) [seg_pos={0 0}, upload=72812]: Done begin upload segment.
Aug 11 15:18:41.584031343 (69h53m3.543128598s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584464473 (69h53m3.543561719s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584738671 (69h53m3.543835917s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.589970068 (69h53m3.54906737s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.592687997 (69h53m3.551785254s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593409977 (69h53m3.552507231s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593729485 (69h53m3.552826739s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.594271156 (69h53m3.553368404s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.595792287 (69h53m3.554889538s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596487549 (69h53m3.555584795s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596607219 (69h53m3.555704476s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597068576 (69h53m3.556165832s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597775168 (69h53m3.556872418s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.598361262 (69h53m3.557458519s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.599504073 (69h53m3.558601324s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.600941047 (69h53m3.560038299s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601403848 (69h53m3.560501104s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601947525 (69h53m3.561044773s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:42.170396643 (69h53m4.129493891s) [upload=72812]: Next returned nil segment
Aug 11 15:18:42.170418005 (69h53m4.129515261s) [upload=72812]: Waiting for error group managing segments...
Aug 11 15:18:42.307059843 (69h53m4.266157095s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.317570550 (69h53m4.276667789s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.320723102 (69h53m4.279820348s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.323996782 (69h53m4.283094014s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.324515612 (69h53m4.283612843s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.325020330 (69h53m4.284117577s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.326792722 (69h53m4.285889969s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.329895347 (69h53m4.28899258s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.334285876 (69h53m4.293383115s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.337141777 (69h53m4.296239008s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.344384543 (69h53m4.303481789s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.350596582 (69h53m4.309693821s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.353811492 (69h53m4.312908729s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374742854 (69h53m4.333840085s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374768982 (69h53m4.333866229s) [seg_pos={0 0}, upload=72812]: Segment reached optimal threshold of 14 pieces.
Aug 11 15:18:42.374993957 (69h53m4.334091202s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 11 15:18:42.375308925 (69h53m4.334406172s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): internal: context canceled
Aug 11 15:18:42.375386257 (69h53m4.334483504s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection
Aug 11 15:18:42.375492641 (69h53m4.33458989s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection
Aug 11 15:18:42.375523754 (69h53m4.334621006s) [seg_pos={0 0}, upload=72812]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 15:18:42.375660518 (69h53m4.334757773s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 15:18:42.375666576 (69h53m4.334763829s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 15:18:42.524978827 (69h53m4.484076072s) [upload=72812]: Done uploading segments...
Aug 11 15:18:42.525000143 (69h53m4.484097381s) [upload=72812]: Upload finished. err: <nil>
Duration: 2.440899639s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
915.622367ms
FAIL (2025-08-11 15:41:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 915.668226ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
868.801305ms
FAIL (2025-08-11 15:40:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 868.834083ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X..X............................] duration:
2.672022909s
FAIL (2025-08-11 15:40:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 15:18:41.385489772 (69h53m3.344587018s) [upload=72812]: Starting upload
Aug 11 15:18:41.385546881 (69h53m3.344644126s) [upload=72812]: Done starting upload
Aug 11 15:18:41.385719888 (69h53m3.344817125s) [upload=72812]: Uploading segments...
Aug 11 15:18:41.386092473 (69h53m3.345189734s) [upload=72812]: Got next segment. Inline: false
Aug 11 15:18:41.386168354 (69h53m3.345265591s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 15:18:41.386174694 (69h53m3.345271928s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 15:18:41.583934962 (69h53m3.543032215s) [seg_pos={0 0}, upload=72812]: Begin upload segment...
Aug 11 15:18:41.583999395 (69h53m3.543096629s) [seg_pos={0 0}, upload=72812]: Done begin upload segment.
Aug 11 15:18:41.584031343 (69h53m3.543128598s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584464473 (69h53m3.543561719s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584738671 (69h53m3.543835917s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.589970068 (69h53m3.54906737s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.592687997 (69h53m3.551785254s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593409977 (69h53m3.552507231s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593729485 (69h53m3.552826739s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.594271156 (69h53m3.553368404s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.595792287 (69h53m3.554889538s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596487549 (69h53m3.555584795s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596607219 (69h53m3.555704476s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597068576 (69h53m3.556165832s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597775168 (69h53m3.556872418s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.598361262 (69h53m3.557458519s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.599504073 (69h53m3.558601324s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.600941047 (69h53m3.560038299s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601403848 (69h53m3.560501104s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601947525 (69h53m3.561044773s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:42.170396643 (69h53m4.129493891s) [upload=72812]: Next returned nil segment
Aug 11 15:18:42.170418005 (69h53m4.129515261s) [upload=72812]: Waiting for error group managing segments...
Aug 11 15:18:42.307059843 (69h53m4.266157095s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.317570550 (69h53m4.276667789s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.320723102 (69h53m4.279820348s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.323996782 (69h53m4.283094014s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.324515612 (69h53m4.283612843s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.325020330 (69h53m4.284117577s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.326792722 (69h53m4.285889969s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.329895347 (69h53m4.28899258s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.334285876 (69h53m4.293383115s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.337141777 (69h53m4.296239008s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.344384543 (69h53m4.303481789s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.350596582 (69h53m4.309693821s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.353811492 (69h53m4.312908729s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374742854 (69h53m4.333840085s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374768982 (69h53m4.333866229s) [seg_pos={0 0}, upload=72812]: Segment reached optimal threshold of 14 pieces.
Aug 11 15:18:42.374993957 (69h53m4.334091202s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 11 15:18:42.375308925 (69h53m4.334406172s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): internal: context canceled
Aug 11 15:18:42.375386257 (69h53m4.334483504s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection
Aug 11 15:18:42.375492641 (69h53m4.33458989s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection
Aug 11 15:18:42.375523754 (69h53m4.334621006s) [seg_pos={0 0}, upload=72812]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 15:18:42.375660518 (69h53m4.334757773s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 15:18:42.375666576 (69h53m4.334763829s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 15:18:42.524978827 (69h53m4.484076072s) [upload=72812]: Done uploading segments...
Aug 11 15:18:42.525000143 (69h53m4.484097381s) [upload=72812]: Upload finished. err: <nil>
Duration: 2.672056738s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
942.545741ms
FAIL (2025-08-11 15:40:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 942.579457ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
948.393739ms
FAIL (2025-08-11 15:39:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 15:37:52.154333504 (70h12m14.113430751s) [upload=73146]: Starting upload Aug 11 15:37:52.154387892 (70h12m14.11348513s) [upload=73146]: Done starting upload Aug 11 15:37:52.154469382 (70h12m14.11356663s) [upload=73146]: Uploading segments... Aug 11 15:37:52.154603604 (70h12m14.113700863s) [upload=73146]: Got next segment. Inline: true Aug 11 15:37:52.154614238 (70h12m14.113711493s) [upload=73146]: Waiting for error group managing segments... Aug 11 15:37:52.154704774 (70h12m14.113802028s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 15:37:52.154733324 (70h12m14.113830574s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 15:37:52.154738270 (70h12m14.113835518s) [upload=73146]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 15:37:52.245517230 (70h12m14.204614492s) [upload=73146]: Done uploading segments... Aug 11 15:37:52.245597137 (70h12m14.204694395s) [upload=73146]: Upload finished. err: metaclient: Too Many Requests
Duration: 948.424631ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X..X...........................] duration:
2.324297404s
FAIL (2025-08-11 15:39:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 15:18:41.385489772 (69h53m3.344587018s) [upload=72812]: Starting upload
Aug 11 15:18:41.385546881 (69h53m3.344644126s) [upload=72812]: Done starting upload
Aug 11 15:18:41.385719888 (69h53m3.344817125s) [upload=72812]: Uploading segments...
Aug 11 15:18:41.386092473 (69h53m3.345189734s) [upload=72812]: Got next segment. Inline: false
Aug 11 15:18:41.386168354 (69h53m3.345265591s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 15:18:41.386174694 (69h53m3.345271928s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 15:18:41.583934962 (69h53m3.543032215s) [seg_pos={0 0}, upload=72812]: Begin upload segment...
Aug 11 15:18:41.583999395 (69h53m3.543096629s) [seg_pos={0 0}, upload=72812]: Done begin upload segment.
Aug 11 15:18:41.584031343 (69h53m3.543128598s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584464473 (69h53m3.543561719s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.584738671 (69h53m3.543835917s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.589970068 (69h53m3.54906737s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.592687997 (69h53m3.551785254s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593409977 (69h53m3.552507231s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.593729485 (69h53m3.552826739s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.594271156 (69h53m3.553368404s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.595792287 (69h53m3.554889538s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596487549 (69h53m3.555584795s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.596607219 (69h53m3.555704476s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597068576 (69h53m3.556165832s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.597775168 (69h53m3.556872418s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.598361262 (69h53m3.557458519s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.599504073 (69h53m3.558601324s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.600941047 (69h53m3.560038299s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601403848 (69h53m3.560501104s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:41.601947525 (69h53m3.561044773s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Uploading piece...
Aug 11 15:18:42.170396643 (69h53m4.129493891s) [upload=72812]: Next returned nil segment
Aug 11 15:18:42.170418005 (69h53m4.129515261s) [upload=72812]: Waiting for error group managing segments...
Aug 11 15:18:42.307059843 (69h53m4.266157095s) [noise=true , address=77.90.31.13:4631 , piece_id=OCFIEV7BY647THNVL6KRQAXH6MYUU3DB7UM6J2TVFJHJSN6GUYWA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.317570550 (69h53m4.276667789s) [noise=true , address=104.36.82.41:4785 , piece_id=2NZGAEMRR6NRM5WCMQBXIYXWM7YDV42UHSYY555ABMCFGH3WXFTA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.320723102 (69h53m4.279820348s) [noise=true , address=104.36.82.52:4114 , piece_id=CCROF4JDCLSO2P3Q3LJM6LXLPK5RHFVUH7HOJVAC4HK5W2CHLKAA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.323996782 (69h53m4.283094014s) [noise=true , address=104.36.82.58:4285 , piece_id=WO5B6RTMFWT7VBMPNHVG3KB3S3RNFH23LMK5GAU6NOHCGLZZ7ACA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.324515612 (69h53m4.283612843s) [noise=true , address=104.36.82.60:4354 , piece_id=ICNQADHFCP4B2F6OCP443UVNREZVC64Z4H6WFRWVEK636QTDM5WA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.325020330 (69h53m4.284117577s) [noise=true , address=77.90.31.16:4736 , piece_id=ITCNWJZXMEDCYDXVYGJPJFC4UOLTQQIKSFC7ZZVBTJRVZ2GNIORA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.326792722 (69h53m4.285889969s) [noise=true , address=104.36.82.44:4891 , piece_id=MIGOOUYDPI5JWZ7H62HJQEUYL2YTZMR6AHW3A2ZPOMAQGEGZTWBA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.329895347 (69h53m4.28899258s) [noise=true , address=104.36.82.35:4609 , piece_id=RPW62KAKVEYBXCU5ZF234RSJO45ACV2JEPPM5YZLAQC5N4CYJIDA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.334285876 (69h53m4.293383115s) [noise=true , address=104.36.82.8:4979 , piece_id=U5IS4OKQEDFN3YNMRYKDJ6XCFCNZPVPG7L67F63X5U6SGIJ625SA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.337141777 (69h53m4.296239008s) [noise=true , address=104.36.82.39:4744 , piece_id=LFFTIPDHGLM6GPSJFCUAV7O6LNEFCO7S2TOC5YHFG3IIKAOINOQQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.344384543 (69h53m4.303481789s) [noise=true , address=104.36.82.13:4203 , piece_id=NBWOY3BY5AXSHZBHR3QXFI5GLLWYPOPEDBZA7QBWVF67NTQ7WKSA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.350596582 (69h53m4.309693821s) [noise=true , address=104.36.82.23:4449 , piece_id=M333FBTJMMCU4UA2YAIGCVVQF2QDUH4UOHJS26JEOB67FCKHUVXA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.353811492 (69h53m4.312908729s) [noise=true , address=104.36.82.59:4325 , piece_id=IYL7NUWLFJX4I3YAPGOXUDIZ4HFEU6ZDTBCH3TVKNG5GRX22CL2A, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374742854 (69h53m4.333840085s) [noise=true , address=104.36.82.37:4673 , piece_id=VBDOPRTRCM36ODI4565W3NUDSLEP7Q2ZCEPI5H42B5MCVUZF67RA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: <nil>
Aug 11 15:18:42.374768982 (69h53m4.333866229s) [seg_pos={0 0}, upload=72812]: Segment reached optimal threshold of 14 pieces.
Aug 11 15:18:42.374993957 (69h53m4.334091202s) [noise=true , address=79.127.201.215:4353 , piece_id=2335X7PRKAQODMYIZQPJ7UQBXGHQEUPHXOSXUTB65C5LL44E52HQ, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 11 15:18:42.375308925 (69h53m4.334406172s) [noise=true , address=64.49.13.155:4923 , piece_id=M45SZSZZHJDLK2KWOUDBPDZ2DUBHVY3XLEJLE77DO7VFAMGC2KLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): internal: context canceled
Aug 11 15:18:42.375386257 (69h53m4.334483504s) [noise=true , address=64.49.13.139:4470 , piece_id=AKBA4LRFEZQAGISOF2HEUM7A4H5H4TUVOMEJXMXGOHLL7CPGMFCA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41230->64.49.13.139:4470: use of closed network connection
Aug 11 15:18:42.375492641 (69h53m4.33458989s) [noise=true , address=64.49.13.138:4490 , piece_id=R2ABVGMGJ3MK2PRZVRUY4VDTXRDWBYK7SEOARCQ27ZQT5UZYMVLA, seg_pos={0 0}, upload=72812]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52162->64.49.13.138:4490: use of closed network connection
Aug 11 15:18:42.375523754 (69h53m4.334621006s) [seg_pos={0 0}, upload=72812]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 15:18:42.375660518 (69h53m4.334757773s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 15:18:42.375666576 (69h53m4.334763829s) [upload=72812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 15:18:42.524978827 (69h53m4.484076072s) [upload=72812]: Done uploading segments...
Aug 11 15:18:42.525000143 (69h53m4.484097381s) [upload=72812]: Upload finished. err: <nil>
Duration: 2.324333195s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|