Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X..........................X..X..........] duration:
2.651086501s
FAIL (2025-08-19 19:18:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 19:09:15.792740990 (265h43m37.751838224s) [upload=276599]: Starting upload Aug 19 19:09:15.792864210 (265h43m37.751961444s) [upload=276599]: Done starting upload Aug 19 19:09:15.793085912 (265h43m37.752183165s) [upload=276599]: Uploading segments... Aug 19 19:09:15.793226202 (265h43m37.752323459s) [upload=276599]: Got next segment. Inline: false Aug 19 19:09:15.793290689 (265h43m37.752387947s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:09:15.793298005 (265h43m37.752395268s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 19:09:15.936498282 (265h43m37.895595537s) [upload=276599]: Next segment err: metaclient: Too Many Requests Aug 19 19:09:15.936526366 (265h43m37.895623622s) [upload=276599]: Done uploading segments... Aug 19 19:09:15.936545920 (265h43m37.895643167s) [upload=276599]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.651127068s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X.................................X.X........] duration:
980.358486ms
FAIL (2025-08-19 19:18:09 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 19:13:09.790567994 (265h47m31.749665241s) [upload=276659]: Starting upload Aug 19 19:13:09.790660008 (265h47m31.749757255s) [upload=276659]: Done starting upload Aug 19 19:13:09.790754338 (265h47m31.74985157s) [upload=276659]: Uploading segments... Aug 19 19:13:09.790809316 (265h47m31.749906563s) [upload=276659]: Got next segment. Inline: true Aug 19 19:13:09.790815075 (265h47m31.749912322s) [upload=276659]: Waiting for error group managing segments... Aug 19 19:13:09.790861159 (265h47m31.749958405s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:13:09.790866599 (265h47m31.749963845s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 19:13:09.790870136 (265h47m31.749967382s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 19:13:10.218780487 (265h47m32.177877735s) [upload=276659]: Done uploading segments... Aug 19 19:13:10.218803561 (265h47m32.177900793s) [upload=276659]: Upload finished. err: <nil>
Duration: 980.427856ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X..........................X..X.........] duration:
2.819783055s
FAIL (2025-08-19 19:17:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 19:09:15.792740990 (265h43m37.751838224s) [upload=276599]: Starting upload Aug 19 19:09:15.792864210 (265h43m37.751961444s) [upload=276599]: Done starting upload Aug 19 19:09:15.793085912 (265h43m37.752183165s) [upload=276599]: Uploading segments... Aug 19 19:09:15.793226202 (265h43m37.752323459s) [upload=276599]: Got next segment. Inline: false Aug 19 19:09:15.793290689 (265h43m37.752387947s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:09:15.793298005 (265h43m37.752395268s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 19:09:15.936498282 (265h43m37.895595537s) [upload=276599]: Next segment err: metaclient: Too Many Requests Aug 19 19:09:15.936526366 (265h43m37.895623622s) [upload=276599]: Done uploading segments... Aug 19 19:09:15.936545920 (265h43m37.895643167s) [upload=276599]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.819832094s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X.................................X.X.......] duration:
1.062734327s
FAIL (2025-08-19 19:17:06 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 19:13:09.790567994 (265h47m31.749665241s) [upload=276659]: Starting upload Aug 19 19:13:09.790660008 (265h47m31.749757255s) [upload=276659]: Done starting upload Aug 19 19:13:09.790754338 (265h47m31.74985157s) [upload=276659]: Uploading segments... Aug 19 19:13:09.790809316 (265h47m31.749906563s) [upload=276659]: Got next segment. Inline: true Aug 19 19:13:09.790815075 (265h47m31.749912322s) [upload=276659]: Waiting for error group managing segments... Aug 19 19:13:09.790861159 (265h47m31.749958405s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:13:09.790866599 (265h47m31.749963845s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 19:13:09.790870136 (265h47m31.749967382s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 19:13:10.218780487 (265h47m32.177877735s) [upload=276659]: Done uploading segments... Aug 19 19:13:10.218803561 (265h47m32.177900793s) [upload=276659]: Upload finished. err: <nil>
Duration: 1.062754641s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X.................................X.X......] duration:
1.237727463s
FAIL (2025-08-19 19:16:51 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 19:13:09.790567994 (265h47m31.749665241s) [upload=276659]: Starting upload Aug 19 19:13:09.790660008 (265h47m31.749757255s) [upload=276659]: Done starting upload Aug 19 19:13:09.790754338 (265h47m31.74985157s) [upload=276659]: Uploading segments... Aug 19 19:13:09.790809316 (265h47m31.749906563s) [upload=276659]: Got next segment. Inline: true Aug 19 19:13:09.790815075 (265h47m31.749912322s) [upload=276659]: Waiting for error group managing segments... Aug 19 19:13:09.790861159 (265h47m31.749958405s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:13:09.790866599 (265h47m31.749963845s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 19:13:09.790870136 (265h47m31.749967382s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 19:13:10.218780487 (265h47m32.177877735s) [upload=276659]: Done uploading segments... Aug 19 19:13:10.218803561 (265h47m32.177900793s) [upload=276659]: Upload finished. err: <nil>
Duration: 1.237765846s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X.................................X.X.....] duration:
864.232739ms
FAIL (2025-08-19 19:16:32 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 19:13:09.790567994 (265h47m31.749665241s) [upload=276659]: Starting upload Aug 19 19:13:09.790660008 (265h47m31.749757255s) [upload=276659]: Done starting upload Aug 19 19:13:09.790754338 (265h47m31.74985157s) [upload=276659]: Uploading segments... Aug 19 19:13:09.790809316 (265h47m31.749906563s) [upload=276659]: Got next segment. Inline: true Aug 19 19:13:09.790815075 (265h47m31.749912322s) [upload=276659]: Waiting for error group managing segments... Aug 19 19:13:09.790861159 (265h47m31.749958405s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:13:09.790866599 (265h47m31.749963845s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 19:13:09.790870136 (265h47m31.749967382s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 19:13:10.218780487 (265h47m32.177877735s) [upload=276659]: Done uploading segments... Aug 19 19:13:10.218803561 (265h47m32.177900793s) [upload=276659]: Upload finished. err: <nil>
Duration: 864.261212ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X.................................X.X....] duration:
1.000825567s
FAIL (2025-08-19 19:16:15 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 19:13:09.790567994 (265h47m31.749665241s) [upload=276659]: Starting upload Aug 19 19:13:09.790660008 (265h47m31.749757255s) [upload=276659]: Done starting upload Aug 19 19:13:09.790754338 (265h47m31.74985157s) [upload=276659]: Uploading segments... Aug 19 19:13:09.790809316 (265h47m31.749906563s) [upload=276659]: Got next segment. Inline: true Aug 19 19:13:09.790815075 (265h47m31.749912322s) [upload=276659]: Waiting for error group managing segments... Aug 19 19:13:09.790861159 (265h47m31.749958405s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:13:09.790866599 (265h47m31.749963845s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 19:13:09.790870136 (265h47m31.749967382s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 19:13:10.218780487 (265h47m32.177877735s) [upload=276659]: Done uploading segments... Aug 19 19:13:10.218803561 (265h47m32.177900793s) [upload=276659]: Upload finished. err: <nil>
Duration: 1.000860274s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X..........................X..X........] duration:
2.393339437s
FAIL (2025-08-19 19:16:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 19:09:15.792740990 (265h43m37.751838224s) [upload=276599]: Starting upload Aug 19 19:09:15.792864210 (265h43m37.751961444s) [upload=276599]: Done starting upload Aug 19 19:09:15.793085912 (265h43m37.752183165s) [upload=276599]: Uploading segments... Aug 19 19:09:15.793226202 (265h43m37.752323459s) [upload=276599]: Got next segment. Inline: false Aug 19 19:09:15.793290689 (265h43m37.752387947s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:09:15.793298005 (265h43m37.752395268s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 19:09:15.936498282 (265h43m37.895595537s) [upload=276599]: Next segment err: metaclient: Too Many Requests Aug 19 19:09:15.936526366 (265h43m37.895623622s) [upload=276599]: Done uploading segments... Aug 19 19:09:15.936545920 (265h43m37.895643167s) [upload=276599]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.393373897s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X..........................X..X.......] duration:
2.508520269s
FAIL (2025-08-19 19:15:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 19:09:15.792740990 (265h43m37.751838224s) [upload=276599]: Starting upload Aug 19 19:09:15.792864210 (265h43m37.751961444s) [upload=276599]: Done starting upload Aug 19 19:09:15.793085912 (265h43m37.752183165s) [upload=276599]: Uploading segments... Aug 19 19:09:15.793226202 (265h43m37.752323459s) [upload=276599]: Got next segment. Inline: false Aug 19 19:09:15.793290689 (265h43m37.752387947s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:09:15.793298005 (265h43m37.752395268s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 19:09:15.936498282 (265h43m37.895595537s) [upload=276599]: Next segment err: metaclient: Too Many Requests Aug 19 19:09:15.936526366 (265h43m37.895623622s) [upload=276599]: Done uploading segments... Aug 19 19:09:15.936545920 (265h43m37.895643167s) [upload=276599]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.508553359s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X.................................X.X...] duration:
979.720356ms
FAIL (2025-08-19 19:15:24 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 19:13:09.790567994 (265h47m31.749665241s) [upload=276659]: Starting upload Aug 19 19:13:09.790660008 (265h47m31.749757255s) [upload=276659]: Done starting upload Aug 19 19:13:09.790754338 (265h47m31.74985157s) [upload=276659]: Uploading segments... Aug 19 19:13:09.790809316 (265h47m31.749906563s) [upload=276659]: Got next segment. Inline: true Aug 19 19:13:09.790815075 (265h47m31.749912322s) [upload=276659]: Waiting for error group managing segments... Aug 19 19:13:09.790861159 (265h47m31.749958405s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:13:09.790866599 (265h47m31.749963845s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 19:13:09.790870136 (265h47m31.749967382s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 19:13:10.218780487 (265h47m32.177877735s) [upload=276659]: Done uploading segments... Aug 19 19:13:10.218803561 (265h47m32.177900793s) [upload=276659]: Upload finished. err: <nil>
Duration: 979.756657ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X..........................X..X......] duration:
2.491971961s
FAIL (2025-08-19 19:14:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 19:09:15.792740990 (265h43m37.751838224s) [upload=276599]: Starting upload Aug 19 19:09:15.792864210 (265h43m37.751961444s) [upload=276599]: Done starting upload Aug 19 19:09:15.793085912 (265h43m37.752183165s) [upload=276599]: Uploading segments... Aug 19 19:09:15.793226202 (265h43m37.752323459s) [upload=276599]: Got next segment. Inline: false Aug 19 19:09:15.793290689 (265h43m37.752387947s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:09:15.793298005 (265h43m37.752395268s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 19:09:15.936498282 (265h43m37.895595537s) [upload=276599]: Next segment err: metaclient: Too Many Requests Aug 19 19:09:15.936526366 (265h43m37.895623622s) [upload=276599]: Done uploading segments... Aug 19 19:09:15.936545920 (265h43m37.895643167s) [upload=276599]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.492056659s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.................................X.X..] duration:
1.053076085s
FAIL (2025-08-19 19:14:39 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 19:13:09.790567994 (265h47m31.749665241s) [upload=276659]: Starting upload Aug 19 19:13:09.790660008 (265h47m31.749757255s) [upload=276659]: Done starting upload Aug 19 19:13:09.790754338 (265h47m31.74985157s) [upload=276659]: Uploading segments... Aug 19 19:13:09.790809316 (265h47m31.749906563s) [upload=276659]: Got next segment. Inline: true Aug 19 19:13:09.790815075 (265h47m31.749912322s) [upload=276659]: Waiting for error group managing segments... Aug 19 19:13:09.790861159 (265h47m31.749958405s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:13:09.790866599 (265h47m31.749963845s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 19:13:09.790870136 (265h47m31.749967382s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 19:13:10.218780487 (265h47m32.177877735s) [upload=276659]: Done uploading segments... Aug 19 19:13:10.218803561 (265h47m32.177900793s) [upload=276659]: Upload finished. err: <nil>
Duration: 1.053109165s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X.................................X.X.] duration:
903.279166ms
FAIL (2025-08-19 19:14:17 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 19:13:09.790567994 (265h47m31.749665241s) [upload=276659]: Starting upload Aug 19 19:13:09.790660008 (265h47m31.749757255s) [upload=276659]: Done starting upload Aug 19 19:13:09.790754338 (265h47m31.74985157s) [upload=276659]: Uploading segments... Aug 19 19:13:09.790809316 (265h47m31.749906563s) [upload=276659]: Got next segment. Inline: true Aug 19 19:13:09.790815075 (265h47m31.749912322s) [upload=276659]: Waiting for error group managing segments... Aug 19 19:13:09.790861159 (265h47m31.749958405s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:13:09.790866599 (265h47m31.749963845s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 19:13:09.790870136 (265h47m31.749967382s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 19:13:10.218780487 (265h47m32.177877735s) [upload=276659]: Done uploading segments... Aug 19 19:13:10.218803561 (265h47m32.177900793s) [upload=276659]: Upload finished. err: <nil>
Duration: 903.324491ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X..........................X..X.....] duration:
2.61722613s
FAIL (2025-08-19 19:14:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 19:09:15.792740990 (265h43m37.751838224s) [upload=276599]: Starting upload Aug 19 19:09:15.792864210 (265h43m37.751961444s) [upload=276599]: Done starting upload Aug 19 19:09:15.793085912 (265h43m37.752183165s) [upload=276599]: Uploading segments... Aug 19 19:09:15.793226202 (265h43m37.752323459s) [upload=276599]: Got next segment. Inline: false Aug 19 19:09:15.793290689 (265h43m37.752387947s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:09:15.793298005 (265h43m37.752395268s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 19:09:15.936498282 (265h43m37.895595537s) [upload=276599]: Next segment err: metaclient: Too Many Requests Aug 19 19:09:15.936526366 (265h43m37.895623622s) [upload=276599]: Done uploading segments... Aug 19 19:09:15.936545920 (265h43m37.895643167s) [upload=276599]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.617257759s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X..........................X..X....] duration:
3.330933996s
FAIL (2025-08-19 19:13:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 19:09:15.792740990 (265h43m37.751838224s) [upload=276599]: Starting upload Aug 19 19:09:15.792864210 (265h43m37.751961444s) [upload=276599]: Done starting upload Aug 19 19:09:15.793085912 (265h43m37.752183165s) [upload=276599]: Uploading segments... Aug 19 19:09:15.793226202 (265h43m37.752323459s) [upload=276599]: Got next segment. Inline: false Aug 19 19:09:15.793290689 (265h43m37.752387947s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:09:15.793298005 (265h43m37.752395268s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 19:09:15.936498282 (265h43m37.895595537s) [upload=276599]: Next segment err: metaclient: Too Many Requests Aug 19 19:09:15.936526366 (265h43m37.895623622s) [upload=276599]: Done uploading segments... Aug 19 19:09:15.936545920 (265h43m37.895643167s) [upload=276599]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.330990332s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................X.................................X.X] duration:
910.696749ms
FAIL (2025-08-19 19:13:10 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 19:13:09.790567994 (265h47m31.749665241s) [upload=276659]: Starting upload Aug 19 19:13:09.790660008 (265h47m31.749757255s) [upload=276659]: Done starting upload Aug 19 19:13:09.790754338 (265h47m31.74985157s) [upload=276659]: Uploading segments... Aug 19 19:13:09.790809316 (265h47m31.749906563s) [upload=276659]: Got next segment. Inline: true Aug 19 19:13:09.790815075 (265h47m31.749912322s) [upload=276659]: Waiting for error group managing segments... Aug 19 19:13:09.790861159 (265h47m31.749958405s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:13:09.790866599 (265h47m31.749963845s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 19:13:09.790870136 (265h47m31.749967382s) [upload=276659]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 19:13:10.218780487 (265h47m32.177877735s) [upload=276659]: Done uploading segments... Aug 19 19:13:10.218803561 (265h47m32.177900793s) [upload=276659]: Upload finished. err: <nil>
Duration: 910.784288ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X.................................X.] duration:
1.208913728s
FAIL (2025-08-19 19:12:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 19:12:05.277879898 (265h46m27.236977148s) [upload=276642]: Starting upload
Aug 19 19:12:05.278045936 (265h46m27.23714319s) [upload=276642]: Done starting upload
Aug 19 19:12:05.278163293 (265h46m27.237260525s) [upload=276642]: Uploading segments...
Aug 19 19:12:05.278232434 (265h46m27.237329689s) [upload=276642]: Got next segment. Inline: true
Aug 19 19:12:05.278240524 (265h46m27.237337771s) [upload=276642]: Waiting for error group managing segments...
Aug 19 19:12:05.278301396 (265h46m27.237398641s) [upload=276642]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 19:12:05.278307249 (265h46m27.237404497s) [upload=276642]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 19:12:05.278310860 (265h46m27.237408105s) [upload=276642]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 19:12:05.780481936 (265h46m27.739579171s) [upload=276642]: Done uploading segments...
Aug 19 19:12:05.780526008 (265h46m27.739623253s) [upload=276642]: Upload finished. err: <nil>
Duration: 1.208945114s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X..........................X..X...] duration:
2.551489237s
FAIL (2025-08-19 19:12:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 19:09:15.792740990 (265h43m37.751838224s) [upload=276599]: Starting upload Aug 19 19:09:15.792864210 (265h43m37.751961444s) [upload=276599]: Done starting upload Aug 19 19:09:15.793085912 (265h43m37.752183165s) [upload=276599]: Uploading segments... Aug 19 19:09:15.793226202 (265h43m37.752323459s) [upload=276599]: Got next segment. Inline: false Aug 19 19:09:15.793290689 (265h43m37.752387947s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:09:15.793298005 (265h43m37.752395268s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 19:09:15.936498282 (265h43m37.895595537s) [upload=276599]: Next segment err: metaclient: Too Many Requests Aug 19 19:09:15.936526366 (265h43m37.895623622s) [upload=276599]: Done uploading segments... Aug 19 19:09:15.936545920 (265h43m37.895643167s) [upload=276599]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.551517493s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.................................X] duration:
1.078417922s
FAIL (2025-08-19 19:12:06 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 19:12:05.277879898 (265h46m27.236977148s) [upload=276642]: Starting upload
Aug 19 19:12:05.278045936 (265h46m27.23714319s) [upload=276642]: Done starting upload
Aug 19 19:12:05.278163293 (265h46m27.237260525s) [upload=276642]: Uploading segments...
Aug 19 19:12:05.278232434 (265h46m27.237329689s) [upload=276642]: Got next segment. Inline: true
Aug 19 19:12:05.278240524 (265h46m27.237337771s) [upload=276642]: Waiting for error group managing segments...
Aug 19 19:12:05.278301396 (265h46m27.237398641s) [upload=276642]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 19:12:05.278307249 (265h46m27.237404497s) [upload=276642]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 19:12:05.278310860 (265h46m27.237408105s) [upload=276642]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 19:12:05.780481936 (265h46m27.739579171s) [upload=276642]: Done uploading segments...
Aug 19 19:12:05.780526008 (265h46m27.739623253s) [upload=276642]: Upload finished. err: <nil>
Duration: 1.078451259s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X..........................X..X..] duration:
2.710729375s
FAIL (2025-08-19 19:11:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 19:09:15.792740990 (265h43m37.751838224s) [upload=276599]: Starting upload Aug 19 19:09:15.792864210 (265h43m37.751961444s) [upload=276599]: Done starting upload Aug 19 19:09:15.793085912 (265h43m37.752183165s) [upload=276599]: Uploading segments... Aug 19 19:09:15.793226202 (265h43m37.752323459s) [upload=276599]: Got next segment. Inline: false Aug 19 19:09:15.793290689 (265h43m37.752387947s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:09:15.793298005 (265h43m37.752395268s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 19:09:15.936498282 (265h43m37.895595537s) [upload=276599]: Next segment err: metaclient: Too Many Requests Aug 19 19:09:15.936526366 (265h43m37.895623622s) [upload=276599]: Done uploading segments... Aug 19 19:09:15.936545920 (265h43m37.895643167s) [upload=276599]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.710898625s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
867.053953ms
FAIL (2025-08-19 19:11:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 18:43:52.083745668 (265h18m14.042842919s) [upload=276163]: Starting upload
Aug 19 18:43:52.083817708 (265h18m14.042914956s) [upload=276163]: Done starting upload
Aug 19 18:43:52.083925788 (265h18m14.043023034s) [upload=276163]: Uploading segments...
Aug 19 18:43:52.084001343 (265h18m14.043098597s) [upload=276163]: Got next segment. Inline: true
Aug 19 18:43:52.084019067 (265h18m14.043116313s) [upload=276163]: Waiting for error group managing segments...
Aug 19 18:43:52.084065003 (265h18m14.043162248s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 18:43:52.084070415 (265h18m14.043167652s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 18:43:52.084073924 (265h18m14.04317116s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 18:43:53.024425173 (265h18m14.983522494s) [upload=276163]: Done uploading segments...
Aug 19 18:43:53.024446062 (265h18m14.983543301s) [upload=276163]: Upload finished. err: <nil>
Duration: 867.083808ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................X..........................X..X.] duration:
2.948728624s
FAIL (2025-08-19 19:10:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 19:09:15.792740990 (265h43m37.751838224s) [upload=276599]: Starting upload Aug 19 19:09:15.792864210 (265h43m37.751961444s) [upload=276599]: Done starting upload Aug 19 19:09:15.793085912 (265h43m37.752183165s) [upload=276599]: Uploading segments... Aug 19 19:09:15.793226202 (265h43m37.752323459s) [upload=276599]: Got next segment. Inline: false Aug 19 19:09:15.793290689 (265h43m37.752387947s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:09:15.793298005 (265h43m37.752395268s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 19:09:15.936498282 (265h43m37.895595537s) [upload=276599]: Next segment err: metaclient: Too Many Requests Aug 19 19:09:15.936526366 (265h43m37.895623622s) [upload=276599]: Done uploading segments... Aug 19 19:09:15.936545920 (265h43m37.895643167s) [upload=276599]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.948856692s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
1.10844701s
FAIL (2025-08-19 19:10:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 18:43:52.083745668 (265h18m14.042842919s) [upload=276163]: Starting upload
Aug 19 18:43:52.083817708 (265h18m14.042914956s) [upload=276163]: Done starting upload
Aug 19 18:43:52.083925788 (265h18m14.043023034s) [upload=276163]: Uploading segments...
Aug 19 18:43:52.084001343 (265h18m14.043098597s) [upload=276163]: Got next segment. Inline: true
Aug 19 18:43:52.084019067 (265h18m14.043116313s) [upload=276163]: Waiting for error group managing segments...
Aug 19 18:43:52.084065003 (265h18m14.043162248s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 18:43:52.084070415 (265h18m14.043167652s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 18:43:52.084073924 (265h18m14.04317116s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 18:43:53.024425173 (265h18m14.983522494s) [upload=276163]: Done uploading segments...
Aug 19 18:43:53.024446062 (265h18m14.983543301s) [upload=276163]: Upload finished. err: <nil>
Duration: 1.108476032s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X............................X..........................X..X] duration:
431.804974ms
FAIL (2025-08-19 19:09:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 19:09:15.792740990 (265h43m37.751838224s) [upload=276599]: Starting upload Aug 19 19:09:15.792864210 (265h43m37.751961444s) [upload=276599]: Done starting upload Aug 19 19:09:15.793085912 (265h43m37.752183165s) [upload=276599]: Uploading segments... Aug 19 19:09:15.793226202 (265h43m37.752323459s) [upload=276599]: Got next segment. Inline: false Aug 19 19:09:15.793290689 (265h43m37.752387947s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 19:09:15.793298005 (265h43m37.752395268s) [upload=276599]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 19:09:15.936498282 (265h43m37.895595537s) [upload=276599]: Next segment err: metaclient: Too Many Requests Aug 19 19:09:15.936526366 (265h43m37.895623622s) [upload=276599]: Done uploading segments... Aug 19 19:09:15.936545920 (265h43m37.895643167s) [upload=276599]: Upload finished. err: metaclient: Too Many Requests
Duration: 431.837174ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
1.048382101s
FAIL (2025-08-19 19:08:59 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 18:43:52.083745668 (265h18m14.042842919s) [upload=276163]: Starting upload
Aug 19 18:43:52.083817708 (265h18m14.042914956s) [upload=276163]: Done starting upload
Aug 19 18:43:52.083925788 (265h18m14.043023034s) [upload=276163]: Uploading segments...
Aug 19 18:43:52.084001343 (265h18m14.043098597s) [upload=276163]: Got next segment. Inline: true
Aug 19 18:43:52.084019067 (265h18m14.043116313s) [upload=276163]: Waiting for error group managing segments...
Aug 19 18:43:52.084065003 (265h18m14.043162248s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 18:43:52.084070415 (265h18m14.043167652s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 18:43:52.084073924 (265h18m14.04317116s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 18:43:53.024425173 (265h18m14.983522494s) [upload=276163]: Done uploading segments...
Aug 19 18:43:53.024446062 (265h18m14.983543301s) [upload=276163]: Upload finished. err: <nil>
Duration: 1.048424827s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X............................X..........................X..] duration:
2.588002887s
FAIL (2025-08-19 19:08:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 404b87da8356c3971fa7103c7a35c61ffe3fe6dfabc9597c8d550702f4adb986 != before c3833e52db793d2a8b826622d0b99b5c30dc9c294005644d119ff49422d81e39
======LOGS======
Aug 19 19:07:23.754781503 (265h41m45.713878754s) [upload=276568]: Starting upload
Aug 19 19:07:23.754855095 (265h41m45.713952334s) [upload=276568]: Done starting upload
Aug 19 19:07:23.754935268 (265h41m45.714032513s) [upload=276568]: Uploading segments...
Aug 19 19:07:23.755224414 (265h41m45.714321666s) [upload=276568]: Got next segment. Inline: false
Aug 19 19:07:23.755273402 (265h41m45.714370654s) [upload=276568]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 19:07:23.755285112 (265h41m45.714382364s) [upload=276568]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 19:07:27.681606974 (265h41m49.64070422s) [seg_pos={0 0}, upload=276568]: Begin upload segment...
Aug 19 19:07:27.681656213 (265h41m49.640753459s) [seg_pos={0 0}, upload=276568]: Done begin upload segment.
Aug 19 19:07:27.681682553 (265h41m49.640779801s) [noise=true , address=79.127.201.215:4359 , piece_id=AEVRU4AC2ZN2IZEAN2NCSCKRAFE53XU6JRSJRS6E7AGT3BSFNIHA, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.681991088 (265h41m49.641088363s) [noise=true , address=104.36.82.45:4906 , piece_id=HWDPX235S3OIVRD3NV54ALQOCM2QBWX4OKCXGNIIISARXPUMJ3NA, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.682140014 (265h41m49.64123726s) [noise=true , address=104.36.82.34:4549 , piece_id=SJYSYLTLGEXEMVYZTMNM5RPVWWKIJ2ISCECNUO7NMQ3QW57JXBNA, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.682493890 (265h41m49.641591153s) [noise=true , address=79.127.205.246:4275 , piece_id=I3TOP55QJ7NUL665WCZ5ZPLUIEDTO5GCXC5F56IBWEDQUOF3D2JA, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.682617600 (265h41m49.641714854s) [noise=true , address=77.90.31.12:4610 , piece_id=BK6OVDHUURYXDJVQXONXWMC3WYJPAA7FANEJNKBLSMGQMCBIWTBQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.682877962 (265h41m49.64197521s) [noise=true , address=45.91.116.4:4944 , piece_id=7OTUDZ4KGMNXSWMZOFWFUGU3UGJ4DUBI34X42L5LXU2D2LKY5ITQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.683100580 (265h41m49.642197829s) [noise=true , address=77.90.31.18:4838 , piece_id=GHROAVOAZ2XMMF3RJH3W73LRJNYMYFVGRMEFGVDDWCJRS66CQWXQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.683214123 (265h41m49.642311368s) [noise=true , address=104.36.82.51:4054 , piece_id=QOKJJVMEA3QWFURSHWGSIX6ZBPJ36X5YFYNH66F72NMBXCVWKHWQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.683591907 (265h41m49.642689154s) [noise=true , address=104.36.82.9:4031 , piece_id=BW3FHKZB6QM6VDSLMJ3YGNM7EUYENSOCJUTRAUGARQPBXQ7SJVZQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.683608114 (265h41m49.642705367s) [noise=true , address=104.36.82.14:4230 , piece_id=IZX5UDPCS5TYNYJ4DQ67POJVGJD7KYUT4NO7HJ7ALLOJYXZWHJVQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.683967780 (265h41m49.643065025s) [noise=true , address=79.127.205.235:4672 , piece_id=G5PKDCKG4ZOT36AGU6FXBTK63WBH7L27WCCYLH5EI3THAGNPRRVQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.684021897 (265h41m49.643119148s) [noise=true , address=45.91.116.12:4259 , piece_id=5NNGUVW25IVHEZGUIFWUZYNWLEFH5LF2XHA6OAD7FYL4UXLTI6PA, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.684504591 (265h41m49.643601844s) [noise=true , address=104.36.82.12:4177 , piece_id=IGA6TEGTJY5OLMT7POEBZ6FVZCJJLC4JS3CLGIRJX64F26NT344Q, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.684671431 (265h41m49.643768679s) [noise=true , address=104.36.82.10:4090 , piece_id=DWXFEPGQZQRBZ2BRHKMTSSBDPJOW6OJ2IDQWF6K22C4BKZXMYSGQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.684883817 (265h41m49.643981062s) [noise=true , address=45.91.116.9:4283 , piece_id=5S4U52BMH2N2MD4KA7TNSLTXGFSBQDZO2NEZKESWUY24LBIT26VQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.685167707 (265h41m49.644264964s) [noise=true , address=104.36.82.15:4282 , piece_id=OWQOJZCQZWUHPSVHLCQS3CRCUZKJOIJCIUAR3GQDMPEJ3BHG6GRQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.685630710 (265h41m49.644727964s) [noise=true , address=77.90.31.13:4646 , piece_id=ZZE24VB3NVLKJNGX2J7T4OQQIWXPBM2NGXQ2YVXSBPQCV4CD7ASQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.686020061 (265h41m49.645117309s) [noise=true , address=77.90.31.15:4701 , piece_id=RNM2KT34MVFKECJELAJ4DXZZGCW7YEC2H5ADRNSTVOLTJ6MFXY7Q, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:28.239891415 (265h41m50.198988647s) [upload=276568]: Next returned nil segment
Aug 19 19:07:28.239918076 (265h41m50.199015334s) [upload=276568]: Waiting for error group managing segments...
Aug 19 19:07:28.402283748 (265h41m50.361380995s) [noise=true , address=45.91.116.4:4944 , piece_id=7OTUDZ4KGMNXSWMZOFWFUGU3UGJ4DUBI34X42L5LXU2D2LKY5ITQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.418104083 (265h41m50.377201318s) [noise=true , address=77.90.31.15:4701 , piece_id=RNM2KT34MVFKECJELAJ4DXZZGCW7YEC2H5ADRNSTVOLTJ6MFXY7Q, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.428626230 (265h41m50.387723465s) [noise=true , address=104.36.82.14:4230 , piece_id=IZX5UDPCS5TYNYJ4DQ67POJVGJD7KYUT4NO7HJ7ALLOJYXZWHJVQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.428681163 (265h41m50.387778402s) [noise=true , address=45.91.116.9:4283 , piece_id=5S4U52BMH2N2MD4KA7TNSLTXGFSBQDZO2NEZKESWUY24LBIT26VQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.430127248 (265h41m50.389224485s) [noise=true , address=45.91.116.12:4259 , piece_id=5NNGUVW25IVHEZGUIFWUZYNWLEFH5LF2XHA6OAD7FYL4UXLTI6PA, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.432516310 (265h41m50.391613545s) [noise=true , address=104.36.82.10:4090 , piece_id=DWXFEPGQZQRBZ2BRHKMTSSBDPJOW6OJ2IDQWF6K22C4BKZXMYSGQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.434731092 (265h41m50.393828326s) [noise=true , address=104.36.82.12:4177 , piece_id=IGA6TEGTJY5OLMT7POEBZ6FVZCJJLC4JS3CLGIRJX64F26NT344Q, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.446618737 (265h41m50.405715974s) [noise=true , address=104.36.82.9:4031 , piece_id=BW3FHKZB6QM6VDSLMJ3YGNM7EUYENSOCJUTRAUGARQPBXQ7SJVZQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.454492484 (265h41m50.413589731s) [noise=true , address=77.90.31.12:4610 , piece_id=BK6OVDHUURYXDJVQXONXWMC3WYJPAA7FANEJNKBLSMGQMCBIWTBQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.458320294 (265h41m50.417417539s) [noise=true , address=104.36.82.45:4906 , piece_id=HWDPX235S3OIVRD3NV54ALQOCM2QBWX4OKCXGNIIISARXPUMJ3NA, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.493991255 (265h41m50.453088487s) [noise=true , address=104.36.82.51:4054 , piece_id=QOKJJVMEA3QWFURSHWGSIX6ZBPJ36X5YFYNH66F72NMBXCVWKHWQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.502046020 (265h41m50.461143256s) [noise=true , address=104.36.82.15:4282 , piece_id=OWQOJZCQZWUHPSVHLCQS3CRCUZKJOIJCIUAR3GQDMPEJ3BHG6GRQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.610736689 (265h41m50.569833958s) [noise=true , address=77.90.31.18:4838 , piece_id=GHROAVOAZ2XMMF3RJH3W73LRJNYMYFVGRMEFGVDDWCJRS66CQWXQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.699083542 (265h41m50.658180786s) [noise=true , address=104.36.82.34:4549 , piece_id=SJYSYLTLGEXEMVYZTMNM5RPVWWKIJ2ISCECNUO7NMQ3QW57JXBNA, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.699114296 (265h41m50.658211541s) [seg_pos={0 0}, upload=276568]: Segment reached optimal threshold of 14 pieces.
Aug 19 19:07:28.699260428 (265h41m50.658357674s) [noise=true , address=77.90.31.13:4646 , piece_id=ZZE24VB3NVLKJNGX2J7T4OQQIWXPBM2NGXQ2YVXSBPQCV4CD7ASQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsJHk8jYeQAg4G4YXwCTjUSG4cX9xYhrZFmVpFQ5brFVz6TU5): protocol: expected piece hash; context canceled; EOF
Aug 19 19:07:28.699331496 (265h41m50.658428741s) [noise=true , address=79.127.201.215:4359 , piece_id=AEVRU4AC2ZN2IZEAN2NCSCKRAFE53XU6JRSJRS6E7AGT3BSFNIHA, seg_pos={0 0}, upload=276568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 19 19:07:28.699496104 (265h41m50.65859335s) [noise=true , address=79.127.205.246:4275 , piece_id=I3TOP55QJ7NUL665WCZ5ZPLUIEDTO5GCXC5F56IBWEDQUOF3D2JA, seg_pos={0 0}, upload=276568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: write tcp 139.59.144.22:36646->79.127.205.246:4275: use of closed network connection; write tcp 139.59.144.22:36646->79.127.205.246:4275: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36646->79.127.205.246:4275: use of closed network connection
Aug 19 19:07:28.699526741 (265h41m50.658623989s) [noise=true , address=79.127.205.235:4672 , piece_id=G5PKDCKG4ZOT36AGU6FXBTK63WBH7L27WCCYLH5EI3THAGNPRRVQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YKdrU9gctYPQCcPZjwhENcbBXcxo28x2kuZ4tp2RzW6Cuyn1i): protocol: write tcp 139.59.144.22:34814->79.127.205.235:4672: use of closed network connection; write tcp 139.59.144.22:34814->79.127.205.235:4672: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34814->79.127.205.235:4672: use of closed network connection
Aug 19 19:07:28.699565821 (265h41m50.65866308s) [seg_pos={0 0}, upload=276568]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 19:07:28.699683301 (265h41m50.658780552s) [upload=276568]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 19:07:28.699690072 (265h41m50.658787334s) [upload=276568]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 19:07:29.023215985 (265h41m50.982313231s) [upload=276568]: Done uploading segments...
Aug 19 19:07:29.023236776 (265h41m50.982334011s) [upload=276568]: Upload finished. err: <nil>
Duration: 2.58803476s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
833.47062ms
FAIL (2025-08-19 19:08:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 18:43:52.083745668 (265h18m14.042842919s) [upload=276163]: Starting upload
Aug 19 18:43:52.083817708 (265h18m14.042914956s) [upload=276163]: Done starting upload
Aug 19 18:43:52.083925788 (265h18m14.043023034s) [upload=276163]: Uploading segments...
Aug 19 18:43:52.084001343 (265h18m14.043098597s) [upload=276163]: Got next segment. Inline: true
Aug 19 18:43:52.084019067 (265h18m14.043116313s) [upload=276163]: Waiting for error group managing segments...
Aug 19 18:43:52.084065003 (265h18m14.043162248s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 18:43:52.084070415 (265h18m14.043167652s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 18:43:52.084073924 (265h18m14.04317116s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 18:43:53.024425173 (265h18m14.983522494s) [upload=276163]: Done uploading segments...
Aug 19 18:43:53.024446062 (265h18m14.983543301s) [upload=276163]: Upload finished. err: <nil>
Duration: 833.568553ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X............................X..........................X.] duration:
2.86625138s
FAIL (2025-08-19 19:07:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 404b87da8356c3971fa7103c7a35c61ffe3fe6dfabc9597c8d550702f4adb986 != before c3833e52db793d2a8b826622d0b99b5c30dc9c294005644d119ff49422d81e39
======LOGS======
Aug 19 19:07:23.754781503 (265h41m45.713878754s) [upload=276568]: Starting upload
Aug 19 19:07:23.754855095 (265h41m45.713952334s) [upload=276568]: Done starting upload
Aug 19 19:07:23.754935268 (265h41m45.714032513s) [upload=276568]: Uploading segments...
Aug 19 19:07:23.755224414 (265h41m45.714321666s) [upload=276568]: Got next segment. Inline: false
Aug 19 19:07:23.755273402 (265h41m45.714370654s) [upload=276568]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 19:07:23.755285112 (265h41m45.714382364s) [upload=276568]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 19:07:27.681606974 (265h41m49.64070422s) [seg_pos={0 0}, upload=276568]: Begin upload segment...
Aug 19 19:07:27.681656213 (265h41m49.640753459s) [seg_pos={0 0}, upload=276568]: Done begin upload segment.
Aug 19 19:07:27.681682553 (265h41m49.640779801s) [noise=true , address=79.127.201.215:4359 , piece_id=AEVRU4AC2ZN2IZEAN2NCSCKRAFE53XU6JRSJRS6E7AGT3BSFNIHA, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.681991088 (265h41m49.641088363s) [noise=true , address=104.36.82.45:4906 , piece_id=HWDPX235S3OIVRD3NV54ALQOCM2QBWX4OKCXGNIIISARXPUMJ3NA, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.682140014 (265h41m49.64123726s) [noise=true , address=104.36.82.34:4549 , piece_id=SJYSYLTLGEXEMVYZTMNM5RPVWWKIJ2ISCECNUO7NMQ3QW57JXBNA, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.682493890 (265h41m49.641591153s) [noise=true , address=79.127.205.246:4275 , piece_id=I3TOP55QJ7NUL665WCZ5ZPLUIEDTO5GCXC5F56IBWEDQUOF3D2JA, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.682617600 (265h41m49.641714854s) [noise=true , address=77.90.31.12:4610 , piece_id=BK6OVDHUURYXDJVQXONXWMC3WYJPAA7FANEJNKBLSMGQMCBIWTBQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.682877962 (265h41m49.64197521s) [noise=true , address=45.91.116.4:4944 , piece_id=7OTUDZ4KGMNXSWMZOFWFUGU3UGJ4DUBI34X42L5LXU2D2LKY5ITQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.683100580 (265h41m49.642197829s) [noise=true , address=77.90.31.18:4838 , piece_id=GHROAVOAZ2XMMF3RJH3W73LRJNYMYFVGRMEFGVDDWCJRS66CQWXQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.683214123 (265h41m49.642311368s) [noise=true , address=104.36.82.51:4054 , piece_id=QOKJJVMEA3QWFURSHWGSIX6ZBPJ36X5YFYNH66F72NMBXCVWKHWQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.683591907 (265h41m49.642689154s) [noise=true , address=104.36.82.9:4031 , piece_id=BW3FHKZB6QM6VDSLMJ3YGNM7EUYENSOCJUTRAUGARQPBXQ7SJVZQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.683608114 (265h41m49.642705367s) [noise=true , address=104.36.82.14:4230 , piece_id=IZX5UDPCS5TYNYJ4DQ67POJVGJD7KYUT4NO7HJ7ALLOJYXZWHJVQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.683967780 (265h41m49.643065025s) [noise=true , address=79.127.205.235:4672 , piece_id=G5PKDCKG4ZOT36AGU6FXBTK63WBH7L27WCCYLH5EI3THAGNPRRVQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.684021897 (265h41m49.643119148s) [noise=true , address=45.91.116.12:4259 , piece_id=5NNGUVW25IVHEZGUIFWUZYNWLEFH5LF2XHA6OAD7FYL4UXLTI6PA, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.684504591 (265h41m49.643601844s) [noise=true , address=104.36.82.12:4177 , piece_id=IGA6TEGTJY5OLMT7POEBZ6FVZCJJLC4JS3CLGIRJX64F26NT344Q, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.684671431 (265h41m49.643768679s) [noise=true , address=104.36.82.10:4090 , piece_id=DWXFEPGQZQRBZ2BRHKMTSSBDPJOW6OJ2IDQWF6K22C4BKZXMYSGQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.684883817 (265h41m49.643981062s) [noise=true , address=45.91.116.9:4283 , piece_id=5S4U52BMH2N2MD4KA7TNSLTXGFSBQDZO2NEZKESWUY24LBIT26VQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.685167707 (265h41m49.644264964s) [noise=true , address=104.36.82.15:4282 , piece_id=OWQOJZCQZWUHPSVHLCQS3CRCUZKJOIJCIUAR3GQDMPEJ3BHG6GRQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.685630710 (265h41m49.644727964s) [noise=true , address=77.90.31.13:4646 , piece_id=ZZE24VB3NVLKJNGX2J7T4OQQIWXPBM2NGXQ2YVXSBPQCV4CD7ASQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.686020061 (265h41m49.645117309s) [noise=true , address=77.90.31.15:4701 , piece_id=RNM2KT34MVFKECJELAJ4DXZZGCW7YEC2H5ADRNSTVOLTJ6MFXY7Q, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:28.239891415 (265h41m50.198988647s) [upload=276568]: Next returned nil segment
Aug 19 19:07:28.239918076 (265h41m50.199015334s) [upload=276568]: Waiting for error group managing segments...
Aug 19 19:07:28.402283748 (265h41m50.361380995s) [noise=true , address=45.91.116.4:4944 , piece_id=7OTUDZ4KGMNXSWMZOFWFUGU3UGJ4DUBI34X42L5LXU2D2LKY5ITQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.418104083 (265h41m50.377201318s) [noise=true , address=77.90.31.15:4701 , piece_id=RNM2KT34MVFKECJELAJ4DXZZGCW7YEC2H5ADRNSTVOLTJ6MFXY7Q, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.428626230 (265h41m50.387723465s) [noise=true , address=104.36.82.14:4230 , piece_id=IZX5UDPCS5TYNYJ4DQ67POJVGJD7KYUT4NO7HJ7ALLOJYXZWHJVQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.428681163 (265h41m50.387778402s) [noise=true , address=45.91.116.9:4283 , piece_id=5S4U52BMH2N2MD4KA7TNSLTXGFSBQDZO2NEZKESWUY24LBIT26VQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.430127248 (265h41m50.389224485s) [noise=true , address=45.91.116.12:4259 , piece_id=5NNGUVW25IVHEZGUIFWUZYNWLEFH5LF2XHA6OAD7FYL4UXLTI6PA, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.432516310 (265h41m50.391613545s) [noise=true , address=104.36.82.10:4090 , piece_id=DWXFEPGQZQRBZ2BRHKMTSSBDPJOW6OJ2IDQWF6K22C4BKZXMYSGQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.434731092 (265h41m50.393828326s) [noise=true , address=104.36.82.12:4177 , piece_id=IGA6TEGTJY5OLMT7POEBZ6FVZCJJLC4JS3CLGIRJX64F26NT344Q, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.446618737 (265h41m50.405715974s) [noise=true , address=104.36.82.9:4031 , piece_id=BW3FHKZB6QM6VDSLMJ3YGNM7EUYENSOCJUTRAUGARQPBXQ7SJVZQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.454492484 (265h41m50.413589731s) [noise=true , address=77.90.31.12:4610 , piece_id=BK6OVDHUURYXDJVQXONXWMC3WYJPAA7FANEJNKBLSMGQMCBIWTBQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.458320294 (265h41m50.417417539s) [noise=true , address=104.36.82.45:4906 , piece_id=HWDPX235S3OIVRD3NV54ALQOCM2QBWX4OKCXGNIIISARXPUMJ3NA, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.493991255 (265h41m50.453088487s) [noise=true , address=104.36.82.51:4054 , piece_id=QOKJJVMEA3QWFURSHWGSIX6ZBPJ36X5YFYNH66F72NMBXCVWKHWQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.502046020 (265h41m50.461143256s) [noise=true , address=104.36.82.15:4282 , piece_id=OWQOJZCQZWUHPSVHLCQS3CRCUZKJOIJCIUAR3GQDMPEJ3BHG6GRQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.610736689 (265h41m50.569833958s) [noise=true , address=77.90.31.18:4838 , piece_id=GHROAVOAZ2XMMF3RJH3W73LRJNYMYFVGRMEFGVDDWCJRS66CQWXQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.699083542 (265h41m50.658180786s) [noise=true , address=104.36.82.34:4549 , piece_id=SJYSYLTLGEXEMVYZTMNM5RPVWWKIJ2ISCECNUO7NMQ3QW57JXBNA, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.699114296 (265h41m50.658211541s) [seg_pos={0 0}, upload=276568]: Segment reached optimal threshold of 14 pieces.
Aug 19 19:07:28.699260428 (265h41m50.658357674s) [noise=true , address=77.90.31.13:4646 , piece_id=ZZE24VB3NVLKJNGX2J7T4OQQIWXPBM2NGXQ2YVXSBPQCV4CD7ASQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsJHk8jYeQAg4G4YXwCTjUSG4cX9xYhrZFmVpFQ5brFVz6TU5): protocol: expected piece hash; context canceled; EOF
Aug 19 19:07:28.699331496 (265h41m50.658428741s) [noise=true , address=79.127.201.215:4359 , piece_id=AEVRU4AC2ZN2IZEAN2NCSCKRAFE53XU6JRSJRS6E7AGT3BSFNIHA, seg_pos={0 0}, upload=276568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 19 19:07:28.699496104 (265h41m50.65859335s) [noise=true , address=79.127.205.246:4275 , piece_id=I3TOP55QJ7NUL665WCZ5ZPLUIEDTO5GCXC5F56IBWEDQUOF3D2JA, seg_pos={0 0}, upload=276568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: write tcp 139.59.144.22:36646->79.127.205.246:4275: use of closed network connection; write tcp 139.59.144.22:36646->79.127.205.246:4275: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36646->79.127.205.246:4275: use of closed network connection
Aug 19 19:07:28.699526741 (265h41m50.658623989s) [noise=true , address=79.127.205.235:4672 , piece_id=G5PKDCKG4ZOT36AGU6FXBTK63WBH7L27WCCYLH5EI3THAGNPRRVQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YKdrU9gctYPQCcPZjwhENcbBXcxo28x2kuZ4tp2RzW6Cuyn1i): protocol: write tcp 139.59.144.22:34814->79.127.205.235:4672: use of closed network connection; write tcp 139.59.144.22:34814->79.127.205.235:4672: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34814->79.127.205.235:4672: use of closed network connection
Aug 19 19:07:28.699565821 (265h41m50.65866308s) [seg_pos={0 0}, upload=276568]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 19:07:28.699683301 (265h41m50.658780552s) [upload=276568]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 19:07:28.699690072 (265h41m50.658787334s) [upload=276568]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 19:07:29.023215985 (265h41m50.982313231s) [upload=276568]: Done uploading segments...
Aug 19 19:07:29.023236776 (265h41m50.982334011s) [upload=276568]: Upload finished. err: <nil>
Duration: 2.866284888s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
1.382972664s
FAIL (2025-08-19 19:07:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 18:43:52.083745668 (265h18m14.042842919s) [upload=276163]: Starting upload
Aug 19 18:43:52.083817708 (265h18m14.042914956s) [upload=276163]: Done starting upload
Aug 19 18:43:52.083925788 (265h18m14.043023034s) [upload=276163]: Uploading segments...
Aug 19 18:43:52.084001343 (265h18m14.043098597s) [upload=276163]: Got next segment. Inline: true
Aug 19 18:43:52.084019067 (265h18m14.043116313s) [upload=276163]: Waiting for error group managing segments...
Aug 19 18:43:52.084065003 (265h18m14.043162248s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 18:43:52.084070415 (265h18m14.043167652s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 18:43:52.084073924 (265h18m14.04317116s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 18:43:53.024425173 (265h18m14.983522494s) [upload=276163]: Done uploading segments...
Aug 19 18:43:53.024446062 (265h18m14.983543301s) [upload=276163]: Upload finished. err: <nil>
Duration: 1.383087848s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X............................X..........................X] duration:
6.695100408s
FAIL (2025-08-19 19:07:30 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 404b87da8356c3971fa7103c7a35c61ffe3fe6dfabc9597c8d550702f4adb986 != before c3833e52db793d2a8b826622d0b99b5c30dc9c294005644d119ff49422d81e39
======LOGS======
Aug 19 19:07:23.754781503 (265h41m45.713878754s) [upload=276568]: Starting upload
Aug 19 19:07:23.754855095 (265h41m45.713952334s) [upload=276568]: Done starting upload
Aug 19 19:07:23.754935268 (265h41m45.714032513s) [upload=276568]: Uploading segments...
Aug 19 19:07:23.755224414 (265h41m45.714321666s) [upload=276568]: Got next segment. Inline: false
Aug 19 19:07:23.755273402 (265h41m45.714370654s) [upload=276568]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 19:07:23.755285112 (265h41m45.714382364s) [upload=276568]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 19:07:27.681606974 (265h41m49.64070422s) [seg_pos={0 0}, upload=276568]: Begin upload segment...
Aug 19 19:07:27.681656213 (265h41m49.640753459s) [seg_pos={0 0}, upload=276568]: Done begin upload segment.
Aug 19 19:07:27.681682553 (265h41m49.640779801s) [noise=true , address=79.127.201.215:4359 , piece_id=AEVRU4AC2ZN2IZEAN2NCSCKRAFE53XU6JRSJRS6E7AGT3BSFNIHA, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.681991088 (265h41m49.641088363s) [noise=true , address=104.36.82.45:4906 , piece_id=HWDPX235S3OIVRD3NV54ALQOCM2QBWX4OKCXGNIIISARXPUMJ3NA, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.682140014 (265h41m49.64123726s) [noise=true , address=104.36.82.34:4549 , piece_id=SJYSYLTLGEXEMVYZTMNM5RPVWWKIJ2ISCECNUO7NMQ3QW57JXBNA, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.682493890 (265h41m49.641591153s) [noise=true , address=79.127.205.246:4275 , piece_id=I3TOP55QJ7NUL665WCZ5ZPLUIEDTO5GCXC5F56IBWEDQUOF3D2JA, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.682617600 (265h41m49.641714854s) [noise=true , address=77.90.31.12:4610 , piece_id=BK6OVDHUURYXDJVQXONXWMC3WYJPAA7FANEJNKBLSMGQMCBIWTBQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.682877962 (265h41m49.64197521s) [noise=true , address=45.91.116.4:4944 , piece_id=7OTUDZ4KGMNXSWMZOFWFUGU3UGJ4DUBI34X42L5LXU2D2LKY5ITQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.683100580 (265h41m49.642197829s) [noise=true , address=77.90.31.18:4838 , piece_id=GHROAVOAZ2XMMF3RJH3W73LRJNYMYFVGRMEFGVDDWCJRS66CQWXQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.683214123 (265h41m49.642311368s) [noise=true , address=104.36.82.51:4054 , piece_id=QOKJJVMEA3QWFURSHWGSIX6ZBPJ36X5YFYNH66F72NMBXCVWKHWQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.683591907 (265h41m49.642689154s) [noise=true , address=104.36.82.9:4031 , piece_id=BW3FHKZB6QM6VDSLMJ3YGNM7EUYENSOCJUTRAUGARQPBXQ7SJVZQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.683608114 (265h41m49.642705367s) [noise=true , address=104.36.82.14:4230 , piece_id=IZX5UDPCS5TYNYJ4DQ67POJVGJD7KYUT4NO7HJ7ALLOJYXZWHJVQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.683967780 (265h41m49.643065025s) [noise=true , address=79.127.205.235:4672 , piece_id=G5PKDCKG4ZOT36AGU6FXBTK63WBH7L27WCCYLH5EI3THAGNPRRVQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.684021897 (265h41m49.643119148s) [noise=true , address=45.91.116.12:4259 , piece_id=5NNGUVW25IVHEZGUIFWUZYNWLEFH5LF2XHA6OAD7FYL4UXLTI6PA, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.684504591 (265h41m49.643601844s) [noise=true , address=104.36.82.12:4177 , piece_id=IGA6TEGTJY5OLMT7POEBZ6FVZCJJLC4JS3CLGIRJX64F26NT344Q, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.684671431 (265h41m49.643768679s) [noise=true , address=104.36.82.10:4090 , piece_id=DWXFEPGQZQRBZ2BRHKMTSSBDPJOW6OJ2IDQWF6K22C4BKZXMYSGQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.684883817 (265h41m49.643981062s) [noise=true , address=45.91.116.9:4283 , piece_id=5S4U52BMH2N2MD4KA7TNSLTXGFSBQDZO2NEZKESWUY24LBIT26VQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.685167707 (265h41m49.644264964s) [noise=true , address=104.36.82.15:4282 , piece_id=OWQOJZCQZWUHPSVHLCQS3CRCUZKJOIJCIUAR3GQDMPEJ3BHG6GRQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.685630710 (265h41m49.644727964s) [noise=true , address=77.90.31.13:4646 , piece_id=ZZE24VB3NVLKJNGX2J7T4OQQIWXPBM2NGXQ2YVXSBPQCV4CD7ASQ, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:27.686020061 (265h41m49.645117309s) [noise=true , address=77.90.31.15:4701 , piece_id=RNM2KT34MVFKECJELAJ4DXZZGCW7YEC2H5ADRNSTVOLTJ6MFXY7Q, seg_pos={0 0}, upload=276568]: Uploading piece...
Aug 19 19:07:28.239891415 (265h41m50.198988647s) [upload=276568]: Next returned nil segment
Aug 19 19:07:28.239918076 (265h41m50.199015334s) [upload=276568]: Waiting for error group managing segments...
Aug 19 19:07:28.402283748 (265h41m50.361380995s) [noise=true , address=45.91.116.4:4944 , piece_id=7OTUDZ4KGMNXSWMZOFWFUGU3UGJ4DUBI34X42L5LXU2D2LKY5ITQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.418104083 (265h41m50.377201318s) [noise=true , address=77.90.31.15:4701 , piece_id=RNM2KT34MVFKECJELAJ4DXZZGCW7YEC2H5ADRNSTVOLTJ6MFXY7Q, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.428626230 (265h41m50.387723465s) [noise=true , address=104.36.82.14:4230 , piece_id=IZX5UDPCS5TYNYJ4DQ67POJVGJD7KYUT4NO7HJ7ALLOJYXZWHJVQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.428681163 (265h41m50.387778402s) [noise=true , address=45.91.116.9:4283 , piece_id=5S4U52BMH2N2MD4KA7TNSLTXGFSBQDZO2NEZKESWUY24LBIT26VQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.430127248 (265h41m50.389224485s) [noise=true , address=45.91.116.12:4259 , piece_id=5NNGUVW25IVHEZGUIFWUZYNWLEFH5LF2XHA6OAD7FYL4UXLTI6PA, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.432516310 (265h41m50.391613545s) [noise=true , address=104.36.82.10:4090 , piece_id=DWXFEPGQZQRBZ2BRHKMTSSBDPJOW6OJ2IDQWF6K22C4BKZXMYSGQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.434731092 (265h41m50.393828326s) [noise=true , address=104.36.82.12:4177 , piece_id=IGA6TEGTJY5OLMT7POEBZ6FVZCJJLC4JS3CLGIRJX64F26NT344Q, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.446618737 (265h41m50.405715974s) [noise=true , address=104.36.82.9:4031 , piece_id=BW3FHKZB6QM6VDSLMJ3YGNM7EUYENSOCJUTRAUGARQPBXQ7SJVZQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.454492484 (265h41m50.413589731s) [noise=true , address=77.90.31.12:4610 , piece_id=BK6OVDHUURYXDJVQXONXWMC3WYJPAA7FANEJNKBLSMGQMCBIWTBQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.458320294 (265h41m50.417417539s) [noise=true , address=104.36.82.45:4906 , piece_id=HWDPX235S3OIVRD3NV54ALQOCM2QBWX4OKCXGNIIISARXPUMJ3NA, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.493991255 (265h41m50.453088487s) [noise=true , address=104.36.82.51:4054 , piece_id=QOKJJVMEA3QWFURSHWGSIX6ZBPJ36X5YFYNH66F72NMBXCVWKHWQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.502046020 (265h41m50.461143256s) [noise=true , address=104.36.82.15:4282 , piece_id=OWQOJZCQZWUHPSVHLCQS3CRCUZKJOIJCIUAR3GQDMPEJ3BHG6GRQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.610736689 (265h41m50.569833958s) [noise=true , address=77.90.31.18:4838 , piece_id=GHROAVOAZ2XMMF3RJH3W73LRJNYMYFVGRMEFGVDDWCJRS66CQWXQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.699083542 (265h41m50.658180786s) [noise=true , address=104.36.82.34:4549 , piece_id=SJYSYLTLGEXEMVYZTMNM5RPVWWKIJ2ISCECNUO7NMQ3QW57JXBNA, seg_pos={0 0}, upload=276568]: Done uploading piece. err: <nil>
Aug 19 19:07:28.699114296 (265h41m50.658211541s) [seg_pos={0 0}, upload=276568]: Segment reached optimal threshold of 14 pieces.
Aug 19 19:07:28.699260428 (265h41m50.658357674s) [noise=true , address=77.90.31.13:4646 , piece_id=ZZE24VB3NVLKJNGX2J7T4OQQIWXPBM2NGXQ2YVXSBPQCV4CD7ASQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsJHk8jYeQAg4G4YXwCTjUSG4cX9xYhrZFmVpFQ5brFVz6TU5): protocol: expected piece hash; context canceled; EOF
Aug 19 19:07:28.699331496 (265h41m50.658428741s) [noise=true , address=79.127.201.215:4359 , piece_id=AEVRU4AC2ZN2IZEAN2NCSCKRAFE53XU6JRSJRS6E7AGT3BSFNIHA, seg_pos={0 0}, upload=276568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 19 19:07:28.699496104 (265h41m50.65859335s) [noise=true , address=79.127.205.246:4275 , piece_id=I3TOP55QJ7NUL665WCZ5ZPLUIEDTO5GCXC5F56IBWEDQUOF3D2JA, seg_pos={0 0}, upload=276568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: write tcp 139.59.144.22:36646->79.127.205.246:4275: use of closed network connection; write tcp 139.59.144.22:36646->79.127.205.246:4275: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36646->79.127.205.246:4275: use of closed network connection
Aug 19 19:07:28.699526741 (265h41m50.658623989s) [noise=true , address=79.127.205.235:4672 , piece_id=G5PKDCKG4ZOT36AGU6FXBTK63WBH7L27WCCYLH5EI3THAGNPRRVQ, seg_pos={0 0}, upload=276568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YKdrU9gctYPQCcPZjwhENcbBXcxo28x2kuZ4tp2RzW6Cuyn1i): protocol: write tcp 139.59.144.22:34814->79.127.205.235:4672: use of closed network connection; write tcp 139.59.144.22:34814->79.127.205.235:4672: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34814->79.127.205.235:4672: use of closed network connection
Aug 19 19:07:28.699565821 (265h41m50.65866308s) [seg_pos={0 0}, upload=276568]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 19:07:28.699683301 (265h41m50.658780552s) [upload=276568]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 19:07:28.699690072 (265h41m50.658787334s) [upload=276568]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 19:07:29.023215985 (265h41m50.982313231s) [upload=276568]: Done uploading segments...
Aug 19 19:07:29.023236776 (265h41m50.982334011s) [upload=276568]: Upload finished. err: <nil>
Duration: 6.695133097s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
924.516248ms
FAIL (2025-08-19 19:07:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 18:43:52.083745668 (265h18m14.042842919s) [upload=276163]: Starting upload
Aug 19 18:43:52.083817708 (265h18m14.042914956s) [upload=276163]: Done starting upload
Aug 19 18:43:52.083925788 (265h18m14.043023034s) [upload=276163]: Uploading segments...
Aug 19 18:43:52.084001343 (265h18m14.043098597s) [upload=276163]: Got next segment. Inline: true
Aug 19 18:43:52.084019067 (265h18m14.043116313s) [upload=276163]: Waiting for error group managing segments...
Aug 19 18:43:52.084065003 (265h18m14.043162248s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 18:43:52.084070415 (265h18m14.043167652s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 18:43:52.084073924 (265h18m14.04317116s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 18:43:53.024425173 (265h18m14.983522494s) [upload=276163]: Done uploading segments...
Aug 19 18:43:53.024446062 (265h18m14.983543301s) [upload=276163]: Upload finished. err: <nil>
Duration: 924.551747ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X............................X..........................] duration:
2.506648903s
FAIL (2025-08-19 19:06:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 18:46:45.388980220 (265h21m7.348077475s) [upload=276213]: Starting upload Aug 19 18:46:45.389053694 (265h21m7.348150948s) [upload=276213]: Done starting upload Aug 19 18:46:45.389192661 (265h21m7.348289919s) [upload=276213]: Uploading segments... Aug 19 18:46:45.389367554 (265h21m7.348464789s) [upload=276213]: Got next segment. Inline: false Aug 19 18:46:45.389412281 (265h21m7.348509527s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 18:46:45.389417893 (265h21m7.348515141s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 18:46:45.478717582 (265h21m7.437814833s) [upload=276213]: Next segment err: metaclient: Too Many Requests Aug 19 18:46:45.478739079 (265h21m7.437836316s) [upload=276213]: Done uploading segments... Aug 19 18:46:45.478755887 (265h21m7.437853132s) [upload=276213]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.50674717s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
1.029824277s
FAIL (2025-08-19 19:06:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 18:43:52.083745668 (265h18m14.042842919s) [upload=276163]: Starting upload
Aug 19 18:43:52.083817708 (265h18m14.042914956s) [upload=276163]: Done starting upload
Aug 19 18:43:52.083925788 (265h18m14.043023034s) [upload=276163]: Uploading segments...
Aug 19 18:43:52.084001343 (265h18m14.043098597s) [upload=276163]: Got next segment. Inline: true
Aug 19 18:43:52.084019067 (265h18m14.043116313s) [upload=276163]: Waiting for error group managing segments...
Aug 19 18:43:52.084065003 (265h18m14.043162248s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 18:43:52.084070415 (265h18m14.043167652s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 18:43:52.084073924 (265h18m14.04317116s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 18:43:53.024425173 (265h18m14.983522494s) [upload=276163]: Done uploading segments...
Aug 19 18:43:53.024446062 (265h18m14.983543301s) [upload=276163]: Upload finished. err: <nil>
Duration: 1.029850367s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X............................X.........................] duration:
2.5994924s
FAIL (2025-08-19 19:05:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 18:46:45.388980220 (265h21m7.348077475s) [upload=276213]: Starting upload Aug 19 18:46:45.389053694 (265h21m7.348150948s) [upload=276213]: Done starting upload Aug 19 18:46:45.389192661 (265h21m7.348289919s) [upload=276213]: Uploading segments... Aug 19 18:46:45.389367554 (265h21m7.348464789s) [upload=276213]: Got next segment. Inline: false Aug 19 18:46:45.389412281 (265h21m7.348509527s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 18:46:45.389417893 (265h21m7.348515141s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 18:46:45.478717582 (265h21m7.437814833s) [upload=276213]: Next segment err: metaclient: Too Many Requests Aug 19 18:46:45.478739079 (265h21m7.437836316s) [upload=276213]: Done uploading segments... Aug 19 18:46:45.478755887 (265h21m7.437853132s) [upload=276213]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.599547702s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X............................X........................] duration:
2.851315328s
FAIL (2025-08-19 19:05:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 18:46:45.388980220 (265h21m7.348077475s) [upload=276213]: Starting upload Aug 19 18:46:45.389053694 (265h21m7.348150948s) [upload=276213]: Done starting upload Aug 19 18:46:45.389192661 (265h21m7.348289919s) [upload=276213]: Uploading segments... Aug 19 18:46:45.389367554 (265h21m7.348464789s) [upload=276213]: Got next segment. Inline: false Aug 19 18:46:45.389412281 (265h21m7.348509527s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 18:46:45.389417893 (265h21m7.348515141s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 18:46:45.478717582 (265h21m7.437814833s) [upload=276213]: Next segment err: metaclient: Too Many Requests Aug 19 18:46:45.478739079 (265h21m7.437836316s) [upload=276213]: Done uploading segments... Aug 19 18:46:45.478755887 (265h21m7.437853132s) [upload=276213]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.851354877s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
1.019357652s
FAIL (2025-08-19 19:05:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 18:43:52.083745668 (265h18m14.042842919s) [upload=276163]: Starting upload
Aug 19 18:43:52.083817708 (265h18m14.042914956s) [upload=276163]: Done starting upload
Aug 19 18:43:52.083925788 (265h18m14.043023034s) [upload=276163]: Uploading segments...
Aug 19 18:43:52.084001343 (265h18m14.043098597s) [upload=276163]: Got next segment. Inline: true
Aug 19 18:43:52.084019067 (265h18m14.043116313s) [upload=276163]: Waiting for error group managing segments...
Aug 19 18:43:52.084065003 (265h18m14.043162248s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 18:43:52.084070415 (265h18m14.043167652s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 18:43:52.084073924 (265h18m14.04317116s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 18:43:53.024425173 (265h18m14.983522494s) [upload=276163]: Done uploading segments...
Aug 19 18:43:53.024446062 (265h18m14.983543301s) [upload=276163]: Upload finished. err: <nil>
Duration: 1.019387861s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X............................X.......................] duration:
2.494672153s
FAIL (2025-08-19 19:04:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 18:46:45.388980220 (265h21m7.348077475s) [upload=276213]: Starting upload Aug 19 18:46:45.389053694 (265h21m7.348150948s) [upload=276213]: Done starting upload Aug 19 18:46:45.389192661 (265h21m7.348289919s) [upload=276213]: Uploading segments... Aug 19 18:46:45.389367554 (265h21m7.348464789s) [upload=276213]: Got next segment. Inline: false Aug 19 18:46:45.389412281 (265h21m7.348509527s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 18:46:45.389417893 (265h21m7.348515141s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 18:46:45.478717582 (265h21m7.437814833s) [upload=276213]: Next segment err: metaclient: Too Many Requests Aug 19 18:46:45.478739079 (265h21m7.437836316s) [upload=276213]: Done uploading segments... Aug 19 18:46:45.478755887 (265h21m7.437853132s) [upload=276213]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.494706447s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
954.377842ms
FAIL (2025-08-19 19:04:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 18:43:52.083745668 (265h18m14.042842919s) [upload=276163]: Starting upload
Aug 19 18:43:52.083817708 (265h18m14.042914956s) [upload=276163]: Done starting upload
Aug 19 18:43:52.083925788 (265h18m14.043023034s) [upload=276163]: Uploading segments...
Aug 19 18:43:52.084001343 (265h18m14.043098597s) [upload=276163]: Got next segment. Inline: true
Aug 19 18:43:52.084019067 (265h18m14.043116313s) [upload=276163]: Waiting for error group managing segments...
Aug 19 18:43:52.084065003 (265h18m14.043162248s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 18:43:52.084070415 (265h18m14.043167652s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 18:43:52.084073924 (265h18m14.04317116s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 18:43:53.024425173 (265h18m14.983522494s) [upload=276163]: Done uploading segments...
Aug 19 18:43:53.024446062 (265h18m14.983543301s) [upload=276163]: Upload finished. err: <nil>
Duration: 954.408487ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X............................X......................] duration:
2.499765419s
FAIL (2025-08-19 19:03:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 18:46:45.388980220 (265h21m7.348077475s) [upload=276213]: Starting upload Aug 19 18:46:45.389053694 (265h21m7.348150948s) [upload=276213]: Done starting upload Aug 19 18:46:45.389192661 (265h21m7.348289919s) [upload=276213]: Uploading segments... Aug 19 18:46:45.389367554 (265h21m7.348464789s) [upload=276213]: Got next segment. Inline: false Aug 19 18:46:45.389412281 (265h21m7.348509527s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 18:46:45.389417893 (265h21m7.348515141s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 18:46:45.478717582 (265h21m7.437814833s) [upload=276213]: Next segment err: metaclient: Too Many Requests Aug 19 18:46:45.478739079 (265h21m7.437836316s) [upload=276213]: Done uploading segments... Aug 19 18:46:45.478755887 (265h21m7.437853132s) [upload=276213]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.499801141s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
870.52501ms
FAIL (2025-08-19 19:03:35 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 18:43:52.083745668 (265h18m14.042842919s) [upload=276163]: Starting upload
Aug 19 18:43:52.083817708 (265h18m14.042914956s) [upload=276163]: Done starting upload
Aug 19 18:43:52.083925788 (265h18m14.043023034s) [upload=276163]: Uploading segments...
Aug 19 18:43:52.084001343 (265h18m14.043098597s) [upload=276163]: Got next segment. Inline: true
Aug 19 18:43:52.084019067 (265h18m14.043116313s) [upload=276163]: Waiting for error group managing segments...
Aug 19 18:43:52.084065003 (265h18m14.043162248s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 18:43:52.084070415 (265h18m14.043167652s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 18:43:52.084073924 (265h18m14.04317116s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 18:43:53.024425173 (265h18m14.983522494s) [upload=276163]: Done uploading segments...
Aug 19 18:43:53.024446062 (265h18m14.983543301s) [upload=276163]: Upload finished. err: <nil>
Duration: 870.549025ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X............................X.....................] duration:
2.61945704s
FAIL (2025-08-19 19:02:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 18:46:45.388980220 (265h21m7.348077475s) [upload=276213]: Starting upload Aug 19 18:46:45.389053694 (265h21m7.348150948s) [upload=276213]: Done starting upload Aug 19 18:46:45.389192661 (265h21m7.348289919s) [upload=276213]: Uploading segments... Aug 19 18:46:45.389367554 (265h21m7.348464789s) [upload=276213]: Got next segment. Inline: false Aug 19 18:46:45.389412281 (265h21m7.348509527s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 18:46:45.389417893 (265h21m7.348515141s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 18:46:45.478717582 (265h21m7.437814833s) [upload=276213]: Next segment err: metaclient: Too Many Requests Aug 19 18:46:45.478739079 (265h21m7.437836316s) [upload=276213]: Done uploading segments... Aug 19 18:46:45.478755887 (265h21m7.437853132s) [upload=276213]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.619493002s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
958.930336ms
FAIL (2025-08-19 19:02:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 18:43:52.083745668 (265h18m14.042842919s) [upload=276163]: Starting upload
Aug 19 18:43:52.083817708 (265h18m14.042914956s) [upload=276163]: Done starting upload
Aug 19 18:43:52.083925788 (265h18m14.043023034s) [upload=276163]: Uploading segments...
Aug 19 18:43:52.084001343 (265h18m14.043098597s) [upload=276163]: Got next segment. Inline: true
Aug 19 18:43:52.084019067 (265h18m14.043116313s) [upload=276163]: Waiting for error group managing segments...
Aug 19 18:43:52.084065003 (265h18m14.043162248s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 18:43:52.084070415 (265h18m14.043167652s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 18:43:52.084073924 (265h18m14.04317116s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 18:43:53.024425173 (265h18m14.983522494s) [upload=276163]: Done uploading segments...
Aug 19 18:43:53.024446062 (265h18m14.983543301s) [upload=276163]: Upload finished. err: <nil>
Duration: 958.959758ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X............................X....................] duration:
2.524651276s
FAIL (2025-08-19 19:01:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 18:46:45.388980220 (265h21m7.348077475s) [upload=276213]: Starting upload Aug 19 18:46:45.389053694 (265h21m7.348150948s) [upload=276213]: Done starting upload Aug 19 18:46:45.389192661 (265h21m7.348289919s) [upload=276213]: Uploading segments... Aug 19 18:46:45.389367554 (265h21m7.348464789s) [upload=276213]: Got next segment. Inline: false Aug 19 18:46:45.389412281 (265h21m7.348509527s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 18:46:45.389417893 (265h21m7.348515141s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 18:46:45.478717582 (265h21m7.437814833s) [upload=276213]: Next segment err: metaclient: Too Many Requests Aug 19 18:46:45.478739079 (265h21m7.437836316s) [upload=276213]: Done uploading segments... Aug 19 18:46:45.478755887 (265h21m7.437853132s) [upload=276213]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.524682058s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
898.906303ms
FAIL (2025-08-19 19:01:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 18:43:52.083745668 (265h18m14.042842919s) [upload=276163]: Starting upload
Aug 19 18:43:52.083817708 (265h18m14.042914956s) [upload=276163]: Done starting upload
Aug 19 18:43:52.083925788 (265h18m14.043023034s) [upload=276163]: Uploading segments...
Aug 19 18:43:52.084001343 (265h18m14.043098597s) [upload=276163]: Got next segment. Inline: true
Aug 19 18:43:52.084019067 (265h18m14.043116313s) [upload=276163]: Waiting for error group managing segments...
Aug 19 18:43:52.084065003 (265h18m14.043162248s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 18:43:52.084070415 (265h18m14.043167652s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 18:43:52.084073924 (265h18m14.04317116s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 18:43:53.024425173 (265h18m14.983522494s) [upload=276163]: Done uploading segments...
Aug 19 18:43:53.024446062 (265h18m14.983543301s) [upload=276163]: Upload finished. err: <nil>
Duration: 898.963684ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X............................X...................] duration:
2.676751171s
FAIL (2025-08-19 19:00:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 18:46:45.388980220 (265h21m7.348077475s) [upload=276213]: Starting upload Aug 19 18:46:45.389053694 (265h21m7.348150948s) [upload=276213]: Done starting upload Aug 19 18:46:45.389192661 (265h21m7.348289919s) [upload=276213]: Uploading segments... Aug 19 18:46:45.389367554 (265h21m7.348464789s) [upload=276213]: Got next segment. Inline: false Aug 19 18:46:45.389412281 (265h21m7.348509527s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 18:46:45.389417893 (265h21m7.348515141s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 18:46:45.478717582 (265h21m7.437814833s) [upload=276213]: Next segment err: metaclient: Too Many Requests Aug 19 18:46:45.478739079 (265h21m7.437836316s) [upload=276213]: Done uploading segments... Aug 19 18:46:45.478755887 (265h21m7.437853132s) [upload=276213]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.676786654s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
1.009867289s
FAIL (2025-08-19 19:00:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 18:43:52.083745668 (265h18m14.042842919s) [upload=276163]: Starting upload
Aug 19 18:43:52.083817708 (265h18m14.042914956s) [upload=276163]: Done starting upload
Aug 19 18:43:52.083925788 (265h18m14.043023034s) [upload=276163]: Uploading segments...
Aug 19 18:43:52.084001343 (265h18m14.043098597s) [upload=276163]: Got next segment. Inline: true
Aug 19 18:43:52.084019067 (265h18m14.043116313s) [upload=276163]: Waiting for error group managing segments...
Aug 19 18:43:52.084065003 (265h18m14.043162248s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 18:43:52.084070415 (265h18m14.043167652s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 18:43:52.084073924 (265h18m14.04317116s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 18:43:53.024425173 (265h18m14.983522494s) [upload=276163]: Done uploading segments...
Aug 19 18:43:53.024446062 (265h18m14.983543301s) [upload=276163]: Upload finished. err: <nil>
Duration: 1.009914831s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X............................X..................] duration:
2.440104319s
FAIL (2025-08-19 18:59:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 18:46:45.388980220 (265h21m7.348077475s) [upload=276213]: Starting upload Aug 19 18:46:45.389053694 (265h21m7.348150948s) [upload=276213]: Done starting upload Aug 19 18:46:45.389192661 (265h21m7.348289919s) [upload=276213]: Uploading segments... Aug 19 18:46:45.389367554 (265h21m7.348464789s) [upload=276213]: Got next segment. Inline: false Aug 19 18:46:45.389412281 (265h21m7.348509527s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 18:46:45.389417893 (265h21m7.348515141s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 18:46:45.478717582 (265h21m7.437814833s) [upload=276213]: Next segment err: metaclient: Too Many Requests Aug 19 18:46:45.478739079 (265h21m7.437836316s) [upload=276213]: Done uploading segments... Aug 19 18:46:45.478755887 (265h21m7.437853132s) [upload=276213]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.44013898s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
963.045143ms
FAIL (2025-08-19 18:59:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 18:43:52.083745668 (265h18m14.042842919s) [upload=276163]: Starting upload
Aug 19 18:43:52.083817708 (265h18m14.042914956s) [upload=276163]: Done starting upload
Aug 19 18:43:52.083925788 (265h18m14.043023034s) [upload=276163]: Uploading segments...
Aug 19 18:43:52.084001343 (265h18m14.043098597s) [upload=276163]: Got next segment. Inline: true
Aug 19 18:43:52.084019067 (265h18m14.043116313s) [upload=276163]: Waiting for error group managing segments...
Aug 19 18:43:52.084065003 (265h18m14.043162248s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 18:43:52.084070415 (265h18m14.043167652s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 18:43:52.084073924 (265h18m14.04317116s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 18:43:53.024425173 (265h18m14.983522494s) [upload=276163]: Done uploading segments...
Aug 19 18:43:53.024446062 (265h18m14.983543301s) [upload=276163]: Upload finished. err: <nil>
Duration: 963.081866ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X............................X.................] duration:
2.465928377s
FAIL (2025-08-19 18:58:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 18:46:45.388980220 (265h21m7.348077475s) [upload=276213]: Starting upload Aug 19 18:46:45.389053694 (265h21m7.348150948s) [upload=276213]: Done starting upload Aug 19 18:46:45.389192661 (265h21m7.348289919s) [upload=276213]: Uploading segments... Aug 19 18:46:45.389367554 (265h21m7.348464789s) [upload=276213]: Got next segment. Inline: false Aug 19 18:46:45.389412281 (265h21m7.348509527s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 18:46:45.389417893 (265h21m7.348515141s) [upload=276213]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 18:46:45.478717582 (265h21m7.437814833s) [upload=276213]: Next segment err: metaclient: Too Many Requests Aug 19 18:46:45.478739079 (265h21m7.437836316s) [upload=276213]: Done uploading segments... Aug 19 18:46:45.478755887 (265h21m7.437853132s) [upload=276213]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.465973366s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
908.422791ms
FAIL (2025-08-19 18:58:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 18:43:52.083745668 (265h18m14.042842919s) [upload=276163]: Starting upload
Aug 19 18:43:52.083817708 (265h18m14.042914956s) [upload=276163]: Done starting upload
Aug 19 18:43:52.083925788 (265h18m14.043023034s) [upload=276163]: Uploading segments...
Aug 19 18:43:52.084001343 (265h18m14.043098597s) [upload=276163]: Got next segment. Inline: true
Aug 19 18:43:52.084019067 (265h18m14.043116313s) [upload=276163]: Waiting for error group managing segments...
Aug 19 18:43:52.084065003 (265h18m14.043162248s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 18:43:52.084070415 (265h18m14.043167652s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 18:43:52.084073924 (265h18m14.04317116s) [upload=276163]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 18:43:53.024425173 (265h18m14.983522494s) [upload=276163]: Done uploading segments...
Aug 19 18:43:53.024446062 (265h18m14.983543301s) [upload=276163]: Upload finished. err: <nil>
Duration: 908.457498ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|