Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
872.740261ms
FAIL (2025-08-17 05:42:24 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 05:37:25.864703317 (204h11m47.823800572s) [upload=212570]: Starting upload Aug 17 05:37:25.864930352 (204h11m47.824027605s) [upload=212570]: Done starting upload Aug 17 05:37:25.865030044 (204h11m47.82412729s) [upload=212570]: Uploading segments... Aug 17 05:37:25.865141131 (204h11m47.824238386s) [upload=212570]: Got next segment. Inline: true Aug 17 05:37:25.865151389 (204h11m47.824248645s) [upload=212570]: Waiting for error group managing segments... Aug 17 05:37:25.865219801 (204h11m47.824317051s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:37:25.865225461 (204h11m47.824322715s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 05:37:25.865229681 (204h11m47.824326931s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 05:37:26.092140033 (204h11m48.051237286s) [upload=212570]: Done uploading segments... Aug 17 05:37:26.092193694 (204h11m48.051290945s) [upload=212570]: Upload finished. err: <nil>
Duration: 872.78426ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X.....................................X...................] duration:
2.371816603s
FAIL (2025-08-17 05:41:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.371849854s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
863.980207ms
FAIL (2025-08-17 05:41:36 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 05:37:25.864703317 (204h11m47.823800572s) [upload=212570]: Starting upload Aug 17 05:37:25.864930352 (204h11m47.824027605s) [upload=212570]: Done starting upload Aug 17 05:37:25.865030044 (204h11m47.82412729s) [upload=212570]: Uploading segments... Aug 17 05:37:25.865141131 (204h11m47.824238386s) [upload=212570]: Got next segment. Inline: true Aug 17 05:37:25.865151389 (204h11m47.824248645s) [upload=212570]: Waiting for error group managing segments... Aug 17 05:37:25.865219801 (204h11m47.824317051s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:37:25.865225461 (204h11m47.824322715s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 05:37:25.865229681 (204h11m47.824326931s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 05:37:26.092140033 (204h11m48.051237286s) [upload=212570]: Done uploading segments... Aug 17 05:37:26.092193694 (204h11m48.051290945s) [upload=212570]: Upload finished. err: <nil>
Duration: 864.020883ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X.....................................X..................] duration:
2.403128773s
FAIL (2025-08-17 05:41:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.403162096s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
836.360595ms
FAIL (2025-08-17 05:40:55 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 05:37:25.864703317 (204h11m47.823800572s) [upload=212570]: Starting upload Aug 17 05:37:25.864930352 (204h11m47.824027605s) [upload=212570]: Done starting upload Aug 17 05:37:25.865030044 (204h11m47.82412729s) [upload=212570]: Uploading segments... Aug 17 05:37:25.865141131 (204h11m47.824238386s) [upload=212570]: Got next segment. Inline: true Aug 17 05:37:25.865151389 (204h11m47.824248645s) [upload=212570]: Waiting for error group managing segments... Aug 17 05:37:25.865219801 (204h11m47.824317051s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:37:25.865225461 (204h11m47.824322715s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 05:37:25.865229681 (204h11m47.824326931s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 05:37:26.092140033 (204h11m48.051237286s) [upload=212570]: Done uploading segments... Aug 17 05:37:26.092193694 (204h11m48.051290945s) [upload=212570]: Upload finished. err: <nil>
Duration: 836.391963ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X.....................................X.................] duration:
2.354915397s
FAIL (2025-08-17 05:40:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.354964475s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.029473172s
FAIL (2025-08-17 05:40:11 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 05:37:25.864703317 (204h11m47.823800572s) [upload=212570]: Starting upload Aug 17 05:37:25.864930352 (204h11m47.824027605s) [upload=212570]: Done starting upload Aug 17 05:37:25.865030044 (204h11m47.82412729s) [upload=212570]: Uploading segments... Aug 17 05:37:25.865141131 (204h11m47.824238386s) [upload=212570]: Got next segment. Inline: true Aug 17 05:37:25.865151389 (204h11m47.824248645s) [upload=212570]: Waiting for error group managing segments... Aug 17 05:37:25.865219801 (204h11m47.824317051s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:37:25.865225461 (204h11m47.824322715s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 05:37:25.865229681 (204h11m47.824326931s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 05:37:26.092140033 (204h11m48.051237286s) [upload=212570]: Done uploading segments... Aug 17 05:37:26.092193694 (204h11m48.051290945s) [upload=212570]: Upload finished. err: <nil>
Duration: 1.029519501s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X.....................................X................] duration:
2.504487932s
FAIL (2025-08-17 05:39:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.504549372s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
794.677615ms
FAIL (2025-08-17 05:39:13 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 05:37:25.864703317 (204h11m47.823800572s) [upload=212570]: Starting upload Aug 17 05:37:25.864930352 (204h11m47.824027605s) [upload=212570]: Done starting upload Aug 17 05:37:25.865030044 (204h11m47.82412729s) [upload=212570]: Uploading segments... Aug 17 05:37:25.865141131 (204h11m47.824238386s) [upload=212570]: Got next segment. Inline: true Aug 17 05:37:25.865151389 (204h11m47.824248645s) [upload=212570]: Waiting for error group managing segments... Aug 17 05:37:25.865219801 (204h11m47.824317051s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:37:25.865225461 (204h11m47.824322715s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 05:37:25.865229681 (204h11m47.824326931s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 05:37:26.092140033 (204h11m48.051237286s) [upload=212570]: Done uploading segments... Aug 17 05:37:26.092193694 (204h11m48.051290945s) [upload=212570]: Upload finished. err: <nil>
Duration: 794.72673ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X.....................................X...............] duration:
2.631857073s
FAIL (2025-08-17 05:38:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.631887463s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
1.030088734s
FAIL (2025-08-17 05:38:26 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 05:37:25.864703317 (204h11m47.823800572s) [upload=212570]: Starting upload Aug 17 05:37:25.864930352 (204h11m47.824027605s) [upload=212570]: Done starting upload Aug 17 05:37:25.865030044 (204h11m47.82412729s) [upload=212570]: Uploading segments... Aug 17 05:37:25.865141131 (204h11m47.824238386s) [upload=212570]: Got next segment. Inline: true Aug 17 05:37:25.865151389 (204h11m47.824248645s) [upload=212570]: Waiting for error group managing segments... Aug 17 05:37:25.865219801 (204h11m47.824317051s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:37:25.865225461 (204h11m47.824322715s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 05:37:25.865229681 (204h11m47.824326931s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 05:37:26.092140033 (204h11m48.051237286s) [upload=212570]: Done uploading segments... Aug 17 05:37:26.092193694 (204h11m48.051290945s) [upload=212570]: Upload finished. err: <nil>
Duration: 1.030118873s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X.....................................X..............] duration:
2.345698966s
FAIL (2025-08-17 05:37:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.345734906s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
827.60183ms
FAIL (2025-08-17 05:37:55 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 05:37:25.864703317 (204h11m47.823800572s) [upload=212570]: Starting upload Aug 17 05:37:25.864930352 (204h11m47.824027605s) [upload=212570]: Done starting upload Aug 17 05:37:25.865030044 (204h11m47.82412729s) [upload=212570]: Uploading segments... Aug 17 05:37:25.865141131 (204h11m47.824238386s) [upload=212570]: Got next segment. Inline: true Aug 17 05:37:25.865151389 (204h11m47.824248645s) [upload=212570]: Waiting for error group managing segments... Aug 17 05:37:25.865219801 (204h11m47.824317051s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:37:25.865225461 (204h11m47.824322715s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 05:37:25.865229681 (204h11m47.824326931s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 05:37:26.092140033 (204h11m48.051237286s) [upload=212570]: Done uploading segments... Aug 17 05:37:26.092193694 (204h11m48.051290945s) [upload=212570]: Upload finished. err: <nil>
Duration: 827.67226ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
742.971006ms
FAIL (2025-08-17 05:37:26 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 05:37:25.864703317 (204h11m47.823800572s) [upload=212570]: Starting upload Aug 17 05:37:25.864930352 (204h11m47.824027605s) [upload=212570]: Done starting upload Aug 17 05:37:25.865030044 (204h11m47.82412729s) [upload=212570]: Uploading segments... Aug 17 05:37:25.865141131 (204h11m47.824238386s) [upload=212570]: Got next segment. Inline: true Aug 17 05:37:25.865151389 (204h11m47.824248645s) [upload=212570]: Waiting for error group managing segments... Aug 17 05:37:25.865219801 (204h11m47.824317051s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:37:25.865225461 (204h11m47.824322715s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 05:37:25.865229681 (204h11m47.824326931s) [upload=212570]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 05:37:26.092140033 (204h11m48.051237286s) [upload=212570]: Done uploading segments... Aug 17 05:37:26.092193694 (204h11m48.051290945s) [upload=212570]: Upload finished. err: <nil>
Duration: 743.005815ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X.....................................X.............] duration:
2.34630306s
FAIL (2025-08-17 05:37:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.346336952s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X.....................................X............] duration:
2.355855851s
FAIL (2025-08-17 05:36:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.355893435s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X.....................................X...........] duration:
2.93126941s
FAIL (2025-08-17 05:35:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.931301187s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X.....................................X..........] duration:
2.452453982s
FAIL (2025-08-17 05:35:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.452484655s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
891.328114ms
FAIL (2025-08-17 05:34:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 891.360074ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X.....................................X.........] duration:
2.614253324s
FAIL (2025-08-17 05:34:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.614287313s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X.....................................X........] duration:
2.426946816s
FAIL (2025-08-17 05:34:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.427002349s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
932.779789ms
FAIL (2025-08-17 05:33:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 932.821691ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
837.166601ms
FAIL (2025-08-17 05:33:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 837.308155ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.............X.....................................X.......] duration:
2.455744496s
FAIL (2025-08-17 05:33:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.455778395s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
811.568688ms
FAIL (2025-08-17 05:32:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 811.676157ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.............X.....................................X......] duration:
2.471387626s
FAIL (2025-08-17 05:32:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.47143722s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.............X.....................................X.....] duration:
2.346021175s
FAIL (2025-08-17 05:32:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.346054479s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
845.92479ms
FAIL (2025-08-17 05:32:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 846.045247ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X.............X.....................................X....] duration:
2.548510208s
FAIL (2025-08-17 05:32:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.548573238s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
822.126276ms
FAIL (2025-08-17 05:31:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 822.154994ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X.............X.....................................X...] duration:
2.495750678s
FAIL (2025-08-17 05:31:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.495777821s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
838.880392ms
FAIL (2025-08-17 05:30:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 838.987648ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X.............X.....................................X..] duration:
2.60125828s
FAIL (2025-08-17 05:30:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.601286316s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X.............X.....................................X.] duration:
2.448701604s
FAIL (2025-08-17 05:30:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.448733956s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X.............X.....................................X] duration:
368.8919ms
FAIL (2025-08-17 05:29:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 05:29:51.999117931 (204h4m13.958215167s) [upload=212436]: Starting upload Aug 17 05:29:51.999199480 (204h4m13.958296727s) [upload=212436]: Done starting upload Aug 17 05:29:51.999289085 (204h4m13.958386331s) [upload=212436]: Uploading segments... Aug 17 05:29:51.999609630 (204h4m13.958706876s) [upload=212436]: Got next segment. Inline: false Aug 17 05:29:51.999658256 (204h4m13.958755502s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 05:29:51.999663789 (204h4m13.958761034s) [upload=212436]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 05:29:52.090344862 (204h4m14.049442119s) [upload=212436]: Next segment err: metaclient: Too Many Requests Aug 17 05:29:52.090379222 (204h4m14.049476474s) [upload=212436]: Done uploading segments... Aug 17 05:29:52.090417497 (204h4m14.049514748s) [upload=212436]: Upload finished. err: metaclient: Too Many Requests
Duration: 368.936155ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
826.941657ms
FAIL (2025-08-17 05:29:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 826.982336ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X.............X.....................................] duration:
2.409972007s
FAIL (2025-08-17 05:29:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.410010344s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
1.070177202s
FAIL (2025-08-17 05:29:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.070222959s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X.............X....................................] duration:
2.474683991s
FAIL (2025-08-17 05:29:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.474711462s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X........X..................................................] duration:
826.353088ms
FAIL (2025-08-17 05:28:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 826.386109ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X.............X...................................] duration:
2.438376247s
FAIL (2025-08-17 05:28:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.438408428s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X........X.................................................] duration:
977.63978ms
FAIL (2025-08-17 05:27:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 977.675061ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X.............X..................................] duration:
2.427923897s
FAIL (2025-08-17 05:27:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.428029946s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.X........X................................................] duration:
805.68735ms
FAIL (2025-08-17 05:27:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 805.724428ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X.............X.................................] duration:
2.434088324s
FAIL (2025-08-17 05:27:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.434125279s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X.X........X...............................................] duration:
842.817504ms
FAIL (2025-08-17 05:26:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 842.850571ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X.X........X..............................................] duration:
870.865862ms
FAIL (2025-08-17 05:26:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 870.909828ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X.............X................................] duration:
2.480021158s
FAIL (2025-08-17 05:26:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.48006293s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X.X........X.............................................] duration:
1.06604535s
FAIL (2025-08-17 05:25:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.066077687s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X.............X...............................] duration:
2.639398982s
FAIL (2025-08-17 05:24:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.639435204s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|