Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X..............................X...........X....X] duration:
363.167928ms
FAIL (2025-08-20 05:32:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:32:04.445414156 (276h6m26.404511413s) [upload=287334]: Starting upload Aug 20 05:32:04.445501665 (276h6m26.404598918s) [upload=287334]: Done starting upload Aug 20 05:32:04.445622869 (276h6m26.404720117s) [upload=287334]: Uploading segments... Aug 20 05:32:04.445744799 (276h6m26.404842054s) [upload=287334]: Got next segment. Inline: true Aug 20 05:32:04.445772155 (276h6m26.404869411s) [upload=287334]: Waiting for error group managing segments... Aug 20 05:32:04.445846353 (276h6m26.404943597s) [upload=287334]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:32:04.445853518 (276h6m26.404950763s) [upload=287334]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 05:32:04.445857366 (276h6m26.404954617s) [upload=287334]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 05:32:04.535155370 (276h6m26.494252619s) [upload=287334]: Done uploading segments... Aug 20 05:32:04.535174344 (276h6m26.494271589s) [upload=287334]: Upload finished. err: metaclient: Too Many Requests
Duration: 363.190939ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X.....X...............] duration:
2.25193694s
FAIL (2025-08-20 05:32:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:21:26.410416216 (275h55m48.369513526s) [upload=287147]: Starting upload Aug 20 05:21:26.410495709 (275h55m48.369592957s) [upload=287147]: Done starting upload Aug 20 05:21:26.410647440 (275h55m48.369744699s) [upload=287147]: Uploading segments... Aug 20 05:21:26.411333004 (275h55m48.370430239s) [upload=287147]: Got next segment. Inline: false Aug 20 05:21:26.411607782 (275h55m48.37070503s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:21:26.411620840 (275h55m48.370718097s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:21:26.502418742 (275h55m48.461515988s) [upload=287147]: Next segment err: metaclient: Too Many Requests Aug 20 05:21:26.502462059 (275h55m48.461559376s) [upload=287147]: Done uploading segments... Aug 20 05:21:26.502503548 (275h55m48.461600789s) [upload=287147]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.251977413s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X.....X..............] duration:
2.324536758s
FAIL (2025-08-20 05:31:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:21:26.410416216 (275h55m48.369513526s) [upload=287147]: Starting upload Aug 20 05:21:26.410495709 (275h55m48.369592957s) [upload=287147]: Done starting upload Aug 20 05:21:26.410647440 (275h55m48.369744699s) [upload=287147]: Uploading segments... Aug 20 05:21:26.411333004 (275h55m48.370430239s) [upload=287147]: Got next segment. Inline: false Aug 20 05:21:26.411607782 (275h55m48.37070503s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:21:26.411620840 (275h55m48.370718097s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:21:26.502418742 (275h55m48.461515988s) [upload=287147]: Next segment err: metaclient: Too Many Requests Aug 20 05:21:26.502462059 (275h55m48.461559376s) [upload=287147]: Done uploading segments... Aug 20 05:21:26.502503548 (275h55m48.461600789s) [upload=287147]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.324572235s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X..............................X...........X....] duration:
846.289409ms
FAIL (2025-08-20 05:30:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 20 05:27:03.815870434 (276h1m25.774967685s) [upload=287249]: Starting upload
Aug 20 05:27:03.815968066 (276h1m25.775065324s) [upload=287249]: Done starting upload
Aug 20 05:27:03.816108189 (276h1m25.775205443s) [upload=287249]: Uploading segments...
Aug 20 05:27:03.816195280 (276h1m25.77529254s) [upload=287249]: Got next segment. Inline: true
Aug 20 05:27:03.816204703 (276h1m25.775301969s) [upload=287249]: Waiting for error group managing segments...
Aug 20 05:27:03.816281862 (276h1m25.775379116s) [upload=287249]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 05:27:03.816289721 (276h1m25.775386977s) [upload=287249]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 05:27:03.816293768 (276h1m25.77539102s) [upload=287249]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 05:27:03.969142218 (276h1m25.928239464s) [upload=287249]: Done uploading segments...
Aug 20 05:27:03.969173184 (276h1m25.928270429s) [upload=287249]: Upload finished. err: <nil>
Duration: 846.338265ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................X.....X.............] duration:
2.669783672s
FAIL (2025-08-20 05:30:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:21:26.410416216 (275h55m48.369513526s) [upload=287147]: Starting upload Aug 20 05:21:26.410495709 (275h55m48.369592957s) [upload=287147]: Done starting upload Aug 20 05:21:26.410647440 (275h55m48.369744699s) [upload=287147]: Uploading segments... Aug 20 05:21:26.411333004 (275h55m48.370430239s) [upload=287147]: Got next segment. Inline: false Aug 20 05:21:26.411607782 (275h55m48.37070503s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:21:26.411620840 (275h55m48.370718097s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:21:26.502418742 (275h55m48.461515988s) [upload=287147]: Next segment err: metaclient: Too Many Requests Aug 20 05:21:26.502462059 (275h55m48.461559376s) [upload=287147]: Done uploading segments... Aug 20 05:21:26.502503548 (275h55m48.461600789s) [upload=287147]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.669845697s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X..............................X...........X...] duration:
956.027802ms
FAIL (2025-08-20 05:29:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 20 05:27:03.815870434 (276h1m25.774967685s) [upload=287249]: Starting upload
Aug 20 05:27:03.815968066 (276h1m25.775065324s) [upload=287249]: Done starting upload
Aug 20 05:27:03.816108189 (276h1m25.775205443s) [upload=287249]: Uploading segments...
Aug 20 05:27:03.816195280 (276h1m25.77529254s) [upload=287249]: Got next segment. Inline: true
Aug 20 05:27:03.816204703 (276h1m25.775301969s) [upload=287249]: Waiting for error group managing segments...
Aug 20 05:27:03.816281862 (276h1m25.775379116s) [upload=287249]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 05:27:03.816289721 (276h1m25.775386977s) [upload=287249]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 05:27:03.816293768 (276h1m25.77539102s) [upload=287249]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 05:27:03.969142218 (276h1m25.928239464s) [upload=287249]: Done uploading segments...
Aug 20 05:27:03.969173184 (276h1m25.928270429s) [upload=287249]: Upload finished. err: <nil>
Duration: 956.061686ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X.....X............] duration:
2.341297249s
FAIL (2025-08-20 05:29:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:21:26.410416216 (275h55m48.369513526s) [upload=287147]: Starting upload Aug 20 05:21:26.410495709 (275h55m48.369592957s) [upload=287147]: Done starting upload Aug 20 05:21:26.410647440 (275h55m48.369744699s) [upload=287147]: Uploading segments... Aug 20 05:21:26.411333004 (275h55m48.370430239s) [upload=287147]: Got next segment. Inline: false Aug 20 05:21:26.411607782 (275h55m48.37070503s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:21:26.411620840 (275h55m48.370718097s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:21:26.502418742 (275h55m48.461515988s) [upload=287147]: Next segment err: metaclient: Too Many Requests Aug 20 05:21:26.502462059 (275h55m48.461559376s) [upload=287147]: Done uploading segments... Aug 20 05:21:26.502503548 (275h55m48.461600789s) [upload=287147]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.34132689s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X.............X..............................X...........X..] duration:
949.884294ms
FAIL (2025-08-20 05:29:06 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 20 05:27:03.815870434 (276h1m25.774967685s) [upload=287249]: Starting upload
Aug 20 05:27:03.815968066 (276h1m25.775065324s) [upload=287249]: Done starting upload
Aug 20 05:27:03.816108189 (276h1m25.775205443s) [upload=287249]: Uploading segments...
Aug 20 05:27:03.816195280 (276h1m25.77529254s) [upload=287249]: Got next segment. Inline: true
Aug 20 05:27:03.816204703 (276h1m25.775301969s) [upload=287249]: Waiting for error group managing segments...
Aug 20 05:27:03.816281862 (276h1m25.775379116s) [upload=287249]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 05:27:03.816289721 (276h1m25.775386977s) [upload=287249]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 05:27:03.816293768 (276h1m25.77539102s) [upload=287249]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 05:27:03.969142218 (276h1m25.928239464s) [upload=287249]: Done uploading segments...
Aug 20 05:27:03.969173184 (276h1m25.928270429s) [upload=287249]: Upload finished. err: <nil>
Duration: 949.942927ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X.....X...........] duration:
2.2638079s
FAIL (2025-08-20 05:28:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:21:26.410416216 (275h55m48.369513526s) [upload=287147]: Starting upload Aug 20 05:21:26.410495709 (275h55m48.369592957s) [upload=287147]: Done starting upload Aug 20 05:21:26.410647440 (275h55m48.369744699s) [upload=287147]: Uploading segments... Aug 20 05:21:26.411333004 (275h55m48.370430239s) [upload=287147]: Got next segment. Inline: false Aug 20 05:21:26.411607782 (275h55m48.37070503s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:21:26.411620840 (275h55m48.370718097s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:21:26.502418742 (275h55m48.461515988s) [upload=287147]: Next segment err: metaclient: Too Many Requests Aug 20 05:21:26.502462059 (275h55m48.461559376s) [upload=287147]: Done uploading segments... Aug 20 05:21:26.502503548 (275h55m48.461600789s) [upload=287147]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.263855996s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X.............X..............................X...........X.] duration:
841.32224ms
FAIL (2025-08-20 05:27:51 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 20 05:27:03.815870434 (276h1m25.774967685s) [upload=287249]: Starting upload
Aug 20 05:27:03.815968066 (276h1m25.775065324s) [upload=287249]: Done starting upload
Aug 20 05:27:03.816108189 (276h1m25.775205443s) [upload=287249]: Uploading segments...
Aug 20 05:27:03.816195280 (276h1m25.77529254s) [upload=287249]: Got next segment. Inline: true
Aug 20 05:27:03.816204703 (276h1m25.775301969s) [upload=287249]: Waiting for error group managing segments...
Aug 20 05:27:03.816281862 (276h1m25.775379116s) [upload=287249]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 05:27:03.816289721 (276h1m25.775386977s) [upload=287249]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 05:27:03.816293768 (276h1m25.77539102s) [upload=287249]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 05:27:03.969142218 (276h1m25.928239464s) [upload=287249]: Done uploading segments...
Aug 20 05:27:03.969173184 (276h1m25.928270429s) [upload=287249]: Upload finished. err: <nil>
Duration: 841.382986ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X.....X..........] duration:
2.31515516s
FAIL (2025-08-20 05:27:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:21:26.410416216 (275h55m48.369513526s) [upload=287147]: Starting upload Aug 20 05:21:26.410495709 (275h55m48.369592957s) [upload=287147]: Done starting upload Aug 20 05:21:26.410647440 (275h55m48.369744699s) [upload=287147]: Uploading segments... Aug 20 05:21:26.411333004 (275h55m48.370430239s) [upload=287147]: Got next segment. Inline: false Aug 20 05:21:26.411607782 (275h55m48.37070503s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:21:26.411620840 (275h55m48.370718097s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:21:26.502418742 (275h55m48.461515988s) [upload=287147]: Next segment err: metaclient: Too Many Requests Aug 20 05:21:26.502462059 (275h55m48.461559376s) [upload=287147]: Done uploading segments... Aug 20 05:21:26.502503548 (275h55m48.461600789s) [upload=287147]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.315184276s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X.............X..............................X...........X] duration:
719.602108ms
FAIL (2025-08-20 05:27:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 20 05:27:03.815870434 (276h1m25.774967685s) [upload=287249]: Starting upload
Aug 20 05:27:03.815968066 (276h1m25.775065324s) [upload=287249]: Done starting upload
Aug 20 05:27:03.816108189 (276h1m25.775205443s) [upload=287249]: Uploading segments...
Aug 20 05:27:03.816195280 (276h1m25.77529254s) [upload=287249]: Got next segment. Inline: true
Aug 20 05:27:03.816204703 (276h1m25.775301969s) [upload=287249]: Waiting for error group managing segments...
Aug 20 05:27:03.816281862 (276h1m25.775379116s) [upload=287249]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 05:27:03.816289721 (276h1m25.775386977s) [upload=287249]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 20 05:27:03.816293768 (276h1m25.77539102s) [upload=287249]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 05:27:03.969142218 (276h1m25.928239464s) [upload=287249]: Done uploading segments...
Aug 20 05:27:03.969173184 (276h1m25.928270429s) [upload=287249]: Upload finished. err: <nil>
Duration: 719.637583ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X.............X..............................X...........] duration:
811.197262ms
FAIL (2025-08-20 05:26:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:17:28.472976961 (275h51m50.432074209s) [upload=287080]: Starting upload Aug 20 05:17:28.473062481 (275h51m50.432159796s) [upload=287080]: Done starting upload Aug 20 05:17:28.473209503 (275h51m50.432306738s) [upload=287080]: Uploading segments... Aug 20 05:17:28.473317938 (275h51m50.432415173s) [upload=287080]: Got next segment. Inline: true Aug 20 05:17:28.473326272 (275h51m50.432423529s) [upload=287080]: Waiting for error group managing segments... Aug 20 05:17:28.473402774 (275h51m50.432500023s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:17:28.473410441 (275h51m50.432507686s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 05:17:28.473414029 (275h51m50.432511275s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 05:17:28.561766586 (275h51m50.520863831s) [upload=287080]: Done uploading segments... Aug 20 05:17:28.561786905 (275h51m50.52088415s) [upload=287080]: Upload finished. err: metaclient: Too Many Requests
Duration: 811.229595ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................................X.....X.........] duration:
2.357137911s
FAIL (2025-08-20 05:26:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:21:26.410416216 (275h55m48.369513526s) [upload=287147]: Starting upload Aug 20 05:21:26.410495709 (275h55m48.369592957s) [upload=287147]: Done starting upload Aug 20 05:21:26.410647440 (275h55m48.369744699s) [upload=287147]: Uploading segments... Aug 20 05:21:26.411333004 (275h55m48.370430239s) [upload=287147]: Got next segment. Inline: false Aug 20 05:21:26.411607782 (275h55m48.37070503s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:21:26.411620840 (275h55m48.370718097s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:21:26.502418742 (275h55m48.461515988s) [upload=287147]: Next segment err: metaclient: Too Many Requests Aug 20 05:21:26.502462059 (275h55m48.461559376s) [upload=287147]: Done uploading segments... Aug 20 05:21:26.502503548 (275h55m48.461600789s) [upload=287147]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.357174408s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X.....X........] duration:
2.363917563s
FAIL (2025-08-20 05:25:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:21:26.410416216 (275h55m48.369513526s) [upload=287147]: Starting upload Aug 20 05:21:26.410495709 (275h55m48.369592957s) [upload=287147]: Done starting upload Aug 20 05:21:26.410647440 (275h55m48.369744699s) [upload=287147]: Uploading segments... Aug 20 05:21:26.411333004 (275h55m48.370430239s) [upload=287147]: Got next segment. Inline: false Aug 20 05:21:26.411607782 (275h55m48.37070503s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:21:26.411620840 (275h55m48.370718097s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:21:26.502418742 (275h55m48.461515988s) [upload=287147]: Next segment err: metaclient: Too Many Requests Aug 20 05:21:26.502462059 (275h55m48.461559376s) [upload=287147]: Done uploading segments... Aug 20 05:21:26.502503548 (275h55m48.461600789s) [upload=287147]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.363950543s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X.....X.......] duration:
2.361322961s
FAIL (2025-08-20 05:25:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:21:26.410416216 (275h55m48.369513526s) [upload=287147]: Starting upload Aug 20 05:21:26.410495709 (275h55m48.369592957s) [upload=287147]: Done starting upload Aug 20 05:21:26.410647440 (275h55m48.369744699s) [upload=287147]: Uploading segments... Aug 20 05:21:26.411333004 (275h55m48.370430239s) [upload=287147]: Got next segment. Inline: false Aug 20 05:21:26.411607782 (275h55m48.37070503s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:21:26.411620840 (275h55m48.370718097s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:21:26.502418742 (275h55m48.461515988s) [upload=287147]: Next segment err: metaclient: Too Many Requests Aug 20 05:21:26.502462059 (275h55m48.461559376s) [upload=287147]: Done uploading segments... Aug 20 05:21:26.502503548 (275h55m48.461600789s) [upload=287147]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.361369724s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X.............X..............................X..........] duration:
849.774099ms
FAIL (2025-08-20 05:25:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:17:28.472976961 (275h51m50.432074209s) [upload=287080]: Starting upload Aug 20 05:17:28.473062481 (275h51m50.432159796s) [upload=287080]: Done starting upload Aug 20 05:17:28.473209503 (275h51m50.432306738s) [upload=287080]: Uploading segments... Aug 20 05:17:28.473317938 (275h51m50.432415173s) [upload=287080]: Got next segment. Inline: true Aug 20 05:17:28.473326272 (275h51m50.432423529s) [upload=287080]: Waiting for error group managing segments... Aug 20 05:17:28.473402774 (275h51m50.432500023s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:17:28.473410441 (275h51m50.432507686s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 05:17:28.473414029 (275h51m50.432511275s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 05:17:28.561766586 (275h51m50.520863831s) [upload=287080]: Done uploading segments... Aug 20 05:17:28.561786905 (275h51m50.52088415s) [upload=287080]: Upload finished. err: metaclient: Too Many Requests
Duration: 849.822506ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X.....X......] duration:
2.342334736s
FAIL (2025-08-20 05:25:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:21:26.410416216 (275h55m48.369513526s) [upload=287147]: Starting upload Aug 20 05:21:26.410495709 (275h55m48.369592957s) [upload=287147]: Done starting upload Aug 20 05:21:26.410647440 (275h55m48.369744699s) [upload=287147]: Uploading segments... Aug 20 05:21:26.411333004 (275h55m48.370430239s) [upload=287147]: Got next segment. Inline: false Aug 20 05:21:26.411607782 (275h55m48.37070503s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:21:26.411620840 (275h55m48.370718097s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:21:26.502418742 (275h55m48.461515988s) [upload=287147]: Next segment err: metaclient: Too Many Requests Aug 20 05:21:26.502462059 (275h55m48.461559376s) [upload=287147]: Done uploading segments... Aug 20 05:21:26.502503548 (275h55m48.461600789s) [upload=287147]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.342371769s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................................X.....X.....] duration:
2.454961546s
FAIL (2025-08-20 05:24:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:21:26.410416216 (275h55m48.369513526s) [upload=287147]: Starting upload Aug 20 05:21:26.410495709 (275h55m48.369592957s) [upload=287147]: Done starting upload Aug 20 05:21:26.410647440 (275h55m48.369744699s) [upload=287147]: Uploading segments... Aug 20 05:21:26.411333004 (275h55m48.370430239s) [upload=287147]: Got next segment. Inline: false Aug 20 05:21:26.411607782 (275h55m48.37070503s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:21:26.411620840 (275h55m48.370718097s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:21:26.502418742 (275h55m48.461515988s) [upload=287147]: Next segment err: metaclient: Too Many Requests Aug 20 05:21:26.502462059 (275h55m48.461559376s) [upload=287147]: Done uploading segments... Aug 20 05:21:26.502503548 (275h55m48.461600789s) [upload=287147]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.45498874s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X.....X....] duration:
2.279394637s
FAIL (2025-08-20 05:24:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:21:26.410416216 (275h55m48.369513526s) [upload=287147]: Starting upload Aug 20 05:21:26.410495709 (275h55m48.369592957s) [upload=287147]: Done starting upload Aug 20 05:21:26.410647440 (275h55m48.369744699s) [upload=287147]: Uploading segments... Aug 20 05:21:26.411333004 (275h55m48.370430239s) [upload=287147]: Got next segment. Inline: false Aug 20 05:21:26.411607782 (275h55m48.37070503s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:21:26.411620840 (275h55m48.370718097s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:21:26.502418742 (275h55m48.461515988s) [upload=287147]: Next segment err: metaclient: Too Many Requests Aug 20 05:21:26.502462059 (275h55m48.461559376s) [upload=287147]: Done uploading segments... Aug 20 05:21:26.502503548 (275h55m48.461600789s) [upload=287147]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.279430737s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X.............X..............................X.........] duration:
815.031213ms
FAIL (2025-08-20 05:24:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:17:28.472976961 (275h51m50.432074209s) [upload=287080]: Starting upload Aug 20 05:17:28.473062481 (275h51m50.432159796s) [upload=287080]: Done starting upload Aug 20 05:17:28.473209503 (275h51m50.432306738s) [upload=287080]: Uploading segments... Aug 20 05:17:28.473317938 (275h51m50.432415173s) [upload=287080]: Got next segment. Inline: true Aug 20 05:17:28.473326272 (275h51m50.432423529s) [upload=287080]: Waiting for error group managing segments... Aug 20 05:17:28.473402774 (275h51m50.432500023s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:17:28.473410441 (275h51m50.432507686s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 05:17:28.473414029 (275h51m50.432511275s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 05:17:28.561766586 (275h51m50.520863831s) [upload=287080]: Done uploading segments... Aug 20 05:17:28.561786905 (275h51m50.52088415s) [upload=287080]: Upload finished. err: metaclient: Too Many Requests
Duration: 815.064446ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X.............X..............................X........] duration:
929.60768ms
FAIL (2025-08-20 05:23:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:17:28.472976961 (275h51m50.432074209s) [upload=287080]: Starting upload Aug 20 05:17:28.473062481 (275h51m50.432159796s) [upload=287080]: Done starting upload Aug 20 05:17:28.473209503 (275h51m50.432306738s) [upload=287080]: Uploading segments... Aug 20 05:17:28.473317938 (275h51m50.432415173s) [upload=287080]: Got next segment. Inline: true Aug 20 05:17:28.473326272 (275h51m50.432423529s) [upload=287080]: Waiting for error group managing segments... Aug 20 05:17:28.473402774 (275h51m50.432500023s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:17:28.473410441 (275h51m50.432507686s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 05:17:28.473414029 (275h51m50.432511275s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 05:17:28.561766586 (275h51m50.520863831s) [upload=287080]: Done uploading segments... Aug 20 05:17:28.561786905 (275h51m50.52088415s) [upload=287080]: Upload finished. err: metaclient: Too Many Requests
Duration: 929.634801ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X.....X...] duration:
2.270039708s
FAIL (2025-08-20 05:23:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:21:26.410416216 (275h55m48.369513526s) [upload=287147]: Starting upload Aug 20 05:21:26.410495709 (275h55m48.369592957s) [upload=287147]: Done starting upload Aug 20 05:21:26.410647440 (275h55m48.369744699s) [upload=287147]: Uploading segments... Aug 20 05:21:26.411333004 (275h55m48.370430239s) [upload=287147]: Got next segment. Inline: false Aug 20 05:21:26.411607782 (275h55m48.37070503s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:21:26.411620840 (275h55m48.370718097s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:21:26.502418742 (275h55m48.461515988s) [upload=287147]: Next segment err: metaclient: Too Many Requests Aug 20 05:21:26.502462059 (275h55m48.461559376s) [upload=287147]: Done uploading segments... Aug 20 05:21:26.502503548 (275h55m48.461600789s) [upload=287147]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.270072124s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.............X..............................X.......] duration:
904.513297ms
FAIL (2025-08-20 05:22:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:17:28.472976961 (275h51m50.432074209s) [upload=287080]: Starting upload Aug 20 05:17:28.473062481 (275h51m50.432159796s) [upload=287080]: Done starting upload Aug 20 05:17:28.473209503 (275h51m50.432306738s) [upload=287080]: Uploading segments... Aug 20 05:17:28.473317938 (275h51m50.432415173s) [upload=287080]: Got next segment. Inline: true Aug 20 05:17:28.473326272 (275h51m50.432423529s) [upload=287080]: Waiting for error group managing segments... Aug 20 05:17:28.473402774 (275h51m50.432500023s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:17:28.473410441 (275h51m50.432507686s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 05:17:28.473414029 (275h51m50.432511275s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 05:17:28.561766586 (275h51m50.520863831s) [upload=287080]: Done uploading segments... Aug 20 05:17:28.561786905 (275h51m50.52088415s) [upload=287080]: Upload finished. err: metaclient: Too Many Requests
Duration: 904.540728ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................................X.....X..] duration:
2.350913965s
FAIL (2025-08-20 05:22:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:21:26.410416216 (275h55m48.369513526s) [upload=287147]: Starting upload Aug 20 05:21:26.410495709 (275h55m48.369592957s) [upload=287147]: Done starting upload Aug 20 05:21:26.410647440 (275h55m48.369744699s) [upload=287147]: Uploading segments... Aug 20 05:21:26.411333004 (275h55m48.370430239s) [upload=287147]: Got next segment. Inline: false Aug 20 05:21:26.411607782 (275h55m48.37070503s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:21:26.411620840 (275h55m48.370718097s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:21:26.502418742 (275h55m48.461515988s) [upload=287147]: Next segment err: metaclient: Too Many Requests Aug 20 05:21:26.502462059 (275h55m48.461559376s) [upload=287147]: Done uploading segments... Aug 20 05:21:26.502503548 (275h55m48.461600789s) [upload=287147]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.350968928s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X...................................................X.....X.] duration:
2.46381283s
FAIL (2025-08-20 05:22:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:21:26.410416216 (275h55m48.369513526s) [upload=287147]: Starting upload Aug 20 05:21:26.410495709 (275h55m48.369592957s) [upload=287147]: Done starting upload Aug 20 05:21:26.410647440 (275h55m48.369744699s) [upload=287147]: Uploading segments... Aug 20 05:21:26.411333004 (275h55m48.370430239s) [upload=287147]: Got next segment. Inline: false Aug 20 05:21:26.411607782 (275h55m48.37070503s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:21:26.411620840 (275h55m48.370718097s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:21:26.502418742 (275h55m48.461515988s) [upload=287147]: Next segment err: metaclient: Too Many Requests Aug 20 05:21:26.502462059 (275h55m48.461559376s) [upload=287147]: Done uploading segments... Aug 20 05:21:26.502503548 (275h55m48.461600789s) [upload=287147]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.463952857s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X.............X..............................X......] duration:
833.964457ms
FAIL (2025-08-20 05:21:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:17:28.472976961 (275h51m50.432074209s) [upload=287080]: Starting upload Aug 20 05:17:28.473062481 (275h51m50.432159796s) [upload=287080]: Done starting upload Aug 20 05:17:28.473209503 (275h51m50.432306738s) [upload=287080]: Uploading segments... Aug 20 05:17:28.473317938 (275h51m50.432415173s) [upload=287080]: Got next segment. Inline: true Aug 20 05:17:28.473326272 (275h51m50.432423529s) [upload=287080]: Waiting for error group managing segments... Aug 20 05:17:28.473402774 (275h51m50.432500023s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:17:28.473410441 (275h51m50.432507686s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 05:17:28.473414029 (275h51m50.432511275s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 05:17:28.561766586 (275h51m50.520863831s) [upload=287080]: Done uploading segments... Aug 20 05:17:28.561786905 (275h51m50.52088415s) [upload=287080]: Upload finished. err: metaclient: Too Many Requests
Duration: 833.989663ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X.............X..............................X.....] duration:
846.285272ms
FAIL (2025-08-20 05:21:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:17:28.472976961 (275h51m50.432074209s) [upload=287080]: Starting upload Aug 20 05:17:28.473062481 (275h51m50.432159796s) [upload=287080]: Done starting upload Aug 20 05:17:28.473209503 (275h51m50.432306738s) [upload=287080]: Uploading segments... Aug 20 05:17:28.473317938 (275h51m50.432415173s) [upload=287080]: Got next segment. Inline: true Aug 20 05:17:28.473326272 (275h51m50.432423529s) [upload=287080]: Waiting for error group managing segments... Aug 20 05:17:28.473402774 (275h51m50.432500023s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:17:28.473410441 (275h51m50.432507686s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 05:17:28.473414029 (275h51m50.432511275s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 05:17:28.561766586 (275h51m50.520863831s) [upload=287080]: Done uploading segments... Aug 20 05:17:28.561786905 (275h51m50.52088415s) [upload=287080]: Upload finished. err: metaclient: Too Many Requests
Duration: 846.381109ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X...................................................X.....X] duration:
360.535895ms
FAIL (2025-08-20 05:21:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:21:26.410416216 (275h55m48.369513526s) [upload=287147]: Starting upload Aug 20 05:21:26.410495709 (275h55m48.369592957s) [upload=287147]: Done starting upload Aug 20 05:21:26.410647440 (275h55m48.369744699s) [upload=287147]: Uploading segments... Aug 20 05:21:26.411333004 (275h55m48.370430239s) [upload=287147]: Got next segment. Inline: false Aug 20 05:21:26.411607782 (275h55m48.37070503s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:21:26.411620840 (275h55m48.370718097s) [upload=287147]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:21:26.502418742 (275h55m48.461515988s) [upload=287147]: Next segment err: metaclient: Too Many Requests Aug 20 05:21:26.502462059 (275h55m48.461559376s) [upload=287147]: Done uploading segments... Aug 20 05:21:26.502503548 (275h55m48.461600789s) [upload=287147]: Upload finished. err: metaclient: Too Many Requests
Duration: 360.576941ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X...................................................X.....] duration:
2.315816685s
FAIL (2025-08-20 05:20:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:16:34.846056550 (275h50m56.805153796s) [upload=287066]: Starting upload Aug 20 05:16:34.846119554 (275h50m56.805216799s) [upload=287066]: Done starting upload Aug 20 05:16:34.846202518 (275h50m56.805299764s) [upload=287066]: Uploading segments... Aug 20 05:16:34.846497101 (275h50m56.805594336s) [upload=287066]: Got next segment. Inline: false Aug 20 05:16:34.846569308 (275h50m56.805666554s) [upload=287066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:16:34.846574729 (275h50m56.805671975s) [upload=287066]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:16:34.936151872 (275h50m56.895249124s) [upload=287066]: Next segment err: metaclient: Too Many Requests Aug 20 05:16:34.936196957 (275h50m56.895294203s) [upload=287066]: Done uploading segments... Aug 20 05:16:34.936215046 (275h50m56.895312284s) [upload=287066]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.315863413s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X.............X..............................X....] duration:
817.123613ms
FAIL (2025-08-20 05:20:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:17:28.472976961 (275h51m50.432074209s) [upload=287080]: Starting upload Aug 20 05:17:28.473062481 (275h51m50.432159796s) [upload=287080]: Done starting upload Aug 20 05:17:28.473209503 (275h51m50.432306738s) [upload=287080]: Uploading segments... Aug 20 05:17:28.473317938 (275h51m50.432415173s) [upload=287080]: Got next segment. Inline: true Aug 20 05:17:28.473326272 (275h51m50.432423529s) [upload=287080]: Waiting for error group managing segments... Aug 20 05:17:28.473402774 (275h51m50.432500023s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:17:28.473410441 (275h51m50.432507686s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 05:17:28.473414029 (275h51m50.432511275s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 05:17:28.561766586 (275h51m50.520863831s) [upload=287080]: Done uploading segments... Aug 20 05:17:28.561786905 (275h51m50.52088415s) [upload=287080]: Upload finished. err: metaclient: Too Many Requests
Duration: 817.162744ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X...................................................X....] duration:
2.384402208s
FAIL (2025-08-20 05:20:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:16:34.846056550 (275h50m56.805153796s) [upload=287066]: Starting upload Aug 20 05:16:34.846119554 (275h50m56.805216799s) [upload=287066]: Done starting upload Aug 20 05:16:34.846202518 (275h50m56.805299764s) [upload=287066]: Uploading segments... Aug 20 05:16:34.846497101 (275h50m56.805594336s) [upload=287066]: Got next segment. Inline: false Aug 20 05:16:34.846569308 (275h50m56.805666554s) [upload=287066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:16:34.846574729 (275h50m56.805671975s) [upload=287066]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:16:34.936151872 (275h50m56.895249124s) [upload=287066]: Next segment err: metaclient: Too Many Requests Aug 20 05:16:34.936196957 (275h50m56.895294203s) [upload=287066]: Done uploading segments... Aug 20 05:16:34.936215046 (275h50m56.895312284s) [upload=287066]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.384461786s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X.............X..............................X...] duration:
833.08402ms
FAIL (2025-08-20 05:19:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:17:28.472976961 (275h51m50.432074209s) [upload=287080]: Starting upload Aug 20 05:17:28.473062481 (275h51m50.432159796s) [upload=287080]: Done starting upload Aug 20 05:17:28.473209503 (275h51m50.432306738s) [upload=287080]: Uploading segments... Aug 20 05:17:28.473317938 (275h51m50.432415173s) [upload=287080]: Got next segment. Inline: true Aug 20 05:17:28.473326272 (275h51m50.432423529s) [upload=287080]: Waiting for error group managing segments... Aug 20 05:17:28.473402774 (275h51m50.432500023s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:17:28.473410441 (275h51m50.432507686s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 05:17:28.473414029 (275h51m50.432511275s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 05:17:28.561766586 (275h51m50.520863831s) [upload=287080]: Done uploading segments... Aug 20 05:17:28.561786905 (275h51m50.52088415s) [upload=287080]: Upload finished. err: metaclient: Too Many Requests
Duration: 833.169745ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X...................................................X...] duration:
2.342303439s
FAIL (2025-08-20 05:19:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:16:34.846056550 (275h50m56.805153796s) [upload=287066]: Starting upload Aug 20 05:16:34.846119554 (275h50m56.805216799s) [upload=287066]: Done starting upload Aug 20 05:16:34.846202518 (275h50m56.805299764s) [upload=287066]: Uploading segments... Aug 20 05:16:34.846497101 (275h50m56.805594336s) [upload=287066]: Got next segment. Inline: false Aug 20 05:16:34.846569308 (275h50m56.805666554s) [upload=287066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:16:34.846574729 (275h50m56.805671975s) [upload=287066]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:16:34.936151872 (275h50m56.895249124s) [upload=287066]: Next segment err: metaclient: Too Many Requests Aug 20 05:16:34.936196957 (275h50m56.895294203s) [upload=287066]: Done uploading segments... Aug 20 05:16:34.936215046 (275h50m56.895312284s) [upload=287066]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.342340725s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X.............X..............................X..] duration:
975.926595ms
FAIL (2025-08-20 05:18:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:17:28.472976961 (275h51m50.432074209s) [upload=287080]: Starting upload Aug 20 05:17:28.473062481 (275h51m50.432159796s) [upload=287080]: Done starting upload Aug 20 05:17:28.473209503 (275h51m50.432306738s) [upload=287080]: Uploading segments... Aug 20 05:17:28.473317938 (275h51m50.432415173s) [upload=287080]: Got next segment. Inline: true Aug 20 05:17:28.473326272 (275h51m50.432423529s) [upload=287080]: Waiting for error group managing segments... Aug 20 05:17:28.473402774 (275h51m50.432500023s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:17:28.473410441 (275h51m50.432507686s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 05:17:28.473414029 (275h51m50.432511275s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 05:17:28.561766586 (275h51m50.520863831s) [upload=287080]: Done uploading segments... Aug 20 05:17:28.561786905 (275h51m50.52088415s) [upload=287080]: Upload finished. err: metaclient: Too Many Requests
Duration: 975.957705ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X...................................................X..] duration:
2.465176897s
FAIL (2025-08-20 05:18:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:16:34.846056550 (275h50m56.805153796s) [upload=287066]: Starting upload Aug 20 05:16:34.846119554 (275h50m56.805216799s) [upload=287066]: Done starting upload Aug 20 05:16:34.846202518 (275h50m56.805299764s) [upload=287066]: Uploading segments... Aug 20 05:16:34.846497101 (275h50m56.805594336s) [upload=287066]: Got next segment. Inline: false Aug 20 05:16:34.846569308 (275h50m56.805666554s) [upload=287066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:16:34.846574729 (275h50m56.805671975s) [upload=287066]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:16:34.936151872 (275h50m56.895249124s) [upload=287066]: Next segment err: metaclient: Too Many Requests Aug 20 05:16:34.936196957 (275h50m56.895294203s) [upload=287066]: Done uploading segments... Aug 20 05:16:34.936215046 (275h50m56.895312284s) [upload=287066]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.465214887s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X.............X..............................X.] duration:
1.071503423s
FAIL (2025-08-20 05:17:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:17:28.472976961 (275h51m50.432074209s) [upload=287080]: Starting upload Aug 20 05:17:28.473062481 (275h51m50.432159796s) [upload=287080]: Done starting upload Aug 20 05:17:28.473209503 (275h51m50.432306738s) [upload=287080]: Uploading segments... Aug 20 05:17:28.473317938 (275h51m50.432415173s) [upload=287080]: Got next segment. Inline: true Aug 20 05:17:28.473326272 (275h51m50.432423529s) [upload=287080]: Waiting for error group managing segments... Aug 20 05:17:28.473402774 (275h51m50.432500023s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:17:28.473410441 (275h51m50.432507686s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 05:17:28.473414029 (275h51m50.432511275s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 05:17:28.561766586 (275h51m50.520863831s) [upload=287080]: Done uploading segments... Aug 20 05:17:28.561786905 (275h51m50.52088415s) [upload=287080]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.07152993s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X...................................................X.] duration:
2.298023202s
FAIL (2025-08-20 05:17:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:16:34.846056550 (275h50m56.805153796s) [upload=287066]: Starting upload Aug 20 05:16:34.846119554 (275h50m56.805216799s) [upload=287066]: Done starting upload Aug 20 05:16:34.846202518 (275h50m56.805299764s) [upload=287066]: Uploading segments... Aug 20 05:16:34.846497101 (275h50m56.805594336s) [upload=287066]: Got next segment. Inline: false Aug 20 05:16:34.846569308 (275h50m56.805666554s) [upload=287066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:16:34.846574729 (275h50m56.805671975s) [upload=287066]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:16:34.936151872 (275h50m56.895249124s) [upload=287066]: Next segment err: metaclient: Too Many Requests Aug 20 05:16:34.936196957 (275h50m56.895294203s) [upload=287066]: Done uploading segments... Aug 20 05:16:34.936215046 (275h50m56.895312284s) [upload=287066]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.29818245s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X.............X..............................X] duration:
361.283765ms
FAIL (2025-08-20 05:17:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:17:28.472976961 (275h51m50.432074209s) [upload=287080]: Starting upload Aug 20 05:17:28.473062481 (275h51m50.432159796s) [upload=287080]: Done starting upload Aug 20 05:17:28.473209503 (275h51m50.432306738s) [upload=287080]: Uploading segments... Aug 20 05:17:28.473317938 (275h51m50.432415173s) [upload=287080]: Got next segment. Inline: true Aug 20 05:17:28.473326272 (275h51m50.432423529s) [upload=287080]: Waiting for error group managing segments... Aug 20 05:17:28.473402774 (275h51m50.432500023s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:17:28.473410441 (275h51m50.432507686s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 05:17:28.473414029 (275h51m50.432511275s) [upload=287080]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 05:17:28.561766586 (275h51m50.520863831s) [upload=287080]: Done uploading segments... Aug 20 05:17:28.561786905 (275h51m50.52088415s) [upload=287080]: Upload finished. err: metaclient: Too Many Requests
Duration: 361.306199ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X...................................................X] duration:
363.991833ms
FAIL (2025-08-20 05:16:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 05:16:34.846056550 (275h50m56.805153796s) [upload=287066]: Starting upload Aug 20 05:16:34.846119554 (275h50m56.805216799s) [upload=287066]: Done starting upload Aug 20 05:16:34.846202518 (275h50m56.805299764s) [upload=287066]: Uploading segments... Aug 20 05:16:34.846497101 (275h50m56.805594336s) [upload=287066]: Got next segment. Inline: false Aug 20 05:16:34.846569308 (275h50m56.805666554s) [upload=287066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 05:16:34.846574729 (275h50m56.805671975s) [upload=287066]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 05:16:34.936151872 (275h50m56.895249124s) [upload=287066]: Next segment err: metaclient: Too Many Requests Aug 20 05:16:34.936196957 (275h50m56.895294203s) [upload=287066]: Done uploading segments... Aug 20 05:16:34.936215046 (275h50m56.895312284s) [upload=287066]: Upload finished. err: metaclient: Too Many Requests
Duration: 364.016319ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X.............X..............................] duration:
804.109203ms
FAIL (2025-08-20 05:16:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 804.141381ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.344482736s
FAIL (2025-08-20 05:16:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.344517011s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X.............X.............................] duration:
952.32024ms
FAIL (2025-08-20 05:15:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 952.354586ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.283809879s
FAIL (2025-08-20 05:15:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.283841147s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X.............X............................] duration:
963.673886ms
FAIL (2025-08-20 05:14:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 963.722125ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.32127375s
FAIL (2025-08-20 05:14:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.321318573s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X.............X...........................] duration:
1.120276285s
FAIL (2025-08-20 05:14:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.120308653s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.384138124s
FAIL (2025-08-20 05:13:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.384187673s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X.............X..........................] duration:
830.511838ms
FAIL (2025-08-20 05:13:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 04:52:43.358342203 (275h27m5.317439433s) [upload=286666]: Starting upload Aug 20 04:52:43.358395430 (275h27m5.317492676s) [upload=286666]: Done starting upload Aug 20 04:52:43.358490895 (275h27m5.317588126s) [upload=286666]: Uploading segments... Aug 20 04:52:43.358543575 (275h27m5.317640827s) [upload=286666]: Got next segment. Inline: true Aug 20 04:52:43.358561627 (275h27m5.317658871s) [upload=286666]: Waiting for error group managing segments... Aug 20 04:52:43.358603753 (275h27m5.317701s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 04:52:43.358608698 (275h27m5.317705943s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 04:52:43.358612283 (275h27m5.317709527s) [upload=286666]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 04:52:43.445864346 (275h27m5.404961596s) [upload=286666]: Done uploading segments... Aug 20 04:52:43.445935693 (275h27m5.405032948s) [upload=286666]: Upload finished. err: metaclient: Too Many Requests
Duration: 830.543899ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.614247676s
FAIL (2025-08-20 05:12:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5c19860fdb5e6681a31c36c185e61c1731260584148e96c9f6e2076a3fa3153f != before a28f139f587e76c7b1f8025a8e097ed16ffca28b2ee4ee873b7eb6dc5b40ed09
======LOGS======
Aug 20 04:33:27.199204121 (275h7m49.158301368s) [upload=286343]: Starting upload
Aug 20 04:33:27.199260068 (275h7m49.158357322s) [upload=286343]: Done starting upload
Aug 20 04:33:27.199488966 (275h7m49.158586218s) [upload=286343]: Uploading segments...
Aug 20 04:33:27.199565958 (275h7m49.158663213s) [upload=286343]: Got next segment. Inline: false
Aug 20 04:33:27.199614035 (275h7m49.158711282s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 04:33:27.199620399 (275h7m49.158717645s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 04:33:27.407697839 (275h7m49.366795094s) [seg_pos={0 0}, upload=286343]: Begin upload segment...
Aug 20 04:33:27.407780671 (275h7m49.366877912s) [seg_pos={0 0}, upload=286343]: Done begin upload segment.
Aug 20 04:33:27.407869848 (275h7m49.366967105s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.408607964 (275h7m49.36770522s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409143527 (275h7m49.368240784s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409677349 (275h7m49.368774604s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.409761391 (275h7m49.36885865s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410634033 (275h7m49.369731289s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.410817493 (275h7m49.369914745s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.411554101 (275h7m49.370651355s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.412396631 (275h7m49.371493886s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414095454 (275h7m49.373192708s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414376571 (275h7m49.373473801s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414649944 (275h7m49.373747188s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.414872491 (275h7m49.373969722s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415093511 (275h7m49.374190756s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415364196 (275h7m49.374461453s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.415664624 (275h7m49.374761855s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.416773709 (275h7m49.375870963s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.417663627 (275h7m49.376760878s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Uploading piece...
Aug 20 04:33:27.964616048 (275h7m49.923713284s) [upload=286343]: Next returned nil segment
Aug 20 04:33:27.964633107 (275h7m49.923730401s) [upload=286343]: Waiting for error group managing segments...
Aug 20 04:33:28.114523295 (275h7m50.073620542s) [noise=true , address=45.91.116.4:4943 , piece_id=B2VULGXQWW2RAWW6LB7S3JGZJI5QHKUFEC6YWTUWMMWI7Z7FZMEA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.115372703 (275h7m50.074469938s) [noise=true , address=45.91.116.5:4318 , piece_id=ERGK5HYMELGYVWRVQLUYN6WMS56JWVU2IQ7BAJHWUJTC3FGZY6EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.121451765 (275h7m50.080549011s) [noise=true , address=45.91.116.7:4028 , piece_id=4J4UYHBAW33RHVWTKHMXLZUOSVEIWLXBQ2Q6STPELJUMBDDRTJFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.130813010 (275h7m50.089910311s) [noise=true , address=104.36.82.3:4770 , piece_id=WG65MOQ7TEONDLJRC73PGP3NLHXJX2ZH46OQWQBM2YO2SS5NE2BQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.133481882 (275h7m50.092579128s) [noise=true , address=77.90.31.12:4596 , piece_id=EJKKXQ5HICGZECNP6FMFXCVZ3CVGADC4NQ5EEEK7YFOBRAYWY4EA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.138608038 (275h7m50.097705283s) [noise=true , address=104.36.82.44:4892 , piece_id=FVWHHBZKIDXPIKQLU73KG5O7ANTHTZYNOA4JYCXNJDH3JZDGTXPQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.139436204 (275h7m50.098533442s) [noise=true , address=77.90.31.18:4811 , piece_id=HJQK372OCVXALQ24DXJC5TIGI26BY7Q6QRGGU6SUAVEBD6XAPREA, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.160367355 (275h7m50.119464587s) [noise=true , address=104.36.82.12:4164 , piece_id=MONRA5GFZLHYHYTPS46CA5JXN4QUASZ3JUKACHXUMI3EPIMYDGFQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.166260292 (275h7m50.125357538s) [noise=true , address=104.36.82.23:4469 , piece_id=ICP5W72ICWKISOXOBI53EOGO2VP6UP6O7TRX2FUVWV3YVMVELX3A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.168282157 (275h7m50.127379396s) [noise=true , address=77.90.31.14:4664 , piece_id=RD7RLSVEFUJAKZ3ZEKELPBDA4WMO5NVFIEYGEUPD5A7GIU6U6LUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.170864191 (275h7m50.129961429s) [noise=true , address=104.36.82.5:4844 , piece_id=JKROQJIWBBZTVVBZZGS2WY2DOGCHRYSS6CLCUYN6OQUDZ2ZGEO6A, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.174825448 (275h7m50.133922687s) [noise=true , address=104.36.82.60:4371 , piece_id=NIA6MRS4ADABAWPYT6AUBZYZ5ZJWDDP4YROPA5OXNJWM4A67Q6KQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.213640736 (275h7m50.172737973s) [noise=true , address=45.91.116.11:4142 , piece_id=YNKBLPQDBUW3B3MWJ5U3X4CZQOI6PSUYDT3MZUTVXJ5SO4V3BF4Q, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285755044 (275h7m50.244852283s) [noise=true , address=77.90.31.19:4852 , piece_id=W6T3CRPWAWNNC7ZNXA2EB75FOPN4SBO54OXMKKWXXSLVSTOPCXNQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: <nil>
Aug 20 04:33:28.285789347 (275h7m50.244886592s) [seg_pos={0 0}, upload=286343]: Segment reached optimal threshold of 14 pieces.
Aug 20 04:33:28.285978225 (275h7m50.245075472s) [noise=true , address=77.90.31.10:4541 , piece_id=QEMXTWGGQTHFIDBRPV4PT4QAUE3DBR4MF25PWLW7EXZ3MGY37FHQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1277g6Fg28bEwNXpQEsMvLGSfggDDNn5wPHrkv4inaVD8j71rwW): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286100366 (275h7m50.245197613s) [noise=true , address=77.90.31.13:4650 , piece_id=FKVX22DSVH4567JRBOHJY2DHGJUJZSOZPYIQV5BOEPZBMQZIE4LQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286215951 (275h7m50.245313187s) [noise=true , address=79.127.205.245:4245 , piece_id=BSSCYEGQ6UYXOMGOZNEANOHO3Y5TJDLUYOAFDJLIM2AKUWKRZNCQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1S4wJRQEKESaiR7nPDqq8LZpqd2iYY9qTXF8SG8Kvf4sXsY8JH): protocol: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35430->79.127.205.245:4245: use of closed network connection
Aug 20 04:33:28.286231828 (275h7m50.245329063s) [noise=true , address=77.90.31.21:4897 , piece_id=YPPSINJ6VGEEUPFLUGEUTXO5YYQBFTKNVN626UBLATN7DRPE7IUQ, seg_pos={0 0}, upload=286343]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 20 04:33:28.286279710 (275h7m50.245376949s) [seg_pos={0 0}, upload=286343]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 04:33:28.286372537 (275h7m50.245469782s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 04:33:28.286377568 (275h7m50.245474816s) [upload=286343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 04:33:28.444759229 (275h7m50.403856475s) [upload=286343]: Done uploading segments...
Aug 20 04:33:28.444804935 (275h7m50.403902181s) [upload=286343]: Upload finished. err: <nil>
Duration: 2.614371645s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|