Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
850.66323ms
FAIL (2025-08-09 15:16:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 850.690056ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X...........................X..........] duration:
2.689674893s
FAIL (2025-08-09 15:15:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 15:08:40.329771394 (21h43m2.288868651s) [upload=22627]: Starting upload Aug 9 15:08:40.329845280 (21h43m2.288942534s) [upload=22627]: Done starting upload Aug 9 15:08:40.329992752 (21h43m2.28909s) [upload=22627]: Uploading segments... Aug 9 15:08:40.330146588 (21h43m2.289243827s) [upload=22627]: Got next segment. Inline: false Aug 9 15:08:40.330181556 (21h43m2.2892788s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 15:08:40.330188272 (21h43m2.289285518s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 15:08:40.465535490 (21h43m2.42463274s) [upload=22627]: Next segment err: metaclient: Too Many Requests Aug 9 15:08:40.465587288 (21h43m2.424684535s) [upload=22627]: Done uploading segments... Aug 9 15:08:40.465606039 (21h43m2.424703285s) [upload=22627]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.689717519s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X...........................X.........] duration:
2.899259532s
FAIL (2025-08-09 15:15:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 15:08:40.329771394 (21h43m2.288868651s) [upload=22627]: Starting upload Aug 9 15:08:40.329845280 (21h43m2.288942534s) [upload=22627]: Done starting upload Aug 9 15:08:40.329992752 (21h43m2.28909s) [upload=22627]: Uploading segments... Aug 9 15:08:40.330146588 (21h43m2.289243827s) [upload=22627]: Got next segment. Inline: false Aug 9 15:08:40.330181556 (21h43m2.2892788s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 15:08:40.330188272 (21h43m2.289285518s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 15:08:40.465535490 (21h43m2.42463274s) [upload=22627]: Next segment err: metaclient: Too Many Requests Aug 9 15:08:40.465587288 (21h43m2.424684535s) [upload=22627]: Done uploading segments... Aug 9 15:08:40.465606039 (21h43m2.424703285s) [upload=22627]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.899295856s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
935.779023ms
FAIL (2025-08-09 15:15:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 935.807034ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
831.172255ms
FAIL (2025-08-09 15:14:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 831.20081ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...........................X........] duration:
2.78464965s
FAIL (2025-08-09 15:14:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 15:08:40.329771394 (21h43m2.288868651s) [upload=22627]: Starting upload Aug 9 15:08:40.329845280 (21h43m2.288942534s) [upload=22627]: Done starting upload Aug 9 15:08:40.329992752 (21h43m2.28909s) [upload=22627]: Uploading segments... Aug 9 15:08:40.330146588 (21h43m2.289243827s) [upload=22627]: Got next segment. Inline: false Aug 9 15:08:40.330181556 (21h43m2.2892788s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 15:08:40.330188272 (21h43m2.289285518s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 15:08:40.465535490 (21h43m2.42463274s) [upload=22627]: Next segment err: metaclient: Too Many Requests Aug 9 15:08:40.465587288 (21h43m2.424684535s) [upload=22627]: Done uploading segments... Aug 9 15:08:40.465606039 (21h43m2.424703285s) [upload=22627]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.784679919s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
916.788443ms
FAIL (2025-08-09 15:13:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 916.818844ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X...........................X.......] duration:
3.343937376s
FAIL (2025-08-09 15:13:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 15:08:40.329771394 (21h43m2.288868651s) [upload=22627]: Starting upload Aug 9 15:08:40.329845280 (21h43m2.288942534s) [upload=22627]: Done starting upload Aug 9 15:08:40.329992752 (21h43m2.28909s) [upload=22627]: Uploading segments... Aug 9 15:08:40.330146588 (21h43m2.289243827s) [upload=22627]: Got next segment. Inline: false Aug 9 15:08:40.330181556 (21h43m2.2892788s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 15:08:40.330188272 (21h43m2.289285518s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 15:08:40.465535490 (21h43m2.42463274s) [upload=22627]: Next segment err: metaclient: Too Many Requests Aug 9 15:08:40.465587288 (21h43m2.424684535s) [upload=22627]: Done uploading segments... Aug 9 15:08:40.465606039 (21h43m2.424703285s) [upload=22627]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.343968189s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X........................X...........................X......] duration:
2.614363387s
FAIL (2025-08-09 15:13:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 15:08:40.329771394 (21h43m2.288868651s) [upload=22627]: Starting upload Aug 9 15:08:40.329845280 (21h43m2.288942534s) [upload=22627]: Done starting upload Aug 9 15:08:40.329992752 (21h43m2.28909s) [upload=22627]: Uploading segments... Aug 9 15:08:40.330146588 (21h43m2.289243827s) [upload=22627]: Got next segment. Inline: false Aug 9 15:08:40.330181556 (21h43m2.2892788s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 15:08:40.330188272 (21h43m2.289285518s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 15:08:40.465535490 (21h43m2.42463274s) [upload=22627]: Next segment err: metaclient: Too Many Requests Aug 9 15:08:40.465587288 (21h43m2.424684535s) [upload=22627]: Done uploading segments... Aug 9 15:08:40.465606039 (21h43m2.424703285s) [upload=22627]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.614393123s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.00817094s
FAIL (2025-08-09 15:12:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.008201336s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X........................X...........................X.....] duration:
2.817171087s
FAIL (2025-08-09 15:12:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 15:08:40.329771394 (21h43m2.288868651s) [upload=22627]: Starting upload Aug 9 15:08:40.329845280 (21h43m2.288942534s) [upload=22627]: Done starting upload Aug 9 15:08:40.329992752 (21h43m2.28909s) [upload=22627]: Uploading segments... Aug 9 15:08:40.330146588 (21h43m2.289243827s) [upload=22627]: Got next segment. Inline: false Aug 9 15:08:40.330181556 (21h43m2.2892788s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 15:08:40.330188272 (21h43m2.289285518s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 15:08:40.465535490 (21h43m2.42463274s) [upload=22627]: Next segment err: metaclient: Too Many Requests Aug 9 15:08:40.465587288 (21h43m2.424684535s) [upload=22627]: Done uploading segments... Aug 9 15:08:40.465606039 (21h43m2.424703285s) [upload=22627]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.817214217s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
888.001742ms
FAIL (2025-08-09 15:12:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 888.035594ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
960.419804ms
FAIL (2025-08-09 15:11:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 960.44832ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X........................X...........................X....] duration:
3.356647663s
FAIL (2025-08-09 15:11:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 15:08:40.329771394 (21h43m2.288868651s) [upload=22627]: Starting upload Aug 9 15:08:40.329845280 (21h43m2.288942534s) [upload=22627]: Done starting upload Aug 9 15:08:40.329992752 (21h43m2.28909s) [upload=22627]: Uploading segments... Aug 9 15:08:40.330146588 (21h43m2.289243827s) [upload=22627]: Got next segment. Inline: false Aug 9 15:08:40.330181556 (21h43m2.2892788s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 15:08:40.330188272 (21h43m2.289285518s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 15:08:40.465535490 (21h43m2.42463274s) [upload=22627]: Next segment err: metaclient: Too Many Requests Aug 9 15:08:40.465587288 (21h43m2.424684535s) [upload=22627]: Done uploading segments... Aug 9 15:08:40.465606039 (21h43m2.424703285s) [upload=22627]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.356675959s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X........................X...........................X...] duration:
2.993403468s
FAIL (2025-08-09 15:10:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 15:08:40.329771394 (21h43m2.288868651s) [upload=22627]: Starting upload Aug 9 15:08:40.329845280 (21h43m2.288942534s) [upload=22627]: Done starting upload Aug 9 15:08:40.329992752 (21h43m2.28909s) [upload=22627]: Uploading segments... Aug 9 15:08:40.330146588 (21h43m2.289243827s) [upload=22627]: Got next segment. Inline: false Aug 9 15:08:40.330181556 (21h43m2.2892788s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 15:08:40.330188272 (21h43m2.289285518s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 15:08:40.465535490 (21h43m2.42463274s) [upload=22627]: Next segment err: metaclient: Too Many Requests Aug 9 15:08:40.465587288 (21h43m2.424684535s) [upload=22627]: Done uploading segments... Aug 9 15:08:40.465606039 (21h43m2.424703285s) [upload=22627]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.993425202s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
855.327727ms
FAIL (2025-08-09 15:10:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 855.349062ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X........................X...........................X..] duration:
2.687261187s
FAIL (2025-08-09 15:10:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 15:08:40.329771394 (21h43m2.288868651s) [upload=22627]: Starting upload Aug 9 15:08:40.329845280 (21h43m2.288942534s) [upload=22627]: Done starting upload Aug 9 15:08:40.329992752 (21h43m2.28909s) [upload=22627]: Uploading segments... Aug 9 15:08:40.330146588 (21h43m2.289243827s) [upload=22627]: Got next segment. Inline: false Aug 9 15:08:40.330181556 (21h43m2.2892788s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 15:08:40.330188272 (21h43m2.289285518s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 15:08:40.465535490 (21h43m2.42463274s) [upload=22627]: Next segment err: metaclient: Too Many Requests Aug 9 15:08:40.465587288 (21h43m2.424684535s) [upload=22627]: Done uploading segments... Aug 9 15:08:40.465606039 (21h43m2.424703285s) [upload=22627]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.687288565s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X........................X...........................X.] duration:
2.986433845s
FAIL (2025-08-09 15:09:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 15:08:40.329771394 (21h43m2.288868651s) [upload=22627]: Starting upload Aug 9 15:08:40.329845280 (21h43m2.288942534s) [upload=22627]: Done starting upload Aug 9 15:08:40.329992752 (21h43m2.28909s) [upload=22627]: Uploading segments... Aug 9 15:08:40.330146588 (21h43m2.289243827s) [upload=22627]: Got next segment. Inline: false Aug 9 15:08:40.330181556 (21h43m2.2892788s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 15:08:40.330188272 (21h43m2.289285518s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 15:08:40.465535490 (21h43m2.42463274s) [upload=22627]: Next segment err: metaclient: Too Many Requests Aug 9 15:08:40.465587288 (21h43m2.424684535s) [upload=22627]: Done uploading segments... Aug 9 15:08:40.465606039 (21h43m2.424703285s) [upload=22627]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.986471055s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
886.966798ms
FAIL (2025-08-09 15:09:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 886.994197ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
965.598203ms
FAIL (2025-08-09 15:08:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 965.638838ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X........................X...........................X] duration:
412.490119ms
FAIL (2025-08-09 15:08:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 15:08:40.329771394 (21h43m2.288868651s) [upload=22627]: Starting upload Aug 9 15:08:40.329845280 (21h43m2.288942534s) [upload=22627]: Done starting upload Aug 9 15:08:40.329992752 (21h43m2.28909s) [upload=22627]: Uploading segments... Aug 9 15:08:40.330146588 (21h43m2.289243827s) [upload=22627]: Got next segment. Inline: false Aug 9 15:08:40.330181556 (21h43m2.2892788s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 15:08:40.330188272 (21h43m2.289285518s) [upload=22627]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 15:08:40.465535490 (21h43m2.42463274s) [upload=22627]: Next segment err: metaclient: Too Many Requests Aug 9 15:08:40.465587288 (21h43m2.424684535s) [upload=22627]: Done uploading segments... Aug 9 15:08:40.465606039 (21h43m2.424703285s) [upload=22627]: Upload finished. err: metaclient: Too Many Requests
Duration: 412.540761ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
902.838541ms
FAIL (2025-08-09 15:07:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 902.868959ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X........................X...........................] duration:
3.22170692s
FAIL (2025-08-09 15:07:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 69ba31d6f12c4cf76088340619036d4db38f204c1d0bff08be6ddabdd500f15e != before 755bb27d731fa6afa9063572e06708265d48342f49a6262cbc779783a2d068f0
======LOGS======
Aug 9 14:46:24.327546771 (21h20m46.286644029s) [upload=22253]: Starting upload
Aug 9 14:46:24.327636609 (21h20m46.286733855s) [upload=22253]: Done starting upload
Aug 9 14:46:24.327747841 (21h20m46.286845083s) [upload=22253]: Uploading segments...
Aug 9 14:46:24.328028303 (21h20m46.287125549s) [upload=22253]: Got next segment. Inline: false
Aug 9 14:46:24.328112804 (21h20m46.287210057s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 14:46:24.328122509 (21h20m46.287219762s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 14:46:24.529038307 (21h20m46.488135553s) [seg_pos={0 0}, upload=22253]: Begin upload segment...
Aug 9 14:46:24.529092647 (21h20m46.488189894s) [seg_pos={0 0}, upload=22253]: Done begin upload segment.
Aug 9 14:46:24.529119310 (21h20m46.48821656s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.530347569 (21h20m46.489444824s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531041055 (21h20m46.49013831s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531360175 (21h20m46.490457426s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531639434 (21h20m46.490736682s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531875544 (21h20m46.490972792s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532124047 (21h20m46.491221295s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532343561 (21h20m46.491440809s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532583609 (21h20m46.491680858s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532864065 (21h20m46.491961313s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.533156437 (21h20m46.492253687s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.534823974 (21h20m46.493921228s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535250307 (21h20m46.49434756s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535559299 (21h20m46.494656553s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535837647 (21h20m46.494934895s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536118055 (21h20m46.49521531s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536400154 (21h20m46.495497408s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536728580 (21h20m46.49582583s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:25.115155363 (21h20m47.074252619s) [upload=22253]: Next returned nil segment
Aug 9 14:46:25.115181432 (21h20m47.074278688s) [upload=22253]: Waiting for error group managing segments...
Aug 9 14:46:25.260151754 (21h20m47.219249009s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.261076628 (21h20m47.220173863s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.274754683 (21h20m47.233851938s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.279129678 (21h20m47.238226933s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.282432070 (21h20m47.241529301s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.286575156 (21h20m47.245672405s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.289151420 (21h20m47.248248659s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.290606829 (21h20m47.249704067s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.300168722 (21h20m47.259265959s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.303175304 (21h20m47.262272546s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.310567037 (21h20m47.269664269s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.348301827 (21h20m47.307399062s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.370482766 (21h20m47.329580001s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430139752 (21h20m47.389236987s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430170139 (21h20m47.389267384s) [seg_pos={0 0}, upload=22253]: Segment reached optimal threshold of 14 pieces.
Aug 9 14:46:25.430332159 (21h20m47.389429399s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pr9AH19VocE1DGtjnME5D5KgPjuHQiwWAwkcSzPKVDktgWmQh): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430406693 (21h20m47.389503933s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430456591 (21h20m47.389553827s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection
Aug 9 14:46:25.430529038 (21h20m47.389626276s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection
Aug 9 14:46:25.430553149 (21h20m47.389650395s) [seg_pos={0 0}, upload=22253]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 14:46:25.430644925 (21h20m47.38974217s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 14:46:25.430650989 (21h20m47.389748239s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 14:46:25.742143065 (21h20m47.701240312s) [upload=22253]: Done uploading segments...
Aug 9 14:46:25.742163480 (21h20m47.701260715s) [upload=22253]: Upload finished. err: <nil>
Duration: 3.221740859s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
1.408508537s
FAIL (2025-08-09 15:07:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.408545751s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X........................X..........................] duration:
2.904974289s
FAIL (2025-08-09 15:06:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 69ba31d6f12c4cf76088340619036d4db38f204c1d0bff08be6ddabdd500f15e != before 755bb27d731fa6afa9063572e06708265d48342f49a6262cbc779783a2d068f0
======LOGS======
Aug 9 14:46:24.327546771 (21h20m46.286644029s) [upload=22253]: Starting upload
Aug 9 14:46:24.327636609 (21h20m46.286733855s) [upload=22253]: Done starting upload
Aug 9 14:46:24.327747841 (21h20m46.286845083s) [upload=22253]: Uploading segments...
Aug 9 14:46:24.328028303 (21h20m46.287125549s) [upload=22253]: Got next segment. Inline: false
Aug 9 14:46:24.328112804 (21h20m46.287210057s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 14:46:24.328122509 (21h20m46.287219762s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 14:46:24.529038307 (21h20m46.488135553s) [seg_pos={0 0}, upload=22253]: Begin upload segment...
Aug 9 14:46:24.529092647 (21h20m46.488189894s) [seg_pos={0 0}, upload=22253]: Done begin upload segment.
Aug 9 14:46:24.529119310 (21h20m46.48821656s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.530347569 (21h20m46.489444824s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531041055 (21h20m46.49013831s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531360175 (21h20m46.490457426s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531639434 (21h20m46.490736682s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531875544 (21h20m46.490972792s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532124047 (21h20m46.491221295s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532343561 (21h20m46.491440809s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532583609 (21h20m46.491680858s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532864065 (21h20m46.491961313s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.533156437 (21h20m46.492253687s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.534823974 (21h20m46.493921228s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535250307 (21h20m46.49434756s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535559299 (21h20m46.494656553s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535837647 (21h20m46.494934895s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536118055 (21h20m46.49521531s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536400154 (21h20m46.495497408s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536728580 (21h20m46.49582583s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:25.115155363 (21h20m47.074252619s) [upload=22253]: Next returned nil segment
Aug 9 14:46:25.115181432 (21h20m47.074278688s) [upload=22253]: Waiting for error group managing segments...
Aug 9 14:46:25.260151754 (21h20m47.219249009s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.261076628 (21h20m47.220173863s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.274754683 (21h20m47.233851938s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.279129678 (21h20m47.238226933s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.282432070 (21h20m47.241529301s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.286575156 (21h20m47.245672405s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.289151420 (21h20m47.248248659s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.290606829 (21h20m47.249704067s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.300168722 (21h20m47.259265959s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.303175304 (21h20m47.262272546s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.310567037 (21h20m47.269664269s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.348301827 (21h20m47.307399062s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.370482766 (21h20m47.329580001s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430139752 (21h20m47.389236987s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430170139 (21h20m47.389267384s) [seg_pos={0 0}, upload=22253]: Segment reached optimal threshold of 14 pieces.
Aug 9 14:46:25.430332159 (21h20m47.389429399s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pr9AH19VocE1DGtjnME5D5KgPjuHQiwWAwkcSzPKVDktgWmQh): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430406693 (21h20m47.389503933s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430456591 (21h20m47.389553827s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection
Aug 9 14:46:25.430529038 (21h20m47.389626276s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection
Aug 9 14:46:25.430553149 (21h20m47.389650395s) [seg_pos={0 0}, upload=22253]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 14:46:25.430644925 (21h20m47.38974217s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 14:46:25.430650989 (21h20m47.389748239s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 14:46:25.742143065 (21h20m47.701240312s) [upload=22253]: Done uploading segments...
Aug 9 14:46:25.742163480 (21h20m47.701260715s) [upload=22253]: Upload finished. err: <nil>
Duration: 2.905001421s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
925.433809ms
FAIL (2025-08-09 15:06:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 925.459318ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
896.190099ms
FAIL (2025-08-09 15:06:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 896.261842ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
921.790609ms
FAIL (2025-08-09 15:05:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 921.821664ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X........................X.........................] duration:
2.818139641s
FAIL (2025-08-09 15:05:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 69ba31d6f12c4cf76088340619036d4db38f204c1d0bff08be6ddabdd500f15e != before 755bb27d731fa6afa9063572e06708265d48342f49a6262cbc779783a2d068f0
======LOGS======
Aug 9 14:46:24.327546771 (21h20m46.286644029s) [upload=22253]: Starting upload
Aug 9 14:46:24.327636609 (21h20m46.286733855s) [upload=22253]: Done starting upload
Aug 9 14:46:24.327747841 (21h20m46.286845083s) [upload=22253]: Uploading segments...
Aug 9 14:46:24.328028303 (21h20m46.287125549s) [upload=22253]: Got next segment. Inline: false
Aug 9 14:46:24.328112804 (21h20m46.287210057s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 14:46:24.328122509 (21h20m46.287219762s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 14:46:24.529038307 (21h20m46.488135553s) [seg_pos={0 0}, upload=22253]: Begin upload segment...
Aug 9 14:46:24.529092647 (21h20m46.488189894s) [seg_pos={0 0}, upload=22253]: Done begin upload segment.
Aug 9 14:46:24.529119310 (21h20m46.48821656s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.530347569 (21h20m46.489444824s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531041055 (21h20m46.49013831s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531360175 (21h20m46.490457426s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531639434 (21h20m46.490736682s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531875544 (21h20m46.490972792s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532124047 (21h20m46.491221295s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532343561 (21h20m46.491440809s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532583609 (21h20m46.491680858s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532864065 (21h20m46.491961313s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.533156437 (21h20m46.492253687s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.534823974 (21h20m46.493921228s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535250307 (21h20m46.49434756s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535559299 (21h20m46.494656553s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535837647 (21h20m46.494934895s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536118055 (21h20m46.49521531s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536400154 (21h20m46.495497408s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536728580 (21h20m46.49582583s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:25.115155363 (21h20m47.074252619s) [upload=22253]: Next returned nil segment
Aug 9 14:46:25.115181432 (21h20m47.074278688s) [upload=22253]: Waiting for error group managing segments...
Aug 9 14:46:25.260151754 (21h20m47.219249009s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.261076628 (21h20m47.220173863s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.274754683 (21h20m47.233851938s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.279129678 (21h20m47.238226933s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.282432070 (21h20m47.241529301s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.286575156 (21h20m47.245672405s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.289151420 (21h20m47.248248659s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.290606829 (21h20m47.249704067s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.300168722 (21h20m47.259265959s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.303175304 (21h20m47.262272546s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.310567037 (21h20m47.269664269s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.348301827 (21h20m47.307399062s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.370482766 (21h20m47.329580001s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430139752 (21h20m47.389236987s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430170139 (21h20m47.389267384s) [seg_pos={0 0}, upload=22253]: Segment reached optimal threshold of 14 pieces.
Aug 9 14:46:25.430332159 (21h20m47.389429399s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pr9AH19VocE1DGtjnME5D5KgPjuHQiwWAwkcSzPKVDktgWmQh): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430406693 (21h20m47.389503933s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430456591 (21h20m47.389553827s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection
Aug 9 14:46:25.430529038 (21h20m47.389626276s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection
Aug 9 14:46:25.430553149 (21h20m47.389650395s) [seg_pos={0 0}, upload=22253]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 14:46:25.430644925 (21h20m47.38974217s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 14:46:25.430650989 (21h20m47.389748239s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 14:46:25.742143065 (21h20m47.701240312s) [upload=22253]: Done uploading segments...
Aug 9 14:46:25.742163480 (21h20m47.701260715s) [upload=22253]: Upload finished. err: <nil>
Duration: 2.818165289s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
1.231744321s
FAIL (2025-08-09 15:05:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.231776781s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X........................X........................] duration:
2.495097698s
FAIL (2025-08-09 15:04:39 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 69ba31d6f12c4cf76088340619036d4db38f204c1d0bff08be6ddabdd500f15e != before 755bb27d731fa6afa9063572e06708265d48342f49a6262cbc779783a2d068f0
======LOGS======
Aug 9 14:46:24.327546771 (21h20m46.286644029s) [upload=22253]: Starting upload
Aug 9 14:46:24.327636609 (21h20m46.286733855s) [upload=22253]: Done starting upload
Aug 9 14:46:24.327747841 (21h20m46.286845083s) [upload=22253]: Uploading segments...
Aug 9 14:46:24.328028303 (21h20m46.287125549s) [upload=22253]: Got next segment. Inline: false
Aug 9 14:46:24.328112804 (21h20m46.287210057s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 14:46:24.328122509 (21h20m46.287219762s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 14:46:24.529038307 (21h20m46.488135553s) [seg_pos={0 0}, upload=22253]: Begin upload segment...
Aug 9 14:46:24.529092647 (21h20m46.488189894s) [seg_pos={0 0}, upload=22253]: Done begin upload segment.
Aug 9 14:46:24.529119310 (21h20m46.48821656s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.530347569 (21h20m46.489444824s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531041055 (21h20m46.49013831s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531360175 (21h20m46.490457426s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531639434 (21h20m46.490736682s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531875544 (21h20m46.490972792s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532124047 (21h20m46.491221295s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532343561 (21h20m46.491440809s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532583609 (21h20m46.491680858s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532864065 (21h20m46.491961313s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.533156437 (21h20m46.492253687s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.534823974 (21h20m46.493921228s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535250307 (21h20m46.49434756s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535559299 (21h20m46.494656553s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535837647 (21h20m46.494934895s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536118055 (21h20m46.49521531s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536400154 (21h20m46.495497408s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536728580 (21h20m46.49582583s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:25.115155363 (21h20m47.074252619s) [upload=22253]: Next returned nil segment
Aug 9 14:46:25.115181432 (21h20m47.074278688s) [upload=22253]: Waiting for error group managing segments...
Aug 9 14:46:25.260151754 (21h20m47.219249009s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.261076628 (21h20m47.220173863s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.274754683 (21h20m47.233851938s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.279129678 (21h20m47.238226933s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.282432070 (21h20m47.241529301s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.286575156 (21h20m47.245672405s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.289151420 (21h20m47.248248659s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.290606829 (21h20m47.249704067s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.300168722 (21h20m47.259265959s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.303175304 (21h20m47.262272546s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.310567037 (21h20m47.269664269s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.348301827 (21h20m47.307399062s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.370482766 (21h20m47.329580001s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430139752 (21h20m47.389236987s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430170139 (21h20m47.389267384s) [seg_pos={0 0}, upload=22253]: Segment reached optimal threshold of 14 pieces.
Aug 9 14:46:25.430332159 (21h20m47.389429399s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pr9AH19VocE1DGtjnME5D5KgPjuHQiwWAwkcSzPKVDktgWmQh): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430406693 (21h20m47.389503933s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430456591 (21h20m47.389553827s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection
Aug 9 14:46:25.430529038 (21h20m47.389626276s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection
Aug 9 14:46:25.430553149 (21h20m47.389650395s) [seg_pos={0 0}, upload=22253]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 14:46:25.430644925 (21h20m47.38974217s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 14:46:25.430650989 (21h20m47.389748239s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 14:46:25.742143065 (21h20m47.701240312s) [upload=22253]: Done uploading segments...
Aug 9 14:46:25.742163480 (21h20m47.701260715s) [upload=22253]: Upload finished. err: <nil>
Duration: 2.495130438s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X................................................X..........] duration:
828.897351ms
FAIL (2025-08-09 15:04:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 828.923103ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X................................................X.........] duration:
1.077783201s
FAIL (2025-08-09 15:03:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.077815453s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X........................X.......................] duration:
3.080532071s
FAIL (2025-08-09 15:03:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 69ba31d6f12c4cf76088340619036d4db38f204c1d0bff08be6ddabdd500f15e != before 755bb27d731fa6afa9063572e06708265d48342f49a6262cbc779783a2d068f0
======LOGS======
Aug 9 14:46:24.327546771 (21h20m46.286644029s) [upload=22253]: Starting upload
Aug 9 14:46:24.327636609 (21h20m46.286733855s) [upload=22253]: Done starting upload
Aug 9 14:46:24.327747841 (21h20m46.286845083s) [upload=22253]: Uploading segments...
Aug 9 14:46:24.328028303 (21h20m46.287125549s) [upload=22253]: Got next segment. Inline: false
Aug 9 14:46:24.328112804 (21h20m46.287210057s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 14:46:24.328122509 (21h20m46.287219762s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 14:46:24.529038307 (21h20m46.488135553s) [seg_pos={0 0}, upload=22253]: Begin upload segment...
Aug 9 14:46:24.529092647 (21h20m46.488189894s) [seg_pos={0 0}, upload=22253]: Done begin upload segment.
Aug 9 14:46:24.529119310 (21h20m46.48821656s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.530347569 (21h20m46.489444824s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531041055 (21h20m46.49013831s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531360175 (21h20m46.490457426s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531639434 (21h20m46.490736682s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531875544 (21h20m46.490972792s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532124047 (21h20m46.491221295s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532343561 (21h20m46.491440809s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532583609 (21h20m46.491680858s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532864065 (21h20m46.491961313s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.533156437 (21h20m46.492253687s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.534823974 (21h20m46.493921228s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535250307 (21h20m46.49434756s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535559299 (21h20m46.494656553s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535837647 (21h20m46.494934895s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536118055 (21h20m46.49521531s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536400154 (21h20m46.495497408s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536728580 (21h20m46.49582583s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:25.115155363 (21h20m47.074252619s) [upload=22253]: Next returned nil segment
Aug 9 14:46:25.115181432 (21h20m47.074278688s) [upload=22253]: Waiting for error group managing segments...
Aug 9 14:46:25.260151754 (21h20m47.219249009s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.261076628 (21h20m47.220173863s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.274754683 (21h20m47.233851938s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.279129678 (21h20m47.238226933s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.282432070 (21h20m47.241529301s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.286575156 (21h20m47.245672405s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.289151420 (21h20m47.248248659s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.290606829 (21h20m47.249704067s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.300168722 (21h20m47.259265959s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.303175304 (21h20m47.262272546s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.310567037 (21h20m47.269664269s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.348301827 (21h20m47.307399062s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.370482766 (21h20m47.329580001s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430139752 (21h20m47.389236987s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430170139 (21h20m47.389267384s) [seg_pos={0 0}, upload=22253]: Segment reached optimal threshold of 14 pieces.
Aug 9 14:46:25.430332159 (21h20m47.389429399s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pr9AH19VocE1DGtjnME5D5KgPjuHQiwWAwkcSzPKVDktgWmQh): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430406693 (21h20m47.389503933s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430456591 (21h20m47.389553827s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection
Aug 9 14:46:25.430529038 (21h20m47.389626276s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection
Aug 9 14:46:25.430553149 (21h20m47.389650395s) [seg_pos={0 0}, upload=22253]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 14:46:25.430644925 (21h20m47.38974217s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 14:46:25.430650989 (21h20m47.389748239s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 14:46:25.742143065 (21h20m47.701240312s) [upload=22253]: Done uploading segments...
Aug 9 14:46:25.742163480 (21h20m47.701260715s) [upload=22253]: Upload finished. err: <nil>
Duration: 3.080552694s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X........................X......................] duration:
2.414490148s
FAIL (2025-08-09 15:02:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 69ba31d6f12c4cf76088340619036d4db38f204c1d0bff08be6ddabdd500f15e != before 755bb27d731fa6afa9063572e06708265d48342f49a6262cbc779783a2d068f0
======LOGS======
Aug 9 14:46:24.327546771 (21h20m46.286644029s) [upload=22253]: Starting upload
Aug 9 14:46:24.327636609 (21h20m46.286733855s) [upload=22253]: Done starting upload
Aug 9 14:46:24.327747841 (21h20m46.286845083s) [upload=22253]: Uploading segments...
Aug 9 14:46:24.328028303 (21h20m46.287125549s) [upload=22253]: Got next segment. Inline: false
Aug 9 14:46:24.328112804 (21h20m46.287210057s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 14:46:24.328122509 (21h20m46.287219762s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 14:46:24.529038307 (21h20m46.488135553s) [seg_pos={0 0}, upload=22253]: Begin upload segment...
Aug 9 14:46:24.529092647 (21h20m46.488189894s) [seg_pos={0 0}, upload=22253]: Done begin upload segment.
Aug 9 14:46:24.529119310 (21h20m46.48821656s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.530347569 (21h20m46.489444824s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531041055 (21h20m46.49013831s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531360175 (21h20m46.490457426s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531639434 (21h20m46.490736682s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531875544 (21h20m46.490972792s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532124047 (21h20m46.491221295s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532343561 (21h20m46.491440809s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532583609 (21h20m46.491680858s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532864065 (21h20m46.491961313s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.533156437 (21h20m46.492253687s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.534823974 (21h20m46.493921228s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535250307 (21h20m46.49434756s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535559299 (21h20m46.494656553s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535837647 (21h20m46.494934895s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536118055 (21h20m46.49521531s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536400154 (21h20m46.495497408s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536728580 (21h20m46.49582583s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:25.115155363 (21h20m47.074252619s) [upload=22253]: Next returned nil segment
Aug 9 14:46:25.115181432 (21h20m47.074278688s) [upload=22253]: Waiting for error group managing segments...
Aug 9 14:46:25.260151754 (21h20m47.219249009s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.261076628 (21h20m47.220173863s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.274754683 (21h20m47.233851938s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.279129678 (21h20m47.238226933s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.282432070 (21h20m47.241529301s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.286575156 (21h20m47.245672405s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.289151420 (21h20m47.248248659s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.290606829 (21h20m47.249704067s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.300168722 (21h20m47.259265959s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.303175304 (21h20m47.262272546s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.310567037 (21h20m47.269664269s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.348301827 (21h20m47.307399062s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.370482766 (21h20m47.329580001s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430139752 (21h20m47.389236987s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430170139 (21h20m47.389267384s) [seg_pos={0 0}, upload=22253]: Segment reached optimal threshold of 14 pieces.
Aug 9 14:46:25.430332159 (21h20m47.389429399s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pr9AH19VocE1DGtjnME5D5KgPjuHQiwWAwkcSzPKVDktgWmQh): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430406693 (21h20m47.389503933s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430456591 (21h20m47.389553827s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection
Aug 9 14:46:25.430529038 (21h20m47.389626276s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection
Aug 9 14:46:25.430553149 (21h20m47.389650395s) [seg_pos={0 0}, upload=22253]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 14:46:25.430644925 (21h20m47.38974217s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 14:46:25.430650989 (21h20m47.389748239s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 14:46:25.742143065 (21h20m47.701240312s) [upload=22253]: Done uploading segments...
Aug 9 14:46:25.742163480 (21h20m47.701260715s) [upload=22253]: Upload finished. err: <nil>
Duration: 2.414523686s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X................................................X........] duration:
991.729306ms
FAIL (2025-08-09 15:02:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 991.764545ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X................................................X.......] duration:
1.015550007s
FAIL (2025-08-09 15:02:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.015576521s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X........................X.....................] duration:
2.680396467s
FAIL (2025-08-09 15:01:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 69ba31d6f12c4cf76088340619036d4db38f204c1d0bff08be6ddabdd500f15e != before 755bb27d731fa6afa9063572e06708265d48342f49a6262cbc779783a2d068f0
======LOGS======
Aug 9 14:46:24.327546771 (21h20m46.286644029s) [upload=22253]: Starting upload
Aug 9 14:46:24.327636609 (21h20m46.286733855s) [upload=22253]: Done starting upload
Aug 9 14:46:24.327747841 (21h20m46.286845083s) [upload=22253]: Uploading segments...
Aug 9 14:46:24.328028303 (21h20m46.287125549s) [upload=22253]: Got next segment. Inline: false
Aug 9 14:46:24.328112804 (21h20m46.287210057s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 14:46:24.328122509 (21h20m46.287219762s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 14:46:24.529038307 (21h20m46.488135553s) [seg_pos={0 0}, upload=22253]: Begin upload segment...
Aug 9 14:46:24.529092647 (21h20m46.488189894s) [seg_pos={0 0}, upload=22253]: Done begin upload segment.
Aug 9 14:46:24.529119310 (21h20m46.48821656s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.530347569 (21h20m46.489444824s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531041055 (21h20m46.49013831s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531360175 (21h20m46.490457426s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531639434 (21h20m46.490736682s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531875544 (21h20m46.490972792s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532124047 (21h20m46.491221295s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532343561 (21h20m46.491440809s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532583609 (21h20m46.491680858s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532864065 (21h20m46.491961313s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.533156437 (21h20m46.492253687s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.534823974 (21h20m46.493921228s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535250307 (21h20m46.49434756s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535559299 (21h20m46.494656553s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535837647 (21h20m46.494934895s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536118055 (21h20m46.49521531s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536400154 (21h20m46.495497408s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536728580 (21h20m46.49582583s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:25.115155363 (21h20m47.074252619s) [upload=22253]: Next returned nil segment
Aug 9 14:46:25.115181432 (21h20m47.074278688s) [upload=22253]: Waiting for error group managing segments...
Aug 9 14:46:25.260151754 (21h20m47.219249009s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.261076628 (21h20m47.220173863s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.274754683 (21h20m47.233851938s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.279129678 (21h20m47.238226933s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.282432070 (21h20m47.241529301s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.286575156 (21h20m47.245672405s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.289151420 (21h20m47.248248659s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.290606829 (21h20m47.249704067s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.300168722 (21h20m47.259265959s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.303175304 (21h20m47.262272546s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.310567037 (21h20m47.269664269s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.348301827 (21h20m47.307399062s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.370482766 (21h20m47.329580001s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430139752 (21h20m47.389236987s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430170139 (21h20m47.389267384s) [seg_pos={0 0}, upload=22253]: Segment reached optimal threshold of 14 pieces.
Aug 9 14:46:25.430332159 (21h20m47.389429399s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pr9AH19VocE1DGtjnME5D5KgPjuHQiwWAwkcSzPKVDktgWmQh): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430406693 (21h20m47.389503933s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430456591 (21h20m47.389553827s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection
Aug 9 14:46:25.430529038 (21h20m47.389626276s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection
Aug 9 14:46:25.430553149 (21h20m47.389650395s) [seg_pos={0 0}, upload=22253]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 14:46:25.430644925 (21h20m47.38974217s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 14:46:25.430650989 (21h20m47.389748239s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 14:46:25.742143065 (21h20m47.701240312s) [upload=22253]: Done uploading segments...
Aug 9 14:46:25.742163480 (21h20m47.701260715s) [upload=22253]: Upload finished. err: <nil>
Duration: 2.680498369s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X........................X....................] duration:
2.674603856s
FAIL (2025-08-09 15:01:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 69ba31d6f12c4cf76088340619036d4db38f204c1d0bff08be6ddabdd500f15e != before 755bb27d731fa6afa9063572e06708265d48342f49a6262cbc779783a2d068f0
======LOGS======
Aug 9 14:46:24.327546771 (21h20m46.286644029s) [upload=22253]: Starting upload
Aug 9 14:46:24.327636609 (21h20m46.286733855s) [upload=22253]: Done starting upload
Aug 9 14:46:24.327747841 (21h20m46.286845083s) [upload=22253]: Uploading segments...
Aug 9 14:46:24.328028303 (21h20m46.287125549s) [upload=22253]: Got next segment. Inline: false
Aug 9 14:46:24.328112804 (21h20m46.287210057s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 14:46:24.328122509 (21h20m46.287219762s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 14:46:24.529038307 (21h20m46.488135553s) [seg_pos={0 0}, upload=22253]: Begin upload segment...
Aug 9 14:46:24.529092647 (21h20m46.488189894s) [seg_pos={0 0}, upload=22253]: Done begin upload segment.
Aug 9 14:46:24.529119310 (21h20m46.48821656s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.530347569 (21h20m46.489444824s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531041055 (21h20m46.49013831s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531360175 (21h20m46.490457426s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531639434 (21h20m46.490736682s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531875544 (21h20m46.490972792s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532124047 (21h20m46.491221295s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532343561 (21h20m46.491440809s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532583609 (21h20m46.491680858s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532864065 (21h20m46.491961313s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.533156437 (21h20m46.492253687s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.534823974 (21h20m46.493921228s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535250307 (21h20m46.49434756s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535559299 (21h20m46.494656553s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535837647 (21h20m46.494934895s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536118055 (21h20m46.49521531s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536400154 (21h20m46.495497408s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536728580 (21h20m46.49582583s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:25.115155363 (21h20m47.074252619s) [upload=22253]: Next returned nil segment
Aug 9 14:46:25.115181432 (21h20m47.074278688s) [upload=22253]: Waiting for error group managing segments...
Aug 9 14:46:25.260151754 (21h20m47.219249009s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.261076628 (21h20m47.220173863s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.274754683 (21h20m47.233851938s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.279129678 (21h20m47.238226933s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.282432070 (21h20m47.241529301s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.286575156 (21h20m47.245672405s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.289151420 (21h20m47.248248659s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.290606829 (21h20m47.249704067s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.300168722 (21h20m47.259265959s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.303175304 (21h20m47.262272546s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.310567037 (21h20m47.269664269s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.348301827 (21h20m47.307399062s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.370482766 (21h20m47.329580001s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430139752 (21h20m47.389236987s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430170139 (21h20m47.389267384s) [seg_pos={0 0}, upload=22253]: Segment reached optimal threshold of 14 pieces.
Aug 9 14:46:25.430332159 (21h20m47.389429399s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pr9AH19VocE1DGtjnME5D5KgPjuHQiwWAwkcSzPKVDktgWmQh): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430406693 (21h20m47.389503933s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430456591 (21h20m47.389553827s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection
Aug 9 14:46:25.430529038 (21h20m47.389626276s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection
Aug 9 14:46:25.430553149 (21h20m47.389650395s) [seg_pos={0 0}, upload=22253]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 14:46:25.430644925 (21h20m47.38974217s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 14:46:25.430650989 (21h20m47.389748239s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 14:46:25.742143065 (21h20m47.701240312s) [upload=22253]: Done uploading segments...
Aug 9 14:46:25.742163480 (21h20m47.701260715s) [upload=22253]: Upload finished. err: <nil>
Duration: 2.674634694s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X................................................X......] duration:
1.109402478s
FAIL (2025-08-09 15:01:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.109446501s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X........................X...................] duration:
3.150503991s
FAIL (2025-08-09 15:00:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 69ba31d6f12c4cf76088340619036d4db38f204c1d0bff08be6ddabdd500f15e != before 755bb27d731fa6afa9063572e06708265d48342f49a6262cbc779783a2d068f0
======LOGS======
Aug 9 14:46:24.327546771 (21h20m46.286644029s) [upload=22253]: Starting upload
Aug 9 14:46:24.327636609 (21h20m46.286733855s) [upload=22253]: Done starting upload
Aug 9 14:46:24.327747841 (21h20m46.286845083s) [upload=22253]: Uploading segments...
Aug 9 14:46:24.328028303 (21h20m46.287125549s) [upload=22253]: Got next segment. Inline: false
Aug 9 14:46:24.328112804 (21h20m46.287210057s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 14:46:24.328122509 (21h20m46.287219762s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 14:46:24.529038307 (21h20m46.488135553s) [seg_pos={0 0}, upload=22253]: Begin upload segment...
Aug 9 14:46:24.529092647 (21h20m46.488189894s) [seg_pos={0 0}, upload=22253]: Done begin upload segment.
Aug 9 14:46:24.529119310 (21h20m46.48821656s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.530347569 (21h20m46.489444824s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531041055 (21h20m46.49013831s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531360175 (21h20m46.490457426s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531639434 (21h20m46.490736682s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531875544 (21h20m46.490972792s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532124047 (21h20m46.491221295s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532343561 (21h20m46.491440809s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532583609 (21h20m46.491680858s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532864065 (21h20m46.491961313s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.533156437 (21h20m46.492253687s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.534823974 (21h20m46.493921228s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535250307 (21h20m46.49434756s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535559299 (21h20m46.494656553s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535837647 (21h20m46.494934895s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536118055 (21h20m46.49521531s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536400154 (21h20m46.495497408s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536728580 (21h20m46.49582583s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:25.115155363 (21h20m47.074252619s) [upload=22253]: Next returned nil segment
Aug 9 14:46:25.115181432 (21h20m47.074278688s) [upload=22253]: Waiting for error group managing segments...
Aug 9 14:46:25.260151754 (21h20m47.219249009s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.261076628 (21h20m47.220173863s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.274754683 (21h20m47.233851938s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.279129678 (21h20m47.238226933s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.282432070 (21h20m47.241529301s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.286575156 (21h20m47.245672405s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.289151420 (21h20m47.248248659s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.290606829 (21h20m47.249704067s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.300168722 (21h20m47.259265959s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.303175304 (21h20m47.262272546s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.310567037 (21h20m47.269664269s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.348301827 (21h20m47.307399062s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.370482766 (21h20m47.329580001s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430139752 (21h20m47.389236987s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430170139 (21h20m47.389267384s) [seg_pos={0 0}, upload=22253]: Segment reached optimal threshold of 14 pieces.
Aug 9 14:46:25.430332159 (21h20m47.389429399s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pr9AH19VocE1DGtjnME5D5KgPjuHQiwWAwkcSzPKVDktgWmQh): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430406693 (21h20m47.389503933s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430456591 (21h20m47.389553827s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection
Aug 9 14:46:25.430529038 (21h20m47.389626276s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection
Aug 9 14:46:25.430553149 (21h20m47.389650395s) [seg_pos={0 0}, upload=22253]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 14:46:25.430644925 (21h20m47.38974217s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 14:46:25.430650989 (21h20m47.389748239s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 14:46:25.742143065 (21h20m47.701240312s) [upload=22253]: Done uploading segments...
Aug 9 14:46:25.742163480 (21h20m47.701260715s) [upload=22253]: Upload finished. err: <nil>
Duration: 3.150560017s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X................................................X.....] duration:
1.079122377s
FAIL (2025-08-09 15:00:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.07917908s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X................................................X....] duration:
1.017922464s
FAIL (2025-08-09 14:59:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.017951509s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X........................X..................] duration:
2.713512467s
FAIL (2025-08-09 14:59:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 69ba31d6f12c4cf76088340619036d4db38f204c1d0bff08be6ddabdd500f15e != before 755bb27d731fa6afa9063572e06708265d48342f49a6262cbc779783a2d068f0
======LOGS======
Aug 9 14:46:24.327546771 (21h20m46.286644029s) [upload=22253]: Starting upload
Aug 9 14:46:24.327636609 (21h20m46.286733855s) [upload=22253]: Done starting upload
Aug 9 14:46:24.327747841 (21h20m46.286845083s) [upload=22253]: Uploading segments...
Aug 9 14:46:24.328028303 (21h20m46.287125549s) [upload=22253]: Got next segment. Inline: false
Aug 9 14:46:24.328112804 (21h20m46.287210057s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 14:46:24.328122509 (21h20m46.287219762s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 14:46:24.529038307 (21h20m46.488135553s) [seg_pos={0 0}, upload=22253]: Begin upload segment...
Aug 9 14:46:24.529092647 (21h20m46.488189894s) [seg_pos={0 0}, upload=22253]: Done begin upload segment.
Aug 9 14:46:24.529119310 (21h20m46.48821656s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.530347569 (21h20m46.489444824s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531041055 (21h20m46.49013831s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531360175 (21h20m46.490457426s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531639434 (21h20m46.490736682s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531875544 (21h20m46.490972792s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532124047 (21h20m46.491221295s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532343561 (21h20m46.491440809s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532583609 (21h20m46.491680858s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532864065 (21h20m46.491961313s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.533156437 (21h20m46.492253687s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.534823974 (21h20m46.493921228s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535250307 (21h20m46.49434756s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535559299 (21h20m46.494656553s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535837647 (21h20m46.494934895s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536118055 (21h20m46.49521531s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536400154 (21h20m46.495497408s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536728580 (21h20m46.49582583s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:25.115155363 (21h20m47.074252619s) [upload=22253]: Next returned nil segment
Aug 9 14:46:25.115181432 (21h20m47.074278688s) [upload=22253]: Waiting for error group managing segments...
Aug 9 14:46:25.260151754 (21h20m47.219249009s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.261076628 (21h20m47.220173863s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.274754683 (21h20m47.233851938s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.279129678 (21h20m47.238226933s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.282432070 (21h20m47.241529301s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.286575156 (21h20m47.245672405s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.289151420 (21h20m47.248248659s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.290606829 (21h20m47.249704067s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.300168722 (21h20m47.259265959s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.303175304 (21h20m47.262272546s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.310567037 (21h20m47.269664269s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.348301827 (21h20m47.307399062s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.370482766 (21h20m47.329580001s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430139752 (21h20m47.389236987s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430170139 (21h20m47.389267384s) [seg_pos={0 0}, upload=22253]: Segment reached optimal threshold of 14 pieces.
Aug 9 14:46:25.430332159 (21h20m47.389429399s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pr9AH19VocE1DGtjnME5D5KgPjuHQiwWAwkcSzPKVDktgWmQh): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430406693 (21h20m47.389503933s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430456591 (21h20m47.389553827s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection
Aug 9 14:46:25.430529038 (21h20m47.389626276s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection
Aug 9 14:46:25.430553149 (21h20m47.389650395s) [seg_pos={0 0}, upload=22253]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 14:46:25.430644925 (21h20m47.38974217s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 14:46:25.430650989 (21h20m47.389748239s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 14:46:25.742143065 (21h20m47.701240312s) [upload=22253]: Done uploading segments...
Aug 9 14:46:25.742163480 (21h20m47.701260715s) [upload=22253]: Upload finished. err: <nil>
Duration: 2.713542432s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X................................................X...] duration:
930.325165ms
FAIL (2025-08-09 14:58:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 930.365652ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X........................X.................] duration:
2.681999731s
FAIL (2025-08-09 14:58:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 69ba31d6f12c4cf76088340619036d4db38f204c1d0bff08be6ddabdd500f15e != before 755bb27d731fa6afa9063572e06708265d48342f49a6262cbc779783a2d068f0
======LOGS======
Aug 9 14:46:24.327546771 (21h20m46.286644029s) [upload=22253]: Starting upload
Aug 9 14:46:24.327636609 (21h20m46.286733855s) [upload=22253]: Done starting upload
Aug 9 14:46:24.327747841 (21h20m46.286845083s) [upload=22253]: Uploading segments...
Aug 9 14:46:24.328028303 (21h20m46.287125549s) [upload=22253]: Got next segment. Inline: false
Aug 9 14:46:24.328112804 (21h20m46.287210057s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 14:46:24.328122509 (21h20m46.287219762s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 14:46:24.529038307 (21h20m46.488135553s) [seg_pos={0 0}, upload=22253]: Begin upload segment...
Aug 9 14:46:24.529092647 (21h20m46.488189894s) [seg_pos={0 0}, upload=22253]: Done begin upload segment.
Aug 9 14:46:24.529119310 (21h20m46.48821656s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.530347569 (21h20m46.489444824s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531041055 (21h20m46.49013831s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531360175 (21h20m46.490457426s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531639434 (21h20m46.490736682s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531875544 (21h20m46.490972792s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532124047 (21h20m46.491221295s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532343561 (21h20m46.491440809s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532583609 (21h20m46.491680858s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532864065 (21h20m46.491961313s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.533156437 (21h20m46.492253687s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.534823974 (21h20m46.493921228s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535250307 (21h20m46.49434756s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535559299 (21h20m46.494656553s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535837647 (21h20m46.494934895s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536118055 (21h20m46.49521531s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536400154 (21h20m46.495497408s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536728580 (21h20m46.49582583s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:25.115155363 (21h20m47.074252619s) [upload=22253]: Next returned nil segment
Aug 9 14:46:25.115181432 (21h20m47.074278688s) [upload=22253]: Waiting for error group managing segments...
Aug 9 14:46:25.260151754 (21h20m47.219249009s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.261076628 (21h20m47.220173863s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.274754683 (21h20m47.233851938s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.279129678 (21h20m47.238226933s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.282432070 (21h20m47.241529301s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.286575156 (21h20m47.245672405s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.289151420 (21h20m47.248248659s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.290606829 (21h20m47.249704067s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.300168722 (21h20m47.259265959s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.303175304 (21h20m47.262272546s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.310567037 (21h20m47.269664269s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.348301827 (21h20m47.307399062s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.370482766 (21h20m47.329580001s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430139752 (21h20m47.389236987s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430170139 (21h20m47.389267384s) [seg_pos={0 0}, upload=22253]: Segment reached optimal threshold of 14 pieces.
Aug 9 14:46:25.430332159 (21h20m47.389429399s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pr9AH19VocE1DGtjnME5D5KgPjuHQiwWAwkcSzPKVDktgWmQh): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430406693 (21h20m47.389503933s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430456591 (21h20m47.389553827s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection
Aug 9 14:46:25.430529038 (21h20m47.389626276s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection
Aug 9 14:46:25.430553149 (21h20m47.389650395s) [seg_pos={0 0}, upload=22253]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 14:46:25.430644925 (21h20m47.38974217s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 14:46:25.430650989 (21h20m47.389748239s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 14:46:25.742143065 (21h20m47.701240312s) [upload=22253]: Done uploading segments...
Aug 9 14:46:25.742163480 (21h20m47.701260715s) [upload=22253]: Upload finished. err: <nil>
Duration: 2.682055394s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X........................X................] duration:
2.56977826s
FAIL (2025-08-09 14:58:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 69ba31d6f12c4cf76088340619036d4db38f204c1d0bff08be6ddabdd500f15e != before 755bb27d731fa6afa9063572e06708265d48342f49a6262cbc779783a2d068f0
======LOGS======
Aug 9 14:46:24.327546771 (21h20m46.286644029s) [upload=22253]: Starting upload
Aug 9 14:46:24.327636609 (21h20m46.286733855s) [upload=22253]: Done starting upload
Aug 9 14:46:24.327747841 (21h20m46.286845083s) [upload=22253]: Uploading segments...
Aug 9 14:46:24.328028303 (21h20m46.287125549s) [upload=22253]: Got next segment. Inline: false
Aug 9 14:46:24.328112804 (21h20m46.287210057s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 14:46:24.328122509 (21h20m46.287219762s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 14:46:24.529038307 (21h20m46.488135553s) [seg_pos={0 0}, upload=22253]: Begin upload segment...
Aug 9 14:46:24.529092647 (21h20m46.488189894s) [seg_pos={0 0}, upload=22253]: Done begin upload segment.
Aug 9 14:46:24.529119310 (21h20m46.48821656s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.530347569 (21h20m46.489444824s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531041055 (21h20m46.49013831s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531360175 (21h20m46.490457426s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531639434 (21h20m46.490736682s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531875544 (21h20m46.490972792s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532124047 (21h20m46.491221295s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532343561 (21h20m46.491440809s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532583609 (21h20m46.491680858s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532864065 (21h20m46.491961313s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.533156437 (21h20m46.492253687s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.534823974 (21h20m46.493921228s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535250307 (21h20m46.49434756s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535559299 (21h20m46.494656553s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535837647 (21h20m46.494934895s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536118055 (21h20m46.49521531s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536400154 (21h20m46.495497408s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536728580 (21h20m46.49582583s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:25.115155363 (21h20m47.074252619s) [upload=22253]: Next returned nil segment
Aug 9 14:46:25.115181432 (21h20m47.074278688s) [upload=22253]: Waiting for error group managing segments...
Aug 9 14:46:25.260151754 (21h20m47.219249009s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.261076628 (21h20m47.220173863s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.274754683 (21h20m47.233851938s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.279129678 (21h20m47.238226933s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.282432070 (21h20m47.241529301s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.286575156 (21h20m47.245672405s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.289151420 (21h20m47.248248659s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.290606829 (21h20m47.249704067s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.300168722 (21h20m47.259265959s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.303175304 (21h20m47.262272546s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.310567037 (21h20m47.269664269s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.348301827 (21h20m47.307399062s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.370482766 (21h20m47.329580001s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430139752 (21h20m47.389236987s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430170139 (21h20m47.389267384s) [seg_pos={0 0}, upload=22253]: Segment reached optimal threshold of 14 pieces.
Aug 9 14:46:25.430332159 (21h20m47.389429399s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pr9AH19VocE1DGtjnME5D5KgPjuHQiwWAwkcSzPKVDktgWmQh): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430406693 (21h20m47.389503933s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430456591 (21h20m47.389553827s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection
Aug 9 14:46:25.430529038 (21h20m47.389626276s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection
Aug 9 14:46:25.430553149 (21h20m47.389650395s) [seg_pos={0 0}, upload=22253]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 14:46:25.430644925 (21h20m47.38974217s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 14:46:25.430650989 (21h20m47.389748239s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 14:46:25.742143065 (21h20m47.701240312s) [upload=22253]: Done uploading segments...
Aug 9 14:46:25.742163480 (21h20m47.701260715s) [upload=22253]: Upload finished. err: <nil>
Duration: 2.569804196s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X................................................X..] duration:
861.12946ms
FAIL (2025-08-09 14:57:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 861.1624ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X........................X...............] duration:
2.580652013s
FAIL (2025-08-09 14:57:30 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 69ba31d6f12c4cf76088340619036d4db38f204c1d0bff08be6ddabdd500f15e != before 755bb27d731fa6afa9063572e06708265d48342f49a6262cbc779783a2d068f0
======LOGS======
Aug 9 14:46:24.327546771 (21h20m46.286644029s) [upload=22253]: Starting upload
Aug 9 14:46:24.327636609 (21h20m46.286733855s) [upload=22253]: Done starting upload
Aug 9 14:46:24.327747841 (21h20m46.286845083s) [upload=22253]: Uploading segments...
Aug 9 14:46:24.328028303 (21h20m46.287125549s) [upload=22253]: Got next segment. Inline: false
Aug 9 14:46:24.328112804 (21h20m46.287210057s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 14:46:24.328122509 (21h20m46.287219762s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 14:46:24.529038307 (21h20m46.488135553s) [seg_pos={0 0}, upload=22253]: Begin upload segment...
Aug 9 14:46:24.529092647 (21h20m46.488189894s) [seg_pos={0 0}, upload=22253]: Done begin upload segment.
Aug 9 14:46:24.529119310 (21h20m46.48821656s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.530347569 (21h20m46.489444824s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531041055 (21h20m46.49013831s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531360175 (21h20m46.490457426s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531639434 (21h20m46.490736682s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.531875544 (21h20m46.490972792s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532124047 (21h20m46.491221295s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532343561 (21h20m46.491440809s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532583609 (21h20m46.491680858s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.532864065 (21h20m46.491961313s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.533156437 (21h20m46.492253687s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.534823974 (21h20m46.493921228s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535250307 (21h20m46.49434756s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535559299 (21h20m46.494656553s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.535837647 (21h20m46.494934895s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536118055 (21h20m46.49521531s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536400154 (21h20m46.495497408s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:24.536728580 (21h20m46.49582583s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Uploading piece...
Aug 9 14:46:25.115155363 (21h20m47.074252619s) [upload=22253]: Next returned nil segment
Aug 9 14:46:25.115181432 (21h20m47.074278688s) [upload=22253]: Waiting for error group managing segments...
Aug 9 14:46:25.260151754 (21h20m47.219249009s) [noise=true , address=104.36.82.55:4206 , piece_id=F3HZB6QXHONEKATSMTXUD6PXQKXFQ3G3YZPAWMSN5VXTDEIUZMDQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.261076628 (21h20m47.220173863s) [noise=true , address=104.36.82.9:4032 , piece_id=WGPP7G56EXKAPOF4EAXK2L4ITDV7AG2OJIVAVIVQQKOPWVO3ME6Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.274754683 (21h20m47.233851938s) [noise=true , address=104.36.82.37:4687 , piece_id=FUJIUEM36XFRJ2KEKDJE4PGPLBSS2YSQOATYTUFYFA4PBAAXWXWA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.279129678 (21h20m47.238226933s) [noise=true , address=104.36.82.17:4335 , piece_id=ZATC4N7Q7AISDYDH5VE5UJTD23WTHWVLIGBQOVOYNBRNPKQPTJ2A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.282432070 (21h20m47.241529301s) [noise=true , address=77.90.31.16:4755 , piece_id=V3ACVIYOYC2Q4OZAPDZZHMBRZT3G6BYGE5V3RTST4YTOZGWU5ZVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.286575156 (21h20m47.245672405s) [noise=true , address=104.36.82.10:4083 , piece_id=JA56DHMMLTCD5FYJ4XJZFSFXDGPC6G7VGC3QT6NCJ4SN5ZVM47HA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.289151420 (21h20m47.248248659s) [noise=true , address=104.36.82.61:4408 , piece_id=DE45JPRTEU2VPBNWBE6IARGVKVQYJPJBHYLCIO4IX6QGGCSMHLMQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.290606829 (21h20m47.249704067s) [noise=true , address=45.91.116.6:4005 , piece_id=ENM73UX5JVMEMBOFVNBCZ45R7KHL5VTJ2SNA65ORO4IVGTEK2FDA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.300168722 (21h20m47.259265959s) [noise=true , address=104.36.82.23:4469 , piece_id=CYQ2TOSMH6WHYCTGQE7WCCXBP4TFPBRKIZ6YNFGB65FJHJ7WFRAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.303175304 (21h20m47.262272546s) [noise=true , address=104.36.82.15:4290 , piece_id=UAPLCNQGNIA4NIFP3BKG7KOYUUIVF4FIOHL2HKN37JOQEHCAOZ6A, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.310567037 (21h20m47.269664269s) [noise=true , address=104.36.82.12:4165 , piece_id=IYSWDEQRCT67X4OTYN6TNBA3FNXE44WEV4AL2BA6TIYFNPUDSDVA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.348301827 (21h20m47.307399062s) [noise=true , address=104.36.82.14:4236 , piece_id=ND6ZSW7XM6XLWBO2XZGZA3JRTO75BALK5CMFCTDDP4LRWK7IU45Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.370482766 (21h20m47.329580001s) [noise=true , address=104.36.82.59:4318 , piece_id=OLVFLCB7A2N2JUL5H2LRKW62X25M4QNVCHORGTKEFLB5TLX5UFCQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430139752 (21h20m47.389236987s) [noise=true , address=104.36.82.44:4878 , piece_id=DDLYSFVD5ZQQN7HGA3OXZTANDBZR7BUXA3DV7HX7KSBCGKASLXZA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: <nil>
Aug 9 14:46:25.430170139 (21h20m47.389267384s) [seg_pos={0 0}, upload=22253]: Segment reached optimal threshold of 14 pieces.
Aug 9 14:46:25.430332159 (21h20m47.389429399s) [noise=true , address=79.127.201.214:4295 , piece_id=EU7CEFSFQDUSTHIW6HHYP4S4OE2VJ4TVRQ3CJUFTXCPHSGOAEM5Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pr9AH19VocE1DGtjnME5D5KgPjuHQiwWAwkcSzPKVDktgWmQh): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430406693 (21h20m47.389503933s) [noise=true , address=79.127.201.215:4353 , piece_id=HRUQIVSVDYUBHJ45P4DTDZUFMLGYFFKRYX6B6WTURYPSPWO6WNJA, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 9 14:46:25.430456591 (21h20m47.389553827s) [noise=true , address=104.36.82.16:4297 , piece_id=XQRJACRO75F4MTGTA7DZC6R6B6PFMA6LSHGOH7XJJ42MVY5VKKAQ, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41120->104.36.82.16:4297: use of closed network connection
Aug 9 14:46:25.430529038 (21h20m47.389626276s) [noise=true , address=79.127.205.233:4625 , piece_id=LYQ7OVCKSEWHYJIS6VYP25XVYWL2DP4FRDZM6HRR4W4TRUJOPU4Q, seg_pos={0 0}, upload=22253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56132->79.127.205.233:4625: use of closed network connection
Aug 9 14:46:25.430553149 (21h20m47.389650395s) [seg_pos={0 0}, upload=22253]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 14:46:25.430644925 (21h20m47.38974217s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 14:46:25.430650989 (21h20m47.389748239s) [upload=22253]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 14:46:25.742143065 (21h20m47.701240312s) [upload=22253]: Done uploading segments...
Aug 9 14:46:25.742163480 (21h20m47.701260715s) [upload=22253]: Upload finished. err: <nil>
Duration: 2.580681427s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X................................................X.] duration:
2.047563525s
FAIL (2025-08-09 14:56:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 14:55:31.735999410 (21h29m53.695096655s) [upload=22409]: Starting upload Aug 9 14:55:31.736083445 (21h29m53.695180695s) [upload=22409]: Done starting upload Aug 9 14:55:31.736174576 (21h29m53.695271808s) [upload=22409]: Uploading segments... Aug 9 14:55:31.736235302 (21h29m53.695332558s) [upload=22409]: Got next segment. Inline: true Aug 9 14:55:31.736242214 (21h29m53.69533947s) [upload=22409]: Waiting for error group managing segments... Aug 9 14:55:31.736296621 (21h29m53.695393866s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 14:55:31.736302956 (21h29m53.695400206s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 14:55:31.736307396 (21h29m53.695404645s) [upload=22409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 14:55:31.824719967 (21h29m53.783817215s) [upload=22409]: Done uploading segments... Aug 9 14:55:31.824738557 (21h29m53.783835789s) [upload=22409]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.047594489s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|