Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X.................X.................X...X............] duration:
930.766265ms
FAIL (2025-08-17 18:20:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:11:42.025857870 (216h46m3.984955115s) [upload=225703]: Starting upload Aug 17 18:11:42.026093027 (216h46m3.985190275s) [upload=225703]: Done starting upload Aug 17 18:11:42.026160662 (216h46m3.985257897s) [upload=225703]: Uploading segments... Aug 17 18:11:42.026785732 (216h46m3.985883005s) [upload=225703]: Got next segment. Inline: true Aug 17 18:11:42.026792101 (216h46m3.985889342s) [upload=225703]: Waiting for error group managing segments... Aug 17 18:11:42.026859447 (216h46m3.985956693s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:11:42.026864195 (216h46m3.985961426s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:11:42.026866916 (216h46m3.985964148s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:11:42.163913044 (216h46m4.12301029s) [upload=225703]: Done uploading segments... Aug 17 18:11:42.163943798 (216h46m4.123041047s) [upload=225703]: Upload finished. err: metaclient: Too Many Requests
Duration: 930.858629ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X...............X...X..........................X.........] duration:
2.696884883s
FAIL (2025-08-17 18:19:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:13:39.645284777 (216h48m1.604382023s) [upload=225738]: Starting upload Aug 17 18:13:39.645344613 (216h48m1.604441864s) [upload=225738]: Done starting upload Aug 17 18:13:39.645630737 (216h48m1.604727975s) [upload=225738]: Uploading segments... Aug 17 18:13:39.645696750 (216h48m1.604793997s) [upload=225738]: Got next segment. Inline: false Aug 17 18:13:39.645755386 (216h48m1.604852632s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:13:39.645760905 (216h48m1.604858151s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:13:39.768739873 (216h48m1.727837124s) [upload=225738]: Next segment err: metaclient: Too Many Requests Aug 17 18:13:39.768778146 (216h48m1.727875391s) [upload=225738]: Done uploading segments... Aug 17 18:13:39.768795419 (216h48m1.727892654s) [upload=225738]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.696936784s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X.................X.................X...X...........] duration:
902.506193ms
FAIL (2025-08-17 18:19:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:11:42.025857870 (216h46m3.984955115s) [upload=225703]: Starting upload Aug 17 18:11:42.026093027 (216h46m3.985190275s) [upload=225703]: Done starting upload Aug 17 18:11:42.026160662 (216h46m3.985257897s) [upload=225703]: Uploading segments... Aug 17 18:11:42.026785732 (216h46m3.985883005s) [upload=225703]: Got next segment. Inline: true Aug 17 18:11:42.026792101 (216h46m3.985889342s) [upload=225703]: Waiting for error group managing segments... Aug 17 18:11:42.026859447 (216h46m3.985956693s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:11:42.026864195 (216h46m3.985961426s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:11:42.026866916 (216h46m3.985964148s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:11:42.163913044 (216h46m4.12301029s) [upload=225703]: Done uploading segments... Aug 17 18:11:42.163943798 (216h46m4.123041047s) [upload=225703]: Upload finished. err: metaclient: Too Many Requests
Duration: 902.533426ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X...............X...X..........................X........] duration:
2.673690466s
FAIL (2025-08-17 18:19:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:13:39.645284777 (216h48m1.604382023s) [upload=225738]: Starting upload Aug 17 18:13:39.645344613 (216h48m1.604441864s) [upload=225738]: Done starting upload Aug 17 18:13:39.645630737 (216h48m1.604727975s) [upload=225738]: Uploading segments... Aug 17 18:13:39.645696750 (216h48m1.604793997s) [upload=225738]: Got next segment. Inline: false Aug 17 18:13:39.645755386 (216h48m1.604852632s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:13:39.645760905 (216h48m1.604858151s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:13:39.768739873 (216h48m1.727837124s) [upload=225738]: Next segment err: metaclient: Too Many Requests Aug 17 18:13:39.768778146 (216h48m1.727875391s) [upload=225738]: Done uploading segments... Aug 17 18:13:39.768795419 (216h48m1.727892654s) [upload=225738]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.67371876s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X.................X.................X...X..........] duration:
891.964646ms
FAIL (2025-08-17 18:18:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:11:42.025857870 (216h46m3.984955115s) [upload=225703]: Starting upload Aug 17 18:11:42.026093027 (216h46m3.985190275s) [upload=225703]: Done starting upload Aug 17 18:11:42.026160662 (216h46m3.985257897s) [upload=225703]: Uploading segments... Aug 17 18:11:42.026785732 (216h46m3.985883005s) [upload=225703]: Got next segment. Inline: true Aug 17 18:11:42.026792101 (216h46m3.985889342s) [upload=225703]: Waiting for error group managing segments... Aug 17 18:11:42.026859447 (216h46m3.985956693s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:11:42.026864195 (216h46m3.985961426s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:11:42.026866916 (216h46m3.985964148s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:11:42.163913044 (216h46m4.12301029s) [upload=225703]: Done uploading segments... Aug 17 18:11:42.163943798 (216h46m4.123041047s) [upload=225703]: Upload finished. err: metaclient: Too Many Requests
Duration: 892.01668ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X.................X.................X...X.........] duration:
1.086162052s
FAIL (2025-08-17 18:18:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:11:42.025857870 (216h46m3.984955115s) [upload=225703]: Starting upload Aug 17 18:11:42.026093027 (216h46m3.985190275s) [upload=225703]: Done starting upload Aug 17 18:11:42.026160662 (216h46m3.985257897s) [upload=225703]: Uploading segments... Aug 17 18:11:42.026785732 (216h46m3.985883005s) [upload=225703]: Got next segment. Inline: true Aug 17 18:11:42.026792101 (216h46m3.985889342s) [upload=225703]: Waiting for error group managing segments... Aug 17 18:11:42.026859447 (216h46m3.985956693s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:11:42.026864195 (216h46m3.985961426s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:11:42.026866916 (216h46m3.985964148s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:11:42.163913044 (216h46m4.12301029s) [upload=225703]: Done uploading segments... Aug 17 18:11:42.163943798 (216h46m4.123041047s) [upload=225703]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.086223332s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X...............X...X..........................X.......] duration:
2.598291523s
FAIL (2025-08-17 18:18:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:13:39.645284777 (216h48m1.604382023s) [upload=225738]: Starting upload Aug 17 18:13:39.645344613 (216h48m1.604441864s) [upload=225738]: Done starting upload Aug 17 18:13:39.645630737 (216h48m1.604727975s) [upload=225738]: Uploading segments... Aug 17 18:13:39.645696750 (216h48m1.604793997s) [upload=225738]: Got next segment. Inline: false Aug 17 18:13:39.645755386 (216h48m1.604852632s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:13:39.645760905 (216h48m1.604858151s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:13:39.768739873 (216h48m1.727837124s) [upload=225738]: Next segment err: metaclient: Too Many Requests Aug 17 18:13:39.768778146 (216h48m1.727875391s) [upload=225738]: Done uploading segments... Aug 17 18:13:39.768795419 (216h48m1.727892654s) [upload=225738]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.598332455s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X...............X...X..........................X......] duration:
2.539099395s
FAIL (2025-08-17 18:17:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:13:39.645284777 (216h48m1.604382023s) [upload=225738]: Starting upload Aug 17 18:13:39.645344613 (216h48m1.604441864s) [upload=225738]: Done starting upload Aug 17 18:13:39.645630737 (216h48m1.604727975s) [upload=225738]: Uploading segments... Aug 17 18:13:39.645696750 (216h48m1.604793997s) [upload=225738]: Got next segment. Inline: false Aug 17 18:13:39.645755386 (216h48m1.604852632s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:13:39.645760905 (216h48m1.604858151s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:13:39.768739873 (216h48m1.727837124s) [upload=225738]: Next segment err: metaclient: Too Many Requests Aug 17 18:13:39.768778146 (216h48m1.727875391s) [upload=225738]: Done uploading segments... Aug 17 18:13:39.768795419 (216h48m1.727892654s) [upload=225738]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.539134162s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X.................X.................X...X........] duration:
935.431432ms
FAIL (2025-08-17 18:17:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:11:42.025857870 (216h46m3.984955115s) [upload=225703]: Starting upload Aug 17 18:11:42.026093027 (216h46m3.985190275s) [upload=225703]: Done starting upload Aug 17 18:11:42.026160662 (216h46m3.985257897s) [upload=225703]: Uploading segments... Aug 17 18:11:42.026785732 (216h46m3.985883005s) [upload=225703]: Got next segment. Inline: true Aug 17 18:11:42.026792101 (216h46m3.985889342s) [upload=225703]: Waiting for error group managing segments... Aug 17 18:11:42.026859447 (216h46m3.985956693s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:11:42.026864195 (216h46m3.985961426s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:11:42.026866916 (216h46m3.985964148s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:11:42.163913044 (216h46m4.12301029s) [upload=225703]: Done uploading segments... Aug 17 18:11:42.163943798 (216h46m4.123041047s) [upload=225703]: Upload finished. err: metaclient: Too Many Requests
Duration: 935.481394ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X.................X.................X...X.......] duration:
1.030420222s
FAIL (2025-08-17 18:16:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:11:42.025857870 (216h46m3.984955115s) [upload=225703]: Starting upload Aug 17 18:11:42.026093027 (216h46m3.985190275s) [upload=225703]: Done starting upload Aug 17 18:11:42.026160662 (216h46m3.985257897s) [upload=225703]: Uploading segments... Aug 17 18:11:42.026785732 (216h46m3.985883005s) [upload=225703]: Got next segment. Inline: true Aug 17 18:11:42.026792101 (216h46m3.985889342s) [upload=225703]: Waiting for error group managing segments... Aug 17 18:11:42.026859447 (216h46m3.985956693s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:11:42.026864195 (216h46m3.985961426s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:11:42.026866916 (216h46m3.985964148s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:11:42.163913044 (216h46m4.12301029s) [upload=225703]: Done uploading segments... Aug 17 18:11:42.163943798 (216h46m4.123041047s) [upload=225703]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.030448556s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X...............X...X..........................X.....] duration:
2.883702804s
FAIL (2025-08-17 18:16:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:13:39.645284777 (216h48m1.604382023s) [upload=225738]: Starting upload Aug 17 18:13:39.645344613 (216h48m1.604441864s) [upload=225738]: Done starting upload Aug 17 18:13:39.645630737 (216h48m1.604727975s) [upload=225738]: Uploading segments... Aug 17 18:13:39.645696750 (216h48m1.604793997s) [upload=225738]: Got next segment. Inline: false Aug 17 18:13:39.645755386 (216h48m1.604852632s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:13:39.645760905 (216h48m1.604858151s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:13:39.768739873 (216h48m1.727837124s) [upload=225738]: Next segment err: metaclient: Too Many Requests Aug 17 18:13:39.768778146 (216h48m1.727875391s) [upload=225738]: Done uploading segments... Aug 17 18:13:39.768795419 (216h48m1.727892654s) [upload=225738]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.883741179s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X...............X...X..........................X....] duration:
2.885804331s
FAIL (2025-08-17 18:15:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:13:39.645284777 (216h48m1.604382023s) [upload=225738]: Starting upload Aug 17 18:13:39.645344613 (216h48m1.604441864s) [upload=225738]: Done starting upload Aug 17 18:13:39.645630737 (216h48m1.604727975s) [upload=225738]: Uploading segments... Aug 17 18:13:39.645696750 (216h48m1.604793997s) [upload=225738]: Got next segment. Inline: false Aug 17 18:13:39.645755386 (216h48m1.604852632s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:13:39.645760905 (216h48m1.604858151s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:13:39.768739873 (216h48m1.727837124s) [upload=225738]: Next segment err: metaclient: Too Many Requests Aug 17 18:13:39.768778146 (216h48m1.727875391s) [upload=225738]: Done uploading segments... Aug 17 18:13:39.768795419 (216h48m1.727892654s) [upload=225738]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.885839464s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X.................X.................X...X......] duration:
1.676556125s
FAIL (2025-08-17 18:15:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:11:42.025857870 (216h46m3.984955115s) [upload=225703]: Starting upload Aug 17 18:11:42.026093027 (216h46m3.985190275s) [upload=225703]: Done starting upload Aug 17 18:11:42.026160662 (216h46m3.985257897s) [upload=225703]: Uploading segments... Aug 17 18:11:42.026785732 (216h46m3.985883005s) [upload=225703]: Got next segment. Inline: true Aug 17 18:11:42.026792101 (216h46m3.985889342s) [upload=225703]: Waiting for error group managing segments... Aug 17 18:11:42.026859447 (216h46m3.985956693s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:11:42.026864195 (216h46m3.985961426s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:11:42.026866916 (216h46m3.985964148s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:11:42.163913044 (216h46m4.12301029s) [upload=225703]: Done uploading segments... Aug 17 18:11:42.163943798 (216h46m4.123041047s) [upload=225703]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.676586995s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........X...............X...X..........................X...] duration:
2.950152142s
FAIL (2025-08-17 18:15:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:13:39.645284777 (216h48m1.604382023s) [upload=225738]: Starting upload Aug 17 18:13:39.645344613 (216h48m1.604441864s) [upload=225738]: Done starting upload Aug 17 18:13:39.645630737 (216h48m1.604727975s) [upload=225738]: Uploading segments... Aug 17 18:13:39.645696750 (216h48m1.604793997s) [upload=225738]: Got next segment. Inline: false Aug 17 18:13:39.645755386 (216h48m1.604852632s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:13:39.645760905 (216h48m1.604858151s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:13:39.768739873 (216h48m1.727837124s) [upload=225738]: Next segment err: metaclient: Too Many Requests Aug 17 18:13:39.768778146 (216h48m1.727875391s) [upload=225738]: Done uploading segments... Aug 17 18:13:39.768795419 (216h48m1.727892654s) [upload=225738]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.950189728s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X.................X.................X...X.....] duration:
1.796794867s
FAIL (2025-08-17 18:15:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:11:42.025857870 (216h46m3.984955115s) [upload=225703]: Starting upload Aug 17 18:11:42.026093027 (216h46m3.985190275s) [upload=225703]: Done starting upload Aug 17 18:11:42.026160662 (216h46m3.985257897s) [upload=225703]: Uploading segments... Aug 17 18:11:42.026785732 (216h46m3.985883005s) [upload=225703]: Got next segment. Inline: true Aug 17 18:11:42.026792101 (216h46m3.985889342s) [upload=225703]: Waiting for error group managing segments... Aug 17 18:11:42.026859447 (216h46m3.985956693s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:11:42.026864195 (216h46m3.985961426s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:11:42.026866916 (216h46m3.985964148s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:11:42.163913044 (216h46m4.12301029s) [upload=225703]: Done uploading segments... Aug 17 18:11:42.163943798 (216h46m4.123041047s) [upload=225703]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.796844746s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X..............X.................X.................X...X....] duration:
1.553834856s
FAIL (2025-08-17 18:14:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:11:42.025857870 (216h46m3.984955115s) [upload=225703]: Starting upload Aug 17 18:11:42.026093027 (216h46m3.985190275s) [upload=225703]: Done starting upload Aug 17 18:11:42.026160662 (216h46m3.985257897s) [upload=225703]: Uploading segments... Aug 17 18:11:42.026785732 (216h46m3.985883005s) [upload=225703]: Got next segment. Inline: true Aug 17 18:11:42.026792101 (216h46m3.985889342s) [upload=225703]: Waiting for error group managing segments... Aug 17 18:11:42.026859447 (216h46m3.985956693s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:11:42.026864195 (216h46m3.985961426s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:11:42.026866916 (216h46m3.985964148s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:11:42.163913044 (216h46m4.12301029s) [upload=225703]: Done uploading segments... Aug 17 18:11:42.163943798 (216h46m4.123041047s) [upload=225703]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.553874169s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........X...............X...X..........................X..] duration:
3.105544068s
FAIL (2025-08-17 18:14:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:13:39.645284777 (216h48m1.604382023s) [upload=225738]: Starting upload Aug 17 18:13:39.645344613 (216h48m1.604441864s) [upload=225738]: Done starting upload Aug 17 18:13:39.645630737 (216h48m1.604727975s) [upload=225738]: Uploading segments... Aug 17 18:13:39.645696750 (216h48m1.604793997s) [upload=225738]: Got next segment. Inline: false Aug 17 18:13:39.645755386 (216h48m1.604852632s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:13:39.645760905 (216h48m1.604858151s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:13:39.768739873 (216h48m1.727837124s) [upload=225738]: Next segment err: metaclient: Too Many Requests Aug 17 18:13:39.768778146 (216h48m1.727875391s) [upload=225738]: Done uploading segments... Aug 17 18:13:39.768795419 (216h48m1.727892654s) [upload=225738]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.105572535s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........X...............X...X..........................X.] duration:
2.647031529s
FAIL (2025-08-17 18:14:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:13:39.645284777 (216h48m1.604382023s) [upload=225738]: Starting upload Aug 17 18:13:39.645344613 (216h48m1.604441864s) [upload=225738]: Done starting upload Aug 17 18:13:39.645630737 (216h48m1.604727975s) [upload=225738]: Uploading segments... Aug 17 18:13:39.645696750 (216h48m1.604793997s) [upload=225738]: Got next segment. Inline: false Aug 17 18:13:39.645755386 (216h48m1.604852632s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:13:39.645760905 (216h48m1.604858151s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:13:39.768739873 (216h48m1.727837124s) [upload=225738]: Next segment err: metaclient: Too Many Requests Aug 17 18:13:39.768778146 (216h48m1.727875391s) [upload=225738]: Done uploading segments... Aug 17 18:13:39.768795419 (216h48m1.727892654s) [upload=225738]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.647067222s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X..............X.................X.................X...X...] duration:
992.279897ms
FAIL (2025-08-17 18:13:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:11:42.025857870 (216h46m3.984955115s) [upload=225703]: Starting upload Aug 17 18:11:42.026093027 (216h46m3.985190275s) [upload=225703]: Done starting upload Aug 17 18:11:42.026160662 (216h46m3.985257897s) [upload=225703]: Uploading segments... Aug 17 18:11:42.026785732 (216h46m3.985883005s) [upload=225703]: Got next segment. Inline: true Aug 17 18:11:42.026792101 (216h46m3.985889342s) [upload=225703]: Waiting for error group managing segments... Aug 17 18:11:42.026859447 (216h46m3.985956693s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:11:42.026864195 (216h46m3.985961426s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:11:42.026866916 (216h46m3.985964148s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:11:42.163913044 (216h46m4.12301029s) [upload=225703]: Done uploading segments... Aug 17 18:11:42.163943798 (216h46m4.123041047s) [upload=225703]: Upload finished. err: metaclient: Too Many Requests
Duration: 992.317833ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [............X...............X...X..........................X] duration:
398.222864ms
FAIL (2025-08-17 18:13:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:13:39.645284777 (216h48m1.604382023s) [upload=225738]: Starting upload Aug 17 18:13:39.645344613 (216h48m1.604441864s) [upload=225738]: Done starting upload Aug 17 18:13:39.645630737 (216h48m1.604727975s) [upload=225738]: Uploading segments... Aug 17 18:13:39.645696750 (216h48m1.604793997s) [upload=225738]: Got next segment. Inline: false Aug 17 18:13:39.645755386 (216h48m1.604852632s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:13:39.645760905 (216h48m1.604858151s) [upload=225738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 18:13:39.768739873 (216h48m1.727837124s) [upload=225738]: Next segment err: metaclient: Too Many Requests Aug 17 18:13:39.768778146 (216h48m1.727875391s) [upload=225738]: Done uploading segments... Aug 17 18:13:39.768795419 (216h48m1.727892654s) [upload=225738]: Upload finished. err: metaclient: Too Many Requests
Duration: 398.24457ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X..............X.................X.................X...X..] duration:
1.030875868s
FAIL (2025-08-17 18:13:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:11:42.025857870 (216h46m3.984955115s) [upload=225703]: Starting upload Aug 17 18:11:42.026093027 (216h46m3.985190275s) [upload=225703]: Done starting upload Aug 17 18:11:42.026160662 (216h46m3.985257897s) [upload=225703]: Uploading segments... Aug 17 18:11:42.026785732 (216h46m3.985883005s) [upload=225703]: Got next segment. Inline: true Aug 17 18:11:42.026792101 (216h46m3.985889342s) [upload=225703]: Waiting for error group managing segments... Aug 17 18:11:42.026859447 (216h46m3.985956693s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:11:42.026864195 (216h46m3.985961426s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:11:42.026866916 (216h46m3.985964148s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:11:42.163913044 (216h46m4.12301029s) [upload=225703]: Done uploading segments... Aug 17 18:11:42.163943798 (216h46m4.123041047s) [upload=225703]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.030911747s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X...............X...X..........................] duration:
2.556055672s
FAIL (2025-08-17 18:12:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:54:56.910242388 (216h29m18.869339647s) [upload=225414]: Starting upload
Aug 17 17:54:56.910346363 (216h29m18.869443611s) [upload=225414]: Done starting upload
Aug 17 17:54:56.910592380 (216h29m18.869689634s) [upload=225414]: Uploading segments...
Aug 17 17:54:56.910774401 (216h29m18.869871673s) [upload=225414]: Got next segment. Inline: false
Aug 17 17:54:56.910874125 (216h29m18.869971398s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:54:56.910882610 (216h29m18.869979901s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:54:57.111146615 (216h29m19.070243865s) [seg_pos={0 0}, upload=225414]: Begin upload segment...
Aug 17 17:54:57.111213660 (216h29m19.070310906s) [seg_pos={0 0}, upload=225414]: Done begin upload segment.
Aug 17 17:54:57.111249315 (216h29m19.070346561s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112064139 (216h29m19.071161388s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112587186 (216h29m19.071684444s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113084792 (216h29m19.072182039s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113558948 (216h29m19.072656274s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114047415 (216h29m19.073144674s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114605691 (216h29m19.073702941s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114974808 (216h29m19.074072057s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115315904 (216h29m19.074413158s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115743712 (216h29m19.074840959s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116132198 (216h29m19.075229448s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116482202 (216h29m19.075579457s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116805842 (216h29m19.07590309s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117031876 (216h29m19.07612913s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117707837 (216h29m19.076805096s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.118485640 (216h29m19.077582897s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119068244 (216h29m19.078165502s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119585875 (216h29m19.078683131s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.680745192 (216h29m19.639842438s) [upload=225414]: Next returned nil segment
Aug 17 17:54:57.680761285 (216h29m19.639858529s) [upload=225414]: Waiting for error group managing segments...
Aug 17 17:54:57.845470529 (216h29m19.804567777s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.849020399 (216h29m19.808117634s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.857547681 (216h29m19.816644913s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.860270755 (216h29m19.819367992s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.862896987 (216h29m19.821994225s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.863099946 (216h29m19.822197206s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871626479 (216h29m19.830723731s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871873189 (216h29m19.830970421s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.872997484 (216h29m19.832094716s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.916986864 (216h29m19.876084112s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.918384963 (216h29m19.877482195s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.972661918 (216h29m19.931759283s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.984719175 (216h29m19.943816427s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033694344 (216h29m19.992791582s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033732846 (216h29m19.992830093s) [seg_pos={0 0}, upload=225414]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:54:58.034040813 (216h29m19.993138049s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034068341 (216h29m19.993165577s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034146397 (216h29m19.993243631s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mg8ujbdjncZ8aiGM1mL3m7D6B58MGspzMT3qztj5iG4WqHYVk): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034252187 (216h29m19.993349433s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection
Aug 17 17:54:58.034275446 (216h29m19.993372681s) [seg_pos={0 0}, upload=225414]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:54:58.034353252 (216h29m19.993450487s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:54:58.034358061 (216h29m19.993455307s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:54:58.216473979 (216h29m20.175571233s) [upload=225414]: Done uploading segments...
Aug 17 17:54:58.216502767 (216h29m20.175600024s) [upload=225414]: Upload finished. err: <nil>
Duration: 2.556089727s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...X..............X.................X.................X...X.] duration:
927.596051ms
FAIL (2025-08-17 18:12:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:11:42.025857870 (216h46m3.984955115s) [upload=225703]: Starting upload Aug 17 18:11:42.026093027 (216h46m3.985190275s) [upload=225703]: Done starting upload Aug 17 18:11:42.026160662 (216h46m3.985257897s) [upload=225703]: Uploading segments... Aug 17 18:11:42.026785732 (216h46m3.985883005s) [upload=225703]: Got next segment. Inline: true Aug 17 18:11:42.026792101 (216h46m3.985889342s) [upload=225703]: Waiting for error group managing segments... Aug 17 18:11:42.026859447 (216h46m3.985956693s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:11:42.026864195 (216h46m3.985961426s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:11:42.026866916 (216h46m3.985964148s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:11:42.163913044 (216h46m4.12301029s) [upload=225703]: Done uploading segments... Aug 17 18:11:42.163943798 (216h46m4.123041047s) [upload=225703]: Upload finished. err: metaclient: Too Many Requests
Duration: 927.627708ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X...............X...X.........................] duration:
2.579098165s
FAIL (2025-08-17 18:12:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:54:56.910242388 (216h29m18.869339647s) [upload=225414]: Starting upload
Aug 17 17:54:56.910346363 (216h29m18.869443611s) [upload=225414]: Done starting upload
Aug 17 17:54:56.910592380 (216h29m18.869689634s) [upload=225414]: Uploading segments...
Aug 17 17:54:56.910774401 (216h29m18.869871673s) [upload=225414]: Got next segment. Inline: false
Aug 17 17:54:56.910874125 (216h29m18.869971398s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:54:56.910882610 (216h29m18.869979901s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:54:57.111146615 (216h29m19.070243865s) [seg_pos={0 0}, upload=225414]: Begin upload segment...
Aug 17 17:54:57.111213660 (216h29m19.070310906s) [seg_pos={0 0}, upload=225414]: Done begin upload segment.
Aug 17 17:54:57.111249315 (216h29m19.070346561s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112064139 (216h29m19.071161388s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112587186 (216h29m19.071684444s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113084792 (216h29m19.072182039s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113558948 (216h29m19.072656274s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114047415 (216h29m19.073144674s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114605691 (216h29m19.073702941s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114974808 (216h29m19.074072057s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115315904 (216h29m19.074413158s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115743712 (216h29m19.074840959s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116132198 (216h29m19.075229448s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116482202 (216h29m19.075579457s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116805842 (216h29m19.07590309s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117031876 (216h29m19.07612913s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117707837 (216h29m19.076805096s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.118485640 (216h29m19.077582897s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119068244 (216h29m19.078165502s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119585875 (216h29m19.078683131s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.680745192 (216h29m19.639842438s) [upload=225414]: Next returned nil segment
Aug 17 17:54:57.680761285 (216h29m19.639858529s) [upload=225414]: Waiting for error group managing segments...
Aug 17 17:54:57.845470529 (216h29m19.804567777s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.849020399 (216h29m19.808117634s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.857547681 (216h29m19.816644913s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.860270755 (216h29m19.819367992s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.862896987 (216h29m19.821994225s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.863099946 (216h29m19.822197206s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871626479 (216h29m19.830723731s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871873189 (216h29m19.830970421s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.872997484 (216h29m19.832094716s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.916986864 (216h29m19.876084112s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.918384963 (216h29m19.877482195s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.972661918 (216h29m19.931759283s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.984719175 (216h29m19.943816427s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033694344 (216h29m19.992791582s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033732846 (216h29m19.992830093s) [seg_pos={0 0}, upload=225414]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:54:58.034040813 (216h29m19.993138049s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034068341 (216h29m19.993165577s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034146397 (216h29m19.993243631s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mg8ujbdjncZ8aiGM1mL3m7D6B58MGspzMT3qztj5iG4WqHYVk): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034252187 (216h29m19.993349433s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection
Aug 17 17:54:58.034275446 (216h29m19.993372681s) [seg_pos={0 0}, upload=225414]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:54:58.034353252 (216h29m19.993450487s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:54:58.034358061 (216h29m19.993455307s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:54:58.216473979 (216h29m20.175571233s) [upload=225414]: Done uploading segments...
Aug 17 17:54:58.216502767 (216h29m20.175600024s) [upload=225414]: Upload finished. err: <nil>
Duration: 2.579149139s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [....X..............X.................X.................X...X] duration:
410.199756ms
FAIL (2025-08-17 18:11:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 18:11:42.025857870 (216h46m3.984955115s) [upload=225703]: Starting upload Aug 17 18:11:42.026093027 (216h46m3.985190275s) [upload=225703]: Done starting upload Aug 17 18:11:42.026160662 (216h46m3.985257897s) [upload=225703]: Uploading segments... Aug 17 18:11:42.026785732 (216h46m3.985883005s) [upload=225703]: Got next segment. Inline: true Aug 17 18:11:42.026792101 (216h46m3.985889342s) [upload=225703]: Waiting for error group managing segments... Aug 17 18:11:42.026859447 (216h46m3.985956693s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 18:11:42.026864195 (216h46m3.985961426s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 18:11:42.026866916 (216h46m3.985964148s) [upload=225703]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 18:11:42.163913044 (216h46m4.12301029s) [upload=225703]: Done uploading segments... Aug 17 18:11:42.163943798 (216h46m4.123041047s) [upload=225703]: Upload finished. err: metaclient: Too Many Requests
Duration: 410.226001ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X...............X...X........................] duration:
2.459840659s
FAIL (2025-08-17 18:11:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:54:56.910242388 (216h29m18.869339647s) [upload=225414]: Starting upload
Aug 17 17:54:56.910346363 (216h29m18.869443611s) [upload=225414]: Done starting upload
Aug 17 17:54:56.910592380 (216h29m18.869689634s) [upload=225414]: Uploading segments...
Aug 17 17:54:56.910774401 (216h29m18.869871673s) [upload=225414]: Got next segment. Inline: false
Aug 17 17:54:56.910874125 (216h29m18.869971398s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:54:56.910882610 (216h29m18.869979901s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:54:57.111146615 (216h29m19.070243865s) [seg_pos={0 0}, upload=225414]: Begin upload segment...
Aug 17 17:54:57.111213660 (216h29m19.070310906s) [seg_pos={0 0}, upload=225414]: Done begin upload segment.
Aug 17 17:54:57.111249315 (216h29m19.070346561s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112064139 (216h29m19.071161388s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112587186 (216h29m19.071684444s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113084792 (216h29m19.072182039s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113558948 (216h29m19.072656274s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114047415 (216h29m19.073144674s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114605691 (216h29m19.073702941s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114974808 (216h29m19.074072057s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115315904 (216h29m19.074413158s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115743712 (216h29m19.074840959s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116132198 (216h29m19.075229448s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116482202 (216h29m19.075579457s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116805842 (216h29m19.07590309s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117031876 (216h29m19.07612913s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117707837 (216h29m19.076805096s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.118485640 (216h29m19.077582897s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119068244 (216h29m19.078165502s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119585875 (216h29m19.078683131s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.680745192 (216h29m19.639842438s) [upload=225414]: Next returned nil segment
Aug 17 17:54:57.680761285 (216h29m19.639858529s) [upload=225414]: Waiting for error group managing segments...
Aug 17 17:54:57.845470529 (216h29m19.804567777s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.849020399 (216h29m19.808117634s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.857547681 (216h29m19.816644913s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.860270755 (216h29m19.819367992s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.862896987 (216h29m19.821994225s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.863099946 (216h29m19.822197206s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871626479 (216h29m19.830723731s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871873189 (216h29m19.830970421s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.872997484 (216h29m19.832094716s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.916986864 (216h29m19.876084112s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.918384963 (216h29m19.877482195s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.972661918 (216h29m19.931759283s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.984719175 (216h29m19.943816427s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033694344 (216h29m19.992791582s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033732846 (216h29m19.992830093s) [seg_pos={0 0}, upload=225414]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:54:58.034040813 (216h29m19.993138049s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034068341 (216h29m19.993165577s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034146397 (216h29m19.993243631s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mg8ujbdjncZ8aiGM1mL3m7D6B58MGspzMT3qztj5iG4WqHYVk): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034252187 (216h29m19.993349433s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection
Aug 17 17:54:58.034275446 (216h29m19.993372681s) [seg_pos={0 0}, upload=225414]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:54:58.034353252 (216h29m19.993450487s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:54:58.034358061 (216h29m19.993455307s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:54:58.216473979 (216h29m20.175571233s) [upload=225414]: Done uploading segments...
Aug 17 17:54:58.216502767 (216h29m20.175600024s) [upload=225414]: Upload finished. err: <nil>
Duration: 2.459892915s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X...............X...X.......................] duration:
2.951722556s
FAIL (2025-08-17 18:10:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:54:56.910242388 (216h29m18.869339647s) [upload=225414]: Starting upload
Aug 17 17:54:56.910346363 (216h29m18.869443611s) [upload=225414]: Done starting upload
Aug 17 17:54:56.910592380 (216h29m18.869689634s) [upload=225414]: Uploading segments...
Aug 17 17:54:56.910774401 (216h29m18.869871673s) [upload=225414]: Got next segment. Inline: false
Aug 17 17:54:56.910874125 (216h29m18.869971398s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:54:56.910882610 (216h29m18.869979901s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:54:57.111146615 (216h29m19.070243865s) [seg_pos={0 0}, upload=225414]: Begin upload segment...
Aug 17 17:54:57.111213660 (216h29m19.070310906s) [seg_pos={0 0}, upload=225414]: Done begin upload segment.
Aug 17 17:54:57.111249315 (216h29m19.070346561s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112064139 (216h29m19.071161388s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112587186 (216h29m19.071684444s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113084792 (216h29m19.072182039s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113558948 (216h29m19.072656274s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114047415 (216h29m19.073144674s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114605691 (216h29m19.073702941s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114974808 (216h29m19.074072057s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115315904 (216h29m19.074413158s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115743712 (216h29m19.074840959s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116132198 (216h29m19.075229448s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116482202 (216h29m19.075579457s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116805842 (216h29m19.07590309s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117031876 (216h29m19.07612913s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117707837 (216h29m19.076805096s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.118485640 (216h29m19.077582897s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119068244 (216h29m19.078165502s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119585875 (216h29m19.078683131s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.680745192 (216h29m19.639842438s) [upload=225414]: Next returned nil segment
Aug 17 17:54:57.680761285 (216h29m19.639858529s) [upload=225414]: Waiting for error group managing segments...
Aug 17 17:54:57.845470529 (216h29m19.804567777s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.849020399 (216h29m19.808117634s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.857547681 (216h29m19.816644913s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.860270755 (216h29m19.819367992s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.862896987 (216h29m19.821994225s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.863099946 (216h29m19.822197206s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871626479 (216h29m19.830723731s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871873189 (216h29m19.830970421s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.872997484 (216h29m19.832094716s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.916986864 (216h29m19.876084112s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.918384963 (216h29m19.877482195s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.972661918 (216h29m19.931759283s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.984719175 (216h29m19.943816427s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033694344 (216h29m19.992791582s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033732846 (216h29m19.992830093s) [seg_pos={0 0}, upload=225414]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:54:58.034040813 (216h29m19.993138049s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034068341 (216h29m19.993165577s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034146397 (216h29m19.993243631s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mg8ujbdjncZ8aiGM1mL3m7D6B58MGspzMT3qztj5iG4WqHYVk): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034252187 (216h29m19.993349433s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection
Aug 17 17:54:58.034275446 (216h29m19.993372681s) [seg_pos={0 0}, upload=225414]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:54:58.034353252 (216h29m19.993450487s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:54:58.034358061 (216h29m19.993455307s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:54:58.216473979 (216h29m20.175571233s) [upload=225414]: Done uploading segments...
Aug 17 17:54:58.216502767 (216h29m20.175600024s) [upload=225414]: Upload finished. err: <nil>
Duration: 2.951747916s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X..............X.................X.................X...] duration:
906.411963ms
FAIL (2025-08-17 18:10:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:08:45.444174555 (216h43m7.403271805s) [upload=225656]: Starting upload
Aug 17 18:08:45.444265275 (216h43m7.403362528s) [upload=225656]: Done starting upload
Aug 17 18:08:45.444380848 (216h43m7.403478094s) [upload=225656]: Uploading segments...
Aug 17 18:08:45.444456105 (216h43m7.403553361s) [upload=225656]: Got next segment. Inline: true
Aug 17 18:08:45.444463359 (216h43m7.403560608s) [upload=225656]: Waiting for error group managing segments...
Aug 17 18:08:45.444534432 (216h43m7.403631682s) [upload=225656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:45.444540461 (216h43m7.403637708s) [upload=225656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:08:45.444544628 (216h43m7.403641875s) [upload=225656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:46.064899476 (216h43m8.023996726s) [upload=225656]: Done uploading segments...
Aug 17 18:08:46.064919982 (216h43m8.024017214s) [upload=225656]: Upload finished. err: <nil>
Duration: 906.635142ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X...............X...X......................] duration:
2.515968414s
FAIL (2025-08-17 18:09:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:54:56.910242388 (216h29m18.869339647s) [upload=225414]: Starting upload
Aug 17 17:54:56.910346363 (216h29m18.869443611s) [upload=225414]: Done starting upload
Aug 17 17:54:56.910592380 (216h29m18.869689634s) [upload=225414]: Uploading segments...
Aug 17 17:54:56.910774401 (216h29m18.869871673s) [upload=225414]: Got next segment. Inline: false
Aug 17 17:54:56.910874125 (216h29m18.869971398s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:54:56.910882610 (216h29m18.869979901s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:54:57.111146615 (216h29m19.070243865s) [seg_pos={0 0}, upload=225414]: Begin upload segment...
Aug 17 17:54:57.111213660 (216h29m19.070310906s) [seg_pos={0 0}, upload=225414]: Done begin upload segment.
Aug 17 17:54:57.111249315 (216h29m19.070346561s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112064139 (216h29m19.071161388s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112587186 (216h29m19.071684444s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113084792 (216h29m19.072182039s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113558948 (216h29m19.072656274s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114047415 (216h29m19.073144674s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114605691 (216h29m19.073702941s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114974808 (216h29m19.074072057s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115315904 (216h29m19.074413158s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115743712 (216h29m19.074840959s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116132198 (216h29m19.075229448s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116482202 (216h29m19.075579457s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116805842 (216h29m19.07590309s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117031876 (216h29m19.07612913s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117707837 (216h29m19.076805096s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.118485640 (216h29m19.077582897s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119068244 (216h29m19.078165502s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119585875 (216h29m19.078683131s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.680745192 (216h29m19.639842438s) [upload=225414]: Next returned nil segment
Aug 17 17:54:57.680761285 (216h29m19.639858529s) [upload=225414]: Waiting for error group managing segments...
Aug 17 17:54:57.845470529 (216h29m19.804567777s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.849020399 (216h29m19.808117634s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.857547681 (216h29m19.816644913s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.860270755 (216h29m19.819367992s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.862896987 (216h29m19.821994225s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.863099946 (216h29m19.822197206s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871626479 (216h29m19.830723731s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871873189 (216h29m19.830970421s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.872997484 (216h29m19.832094716s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.916986864 (216h29m19.876084112s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.918384963 (216h29m19.877482195s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.972661918 (216h29m19.931759283s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.984719175 (216h29m19.943816427s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033694344 (216h29m19.992791582s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033732846 (216h29m19.992830093s) [seg_pos={0 0}, upload=225414]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:54:58.034040813 (216h29m19.993138049s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034068341 (216h29m19.993165577s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034146397 (216h29m19.993243631s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mg8ujbdjncZ8aiGM1mL3m7D6B58MGspzMT3qztj5iG4WqHYVk): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034252187 (216h29m19.993349433s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection
Aug 17 17:54:58.034275446 (216h29m19.993372681s) [seg_pos={0 0}, upload=225414]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:54:58.034353252 (216h29m19.993450487s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:54:58.034358061 (216h29m19.993455307s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:54:58.216473979 (216h29m20.175571233s) [upload=225414]: Done uploading segments...
Aug 17 17:54:58.216502767 (216h29m20.175600024s) [upload=225414]: Upload finished. err: <nil>
Duration: 2.515998926s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X..............X.................X.................X..] duration:
1.206054298s
FAIL (2025-08-17 18:09:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:08:45.444174555 (216h43m7.403271805s) [upload=225656]: Starting upload
Aug 17 18:08:45.444265275 (216h43m7.403362528s) [upload=225656]: Done starting upload
Aug 17 18:08:45.444380848 (216h43m7.403478094s) [upload=225656]: Uploading segments...
Aug 17 18:08:45.444456105 (216h43m7.403553361s) [upload=225656]: Got next segment. Inline: true
Aug 17 18:08:45.444463359 (216h43m7.403560608s) [upload=225656]: Waiting for error group managing segments...
Aug 17 18:08:45.444534432 (216h43m7.403631682s) [upload=225656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:45.444540461 (216h43m7.403637708s) [upload=225656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:08:45.444544628 (216h43m7.403641875s) [upload=225656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:46.064899476 (216h43m8.023996726s) [upload=225656]: Done uploading segments...
Aug 17 18:08:46.064919982 (216h43m8.024017214s) [upload=225656]: Upload finished. err: <nil>
Duration: 1.20608245s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X...............X...X.....................] duration:
2.774236849s
FAIL (2025-08-17 18:09:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:54:56.910242388 (216h29m18.869339647s) [upload=225414]: Starting upload
Aug 17 17:54:56.910346363 (216h29m18.869443611s) [upload=225414]: Done starting upload
Aug 17 17:54:56.910592380 (216h29m18.869689634s) [upload=225414]: Uploading segments...
Aug 17 17:54:56.910774401 (216h29m18.869871673s) [upload=225414]: Got next segment. Inline: false
Aug 17 17:54:56.910874125 (216h29m18.869971398s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:54:56.910882610 (216h29m18.869979901s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:54:57.111146615 (216h29m19.070243865s) [seg_pos={0 0}, upload=225414]: Begin upload segment...
Aug 17 17:54:57.111213660 (216h29m19.070310906s) [seg_pos={0 0}, upload=225414]: Done begin upload segment.
Aug 17 17:54:57.111249315 (216h29m19.070346561s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112064139 (216h29m19.071161388s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112587186 (216h29m19.071684444s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113084792 (216h29m19.072182039s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113558948 (216h29m19.072656274s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114047415 (216h29m19.073144674s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114605691 (216h29m19.073702941s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114974808 (216h29m19.074072057s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115315904 (216h29m19.074413158s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115743712 (216h29m19.074840959s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116132198 (216h29m19.075229448s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116482202 (216h29m19.075579457s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116805842 (216h29m19.07590309s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117031876 (216h29m19.07612913s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117707837 (216h29m19.076805096s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.118485640 (216h29m19.077582897s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119068244 (216h29m19.078165502s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119585875 (216h29m19.078683131s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.680745192 (216h29m19.639842438s) [upload=225414]: Next returned nil segment
Aug 17 17:54:57.680761285 (216h29m19.639858529s) [upload=225414]: Waiting for error group managing segments...
Aug 17 17:54:57.845470529 (216h29m19.804567777s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.849020399 (216h29m19.808117634s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.857547681 (216h29m19.816644913s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.860270755 (216h29m19.819367992s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.862896987 (216h29m19.821994225s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.863099946 (216h29m19.822197206s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871626479 (216h29m19.830723731s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871873189 (216h29m19.830970421s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.872997484 (216h29m19.832094716s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.916986864 (216h29m19.876084112s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.918384963 (216h29m19.877482195s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.972661918 (216h29m19.931759283s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.984719175 (216h29m19.943816427s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033694344 (216h29m19.992791582s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033732846 (216h29m19.992830093s) [seg_pos={0 0}, upload=225414]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:54:58.034040813 (216h29m19.993138049s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034068341 (216h29m19.993165577s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034146397 (216h29m19.993243631s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mg8ujbdjncZ8aiGM1mL3m7D6B58MGspzMT3qztj5iG4WqHYVk): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034252187 (216h29m19.993349433s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection
Aug 17 17:54:58.034275446 (216h29m19.993372681s) [seg_pos={0 0}, upload=225414]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:54:58.034353252 (216h29m19.993450487s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:54:58.034358061 (216h29m19.993455307s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:54:58.216473979 (216h29m20.175571233s) [upload=225414]: Done uploading segments...
Aug 17 17:54:58.216502767 (216h29m20.175600024s) [upload=225414]: Upload finished. err: <nil>
Duration: 2.774282947s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X..............X.................X.................X.] duration:
1.014328775s
FAIL (2025-08-17 18:09:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:08:45.444174555 (216h43m7.403271805s) [upload=225656]: Starting upload
Aug 17 18:08:45.444265275 (216h43m7.403362528s) [upload=225656]: Done starting upload
Aug 17 18:08:45.444380848 (216h43m7.403478094s) [upload=225656]: Uploading segments...
Aug 17 18:08:45.444456105 (216h43m7.403553361s) [upload=225656]: Got next segment. Inline: true
Aug 17 18:08:45.444463359 (216h43m7.403560608s) [upload=225656]: Waiting for error group managing segments...
Aug 17 18:08:45.444534432 (216h43m7.403631682s) [upload=225656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:45.444540461 (216h43m7.403637708s) [upload=225656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:08:45.444544628 (216h43m7.403641875s) [upload=225656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:46.064899476 (216h43m8.023996726s) [upload=225656]: Done uploading segments...
Aug 17 18:08:46.064919982 (216h43m8.024017214s) [upload=225656]: Upload finished. err: <nil>
Duration: 1.014439591s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X..............X.................X.................X] duration:
1.197322857s
FAIL (2025-08-17 18:08:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 18:08:45.444174555 (216h43m7.403271805s) [upload=225656]: Starting upload
Aug 17 18:08:45.444265275 (216h43m7.403362528s) [upload=225656]: Done starting upload
Aug 17 18:08:45.444380848 (216h43m7.403478094s) [upload=225656]: Uploading segments...
Aug 17 18:08:45.444456105 (216h43m7.403553361s) [upload=225656]: Got next segment. Inline: true
Aug 17 18:08:45.444463359 (216h43m7.403560608s) [upload=225656]: Waiting for error group managing segments...
Aug 17 18:08:45.444534432 (216h43m7.403631682s) [upload=225656]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 18:08:45.444540461 (216h43m7.403637708s) [upload=225656]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 18:08:45.444544628 (216h43m7.403641875s) [upload=225656]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 18:08:46.064899476 (216h43m8.023996726s) [upload=225656]: Done uploading segments...
Aug 17 18:08:46.064919982 (216h43m8.024017214s) [upload=225656]: Upload finished. err: <nil>
Duration: 1.19735619s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X...............X...X....................] duration:
2.757102245s
FAIL (2025-08-17 18:08:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:54:56.910242388 (216h29m18.869339647s) [upload=225414]: Starting upload
Aug 17 17:54:56.910346363 (216h29m18.869443611s) [upload=225414]: Done starting upload
Aug 17 17:54:56.910592380 (216h29m18.869689634s) [upload=225414]: Uploading segments...
Aug 17 17:54:56.910774401 (216h29m18.869871673s) [upload=225414]: Got next segment. Inline: false
Aug 17 17:54:56.910874125 (216h29m18.869971398s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:54:56.910882610 (216h29m18.869979901s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:54:57.111146615 (216h29m19.070243865s) [seg_pos={0 0}, upload=225414]: Begin upload segment...
Aug 17 17:54:57.111213660 (216h29m19.070310906s) [seg_pos={0 0}, upload=225414]: Done begin upload segment.
Aug 17 17:54:57.111249315 (216h29m19.070346561s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112064139 (216h29m19.071161388s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112587186 (216h29m19.071684444s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113084792 (216h29m19.072182039s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113558948 (216h29m19.072656274s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114047415 (216h29m19.073144674s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114605691 (216h29m19.073702941s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114974808 (216h29m19.074072057s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115315904 (216h29m19.074413158s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115743712 (216h29m19.074840959s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116132198 (216h29m19.075229448s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116482202 (216h29m19.075579457s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116805842 (216h29m19.07590309s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117031876 (216h29m19.07612913s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117707837 (216h29m19.076805096s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.118485640 (216h29m19.077582897s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119068244 (216h29m19.078165502s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119585875 (216h29m19.078683131s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.680745192 (216h29m19.639842438s) [upload=225414]: Next returned nil segment
Aug 17 17:54:57.680761285 (216h29m19.639858529s) [upload=225414]: Waiting for error group managing segments...
Aug 17 17:54:57.845470529 (216h29m19.804567777s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.849020399 (216h29m19.808117634s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.857547681 (216h29m19.816644913s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.860270755 (216h29m19.819367992s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.862896987 (216h29m19.821994225s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.863099946 (216h29m19.822197206s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871626479 (216h29m19.830723731s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871873189 (216h29m19.830970421s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.872997484 (216h29m19.832094716s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.916986864 (216h29m19.876084112s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.918384963 (216h29m19.877482195s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.972661918 (216h29m19.931759283s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.984719175 (216h29m19.943816427s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033694344 (216h29m19.992791582s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033732846 (216h29m19.992830093s) [seg_pos={0 0}, upload=225414]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:54:58.034040813 (216h29m19.993138049s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034068341 (216h29m19.993165577s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034146397 (216h29m19.993243631s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mg8ujbdjncZ8aiGM1mL3m7D6B58MGspzMT3qztj5iG4WqHYVk): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034252187 (216h29m19.993349433s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection
Aug 17 17:54:58.034275446 (216h29m19.993372681s) [seg_pos={0 0}, upload=225414]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:54:58.034353252 (216h29m19.993450487s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:54:58.034358061 (216h29m19.993455307s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:54:58.216473979 (216h29m20.175571233s) [upload=225414]: Done uploading segments...
Aug 17 17:54:58.216502767 (216h29m20.175600024s) [upload=225414]: Upload finished. err: <nil>
Duration: 2.757132727s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X..............X.................X.................] duration:
923.612607ms
FAIL (2025-08-17 18:08:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:53:06.985398044 (216h27m28.944495304s) [upload=225382]: Starting upload Aug 17 17:53:06.985484690 (216h27m28.94458194s) [upload=225382]: Done starting upload Aug 17 17:53:06.985611641 (216h27m28.944708891s) [upload=225382]: Uploading segments... Aug 17 17:53:06.985670994 (216h27m28.944768253s) [upload=225382]: Got next segment. Inline: true Aug 17 17:53:06.985679072 (216h27m28.944776324s) [upload=225382]: Waiting for error group managing segments... Aug 17 17:53:06.985739535 (216h27m28.944836796s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:53:06.985747190 (216h27m28.944844445s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:53:06.985751879 (216h27m28.944849129s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:53:07.074193501 (216h27m29.033290747s) [upload=225382]: Done uploading segments... Aug 17 17:53:07.074225738 (216h27m29.033322985s) [upload=225382]: Upload finished. err: metaclient: Too Many Requests
Duration: 923.64666ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X..............X.................X................] duration:
874.643435ms
FAIL (2025-08-17 18:07:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:53:06.985398044 (216h27m28.944495304s) [upload=225382]: Starting upload Aug 17 17:53:06.985484690 (216h27m28.94458194s) [upload=225382]: Done starting upload Aug 17 17:53:06.985611641 (216h27m28.944708891s) [upload=225382]: Uploading segments... Aug 17 17:53:06.985670994 (216h27m28.944768253s) [upload=225382]: Got next segment. Inline: true Aug 17 17:53:06.985679072 (216h27m28.944776324s) [upload=225382]: Waiting for error group managing segments... Aug 17 17:53:06.985739535 (216h27m28.944836796s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:53:06.985747190 (216h27m28.944844445s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:53:06.985751879 (216h27m28.944849129s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:53:07.074193501 (216h27m29.033290747s) [upload=225382]: Done uploading segments... Aug 17 17:53:07.074225738 (216h27m29.033322985s) [upload=225382]: Upload finished. err: metaclient: Too Many Requests
Duration: 874.676261ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X...............X...X...................] duration:
2.67135461s
FAIL (2025-08-17 18:07:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:54:56.910242388 (216h29m18.869339647s) [upload=225414]: Starting upload
Aug 17 17:54:56.910346363 (216h29m18.869443611s) [upload=225414]: Done starting upload
Aug 17 17:54:56.910592380 (216h29m18.869689634s) [upload=225414]: Uploading segments...
Aug 17 17:54:56.910774401 (216h29m18.869871673s) [upload=225414]: Got next segment. Inline: false
Aug 17 17:54:56.910874125 (216h29m18.869971398s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:54:56.910882610 (216h29m18.869979901s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:54:57.111146615 (216h29m19.070243865s) [seg_pos={0 0}, upload=225414]: Begin upload segment...
Aug 17 17:54:57.111213660 (216h29m19.070310906s) [seg_pos={0 0}, upload=225414]: Done begin upload segment.
Aug 17 17:54:57.111249315 (216h29m19.070346561s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112064139 (216h29m19.071161388s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112587186 (216h29m19.071684444s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113084792 (216h29m19.072182039s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113558948 (216h29m19.072656274s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114047415 (216h29m19.073144674s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114605691 (216h29m19.073702941s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114974808 (216h29m19.074072057s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115315904 (216h29m19.074413158s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115743712 (216h29m19.074840959s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116132198 (216h29m19.075229448s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116482202 (216h29m19.075579457s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116805842 (216h29m19.07590309s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117031876 (216h29m19.07612913s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117707837 (216h29m19.076805096s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.118485640 (216h29m19.077582897s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119068244 (216h29m19.078165502s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119585875 (216h29m19.078683131s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.680745192 (216h29m19.639842438s) [upload=225414]: Next returned nil segment
Aug 17 17:54:57.680761285 (216h29m19.639858529s) [upload=225414]: Waiting for error group managing segments...
Aug 17 17:54:57.845470529 (216h29m19.804567777s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.849020399 (216h29m19.808117634s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.857547681 (216h29m19.816644913s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.860270755 (216h29m19.819367992s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.862896987 (216h29m19.821994225s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.863099946 (216h29m19.822197206s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871626479 (216h29m19.830723731s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871873189 (216h29m19.830970421s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.872997484 (216h29m19.832094716s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.916986864 (216h29m19.876084112s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.918384963 (216h29m19.877482195s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.972661918 (216h29m19.931759283s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.984719175 (216h29m19.943816427s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033694344 (216h29m19.992791582s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033732846 (216h29m19.992830093s) [seg_pos={0 0}, upload=225414]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:54:58.034040813 (216h29m19.993138049s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034068341 (216h29m19.993165577s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034146397 (216h29m19.993243631s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mg8ujbdjncZ8aiGM1mL3m7D6B58MGspzMT3qztj5iG4WqHYVk): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034252187 (216h29m19.993349433s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection
Aug 17 17:54:58.034275446 (216h29m19.993372681s) [seg_pos={0 0}, upload=225414]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:54:58.034353252 (216h29m19.993450487s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:54:58.034358061 (216h29m19.993455307s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:54:58.216473979 (216h29m20.175571233s) [upload=225414]: Done uploading segments...
Aug 17 17:54:58.216502767 (216h29m20.175600024s) [upload=225414]: Upload finished. err: <nil>
Duration: 2.671423309s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X...............X...X..................] duration:
2.518679144s
FAIL (2025-08-17 18:06:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:54:56.910242388 (216h29m18.869339647s) [upload=225414]: Starting upload
Aug 17 17:54:56.910346363 (216h29m18.869443611s) [upload=225414]: Done starting upload
Aug 17 17:54:56.910592380 (216h29m18.869689634s) [upload=225414]: Uploading segments...
Aug 17 17:54:56.910774401 (216h29m18.869871673s) [upload=225414]: Got next segment. Inline: false
Aug 17 17:54:56.910874125 (216h29m18.869971398s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:54:56.910882610 (216h29m18.869979901s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:54:57.111146615 (216h29m19.070243865s) [seg_pos={0 0}, upload=225414]: Begin upload segment...
Aug 17 17:54:57.111213660 (216h29m19.070310906s) [seg_pos={0 0}, upload=225414]: Done begin upload segment.
Aug 17 17:54:57.111249315 (216h29m19.070346561s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112064139 (216h29m19.071161388s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112587186 (216h29m19.071684444s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113084792 (216h29m19.072182039s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113558948 (216h29m19.072656274s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114047415 (216h29m19.073144674s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114605691 (216h29m19.073702941s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114974808 (216h29m19.074072057s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115315904 (216h29m19.074413158s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115743712 (216h29m19.074840959s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116132198 (216h29m19.075229448s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116482202 (216h29m19.075579457s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116805842 (216h29m19.07590309s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117031876 (216h29m19.07612913s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117707837 (216h29m19.076805096s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.118485640 (216h29m19.077582897s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119068244 (216h29m19.078165502s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119585875 (216h29m19.078683131s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.680745192 (216h29m19.639842438s) [upload=225414]: Next returned nil segment
Aug 17 17:54:57.680761285 (216h29m19.639858529s) [upload=225414]: Waiting for error group managing segments...
Aug 17 17:54:57.845470529 (216h29m19.804567777s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.849020399 (216h29m19.808117634s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.857547681 (216h29m19.816644913s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.860270755 (216h29m19.819367992s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.862896987 (216h29m19.821994225s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.863099946 (216h29m19.822197206s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871626479 (216h29m19.830723731s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871873189 (216h29m19.830970421s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.872997484 (216h29m19.832094716s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.916986864 (216h29m19.876084112s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.918384963 (216h29m19.877482195s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.972661918 (216h29m19.931759283s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.984719175 (216h29m19.943816427s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033694344 (216h29m19.992791582s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033732846 (216h29m19.992830093s) [seg_pos={0 0}, upload=225414]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:54:58.034040813 (216h29m19.993138049s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034068341 (216h29m19.993165577s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034146397 (216h29m19.993243631s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mg8ujbdjncZ8aiGM1mL3m7D6B58MGspzMT3qztj5iG4WqHYVk): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034252187 (216h29m19.993349433s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection
Aug 17 17:54:58.034275446 (216h29m19.993372681s) [seg_pos={0 0}, upload=225414]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:54:58.034353252 (216h29m19.993450487s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:54:58.034358061 (216h29m19.993455307s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:54:58.216473979 (216h29m20.175571233s) [upload=225414]: Done uploading segments...
Aug 17 17:54:58.216502767 (216h29m20.175600024s) [upload=225414]: Upload finished. err: <nil>
Duration: 2.518713842s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X..............X.................X...............] duration:
899.37616ms
FAIL (2025-08-17 18:06:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:53:06.985398044 (216h27m28.944495304s) [upload=225382]: Starting upload Aug 17 17:53:06.985484690 (216h27m28.94458194s) [upload=225382]: Done starting upload Aug 17 17:53:06.985611641 (216h27m28.944708891s) [upload=225382]: Uploading segments... Aug 17 17:53:06.985670994 (216h27m28.944768253s) [upload=225382]: Got next segment. Inline: true Aug 17 17:53:06.985679072 (216h27m28.944776324s) [upload=225382]: Waiting for error group managing segments... Aug 17 17:53:06.985739535 (216h27m28.944836796s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:53:06.985747190 (216h27m28.944844445s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:53:06.985751879 (216h27m28.944849129s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:53:07.074193501 (216h27m29.033290747s) [upload=225382]: Done uploading segments... Aug 17 17:53:07.074225738 (216h27m29.033322985s) [upload=225382]: Upload finished. err: metaclient: Too Many Requests
Duration: 899.411896ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X...............X...X.................] duration:
2.49297737s
FAIL (2025-08-17 18:06:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:54:56.910242388 (216h29m18.869339647s) [upload=225414]: Starting upload
Aug 17 17:54:56.910346363 (216h29m18.869443611s) [upload=225414]: Done starting upload
Aug 17 17:54:56.910592380 (216h29m18.869689634s) [upload=225414]: Uploading segments...
Aug 17 17:54:56.910774401 (216h29m18.869871673s) [upload=225414]: Got next segment. Inline: false
Aug 17 17:54:56.910874125 (216h29m18.869971398s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:54:56.910882610 (216h29m18.869979901s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:54:57.111146615 (216h29m19.070243865s) [seg_pos={0 0}, upload=225414]: Begin upload segment...
Aug 17 17:54:57.111213660 (216h29m19.070310906s) [seg_pos={0 0}, upload=225414]: Done begin upload segment.
Aug 17 17:54:57.111249315 (216h29m19.070346561s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112064139 (216h29m19.071161388s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112587186 (216h29m19.071684444s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113084792 (216h29m19.072182039s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113558948 (216h29m19.072656274s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114047415 (216h29m19.073144674s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114605691 (216h29m19.073702941s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114974808 (216h29m19.074072057s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115315904 (216h29m19.074413158s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115743712 (216h29m19.074840959s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116132198 (216h29m19.075229448s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116482202 (216h29m19.075579457s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116805842 (216h29m19.07590309s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117031876 (216h29m19.07612913s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117707837 (216h29m19.076805096s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.118485640 (216h29m19.077582897s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119068244 (216h29m19.078165502s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119585875 (216h29m19.078683131s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.680745192 (216h29m19.639842438s) [upload=225414]: Next returned nil segment
Aug 17 17:54:57.680761285 (216h29m19.639858529s) [upload=225414]: Waiting for error group managing segments...
Aug 17 17:54:57.845470529 (216h29m19.804567777s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.849020399 (216h29m19.808117634s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.857547681 (216h29m19.816644913s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.860270755 (216h29m19.819367992s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.862896987 (216h29m19.821994225s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.863099946 (216h29m19.822197206s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871626479 (216h29m19.830723731s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871873189 (216h29m19.830970421s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.872997484 (216h29m19.832094716s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.916986864 (216h29m19.876084112s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.918384963 (216h29m19.877482195s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.972661918 (216h29m19.931759283s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.984719175 (216h29m19.943816427s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033694344 (216h29m19.992791582s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033732846 (216h29m19.992830093s) [seg_pos={0 0}, upload=225414]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:54:58.034040813 (216h29m19.993138049s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034068341 (216h29m19.993165577s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034146397 (216h29m19.993243631s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mg8ujbdjncZ8aiGM1mL3m7D6B58MGspzMT3qztj5iG4WqHYVk): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034252187 (216h29m19.993349433s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection
Aug 17 17:54:58.034275446 (216h29m19.993372681s) [seg_pos={0 0}, upload=225414]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:54:58.034353252 (216h29m19.993450487s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:54:58.034358061 (216h29m19.993455307s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:54:58.216473979 (216h29m20.175571233s) [upload=225414]: Done uploading segments...
Aug 17 17:54:58.216502767 (216h29m20.175600024s) [upload=225414]: Upload finished. err: <nil>
Duration: 2.493015872s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X...............X...X................] duration:
2.703971517s
FAIL (2025-08-17 18:05:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:54:56.910242388 (216h29m18.869339647s) [upload=225414]: Starting upload
Aug 17 17:54:56.910346363 (216h29m18.869443611s) [upload=225414]: Done starting upload
Aug 17 17:54:56.910592380 (216h29m18.869689634s) [upload=225414]: Uploading segments...
Aug 17 17:54:56.910774401 (216h29m18.869871673s) [upload=225414]: Got next segment. Inline: false
Aug 17 17:54:56.910874125 (216h29m18.869971398s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:54:56.910882610 (216h29m18.869979901s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:54:57.111146615 (216h29m19.070243865s) [seg_pos={0 0}, upload=225414]: Begin upload segment...
Aug 17 17:54:57.111213660 (216h29m19.070310906s) [seg_pos={0 0}, upload=225414]: Done begin upload segment.
Aug 17 17:54:57.111249315 (216h29m19.070346561s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112064139 (216h29m19.071161388s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112587186 (216h29m19.071684444s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113084792 (216h29m19.072182039s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113558948 (216h29m19.072656274s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114047415 (216h29m19.073144674s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114605691 (216h29m19.073702941s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114974808 (216h29m19.074072057s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115315904 (216h29m19.074413158s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115743712 (216h29m19.074840959s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116132198 (216h29m19.075229448s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116482202 (216h29m19.075579457s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116805842 (216h29m19.07590309s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117031876 (216h29m19.07612913s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117707837 (216h29m19.076805096s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.118485640 (216h29m19.077582897s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119068244 (216h29m19.078165502s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119585875 (216h29m19.078683131s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.680745192 (216h29m19.639842438s) [upload=225414]: Next returned nil segment
Aug 17 17:54:57.680761285 (216h29m19.639858529s) [upload=225414]: Waiting for error group managing segments...
Aug 17 17:54:57.845470529 (216h29m19.804567777s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.849020399 (216h29m19.808117634s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.857547681 (216h29m19.816644913s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.860270755 (216h29m19.819367992s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.862896987 (216h29m19.821994225s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.863099946 (216h29m19.822197206s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871626479 (216h29m19.830723731s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871873189 (216h29m19.830970421s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.872997484 (216h29m19.832094716s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.916986864 (216h29m19.876084112s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.918384963 (216h29m19.877482195s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.972661918 (216h29m19.931759283s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.984719175 (216h29m19.943816427s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033694344 (216h29m19.992791582s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033732846 (216h29m19.992830093s) [seg_pos={0 0}, upload=225414]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:54:58.034040813 (216h29m19.993138049s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034068341 (216h29m19.993165577s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034146397 (216h29m19.993243631s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mg8ujbdjncZ8aiGM1mL3m7D6B58MGspzMT3qztj5iG4WqHYVk): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034252187 (216h29m19.993349433s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection
Aug 17 17:54:58.034275446 (216h29m19.993372681s) [seg_pos={0 0}, upload=225414]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:54:58.034353252 (216h29m19.993450487s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:54:58.034358061 (216h29m19.993455307s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:54:58.216473979 (216h29m20.175571233s) [upload=225414]: Done uploading segments...
Aug 17 17:54:58.216502767 (216h29m20.175600024s) [upload=225414]: Upload finished. err: <nil>
Duration: 2.704002246s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X..............X.................X..............] duration:
989.748894ms
FAIL (2025-08-17 18:05:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:53:06.985398044 (216h27m28.944495304s) [upload=225382]: Starting upload Aug 17 17:53:06.985484690 (216h27m28.94458194s) [upload=225382]: Done starting upload Aug 17 17:53:06.985611641 (216h27m28.944708891s) [upload=225382]: Uploading segments... Aug 17 17:53:06.985670994 (216h27m28.944768253s) [upload=225382]: Got next segment. Inline: true Aug 17 17:53:06.985679072 (216h27m28.944776324s) [upload=225382]: Waiting for error group managing segments... Aug 17 17:53:06.985739535 (216h27m28.944836796s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:53:06.985747190 (216h27m28.944844445s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:53:06.985751879 (216h27m28.944849129s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:53:07.074193501 (216h27m29.033290747s) [upload=225382]: Done uploading segments... Aug 17 17:53:07.074225738 (216h27m29.033322985s) [upload=225382]: Upload finished. err: metaclient: Too Many Requests
Duration: 989.837272ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X...............X...X...............] duration:
2.576969923s
FAIL (2025-08-17 18:05:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:54:56.910242388 (216h29m18.869339647s) [upload=225414]: Starting upload
Aug 17 17:54:56.910346363 (216h29m18.869443611s) [upload=225414]: Done starting upload
Aug 17 17:54:56.910592380 (216h29m18.869689634s) [upload=225414]: Uploading segments...
Aug 17 17:54:56.910774401 (216h29m18.869871673s) [upload=225414]: Got next segment. Inline: false
Aug 17 17:54:56.910874125 (216h29m18.869971398s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:54:56.910882610 (216h29m18.869979901s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:54:57.111146615 (216h29m19.070243865s) [seg_pos={0 0}, upload=225414]: Begin upload segment...
Aug 17 17:54:57.111213660 (216h29m19.070310906s) [seg_pos={0 0}, upload=225414]: Done begin upload segment.
Aug 17 17:54:57.111249315 (216h29m19.070346561s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112064139 (216h29m19.071161388s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112587186 (216h29m19.071684444s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113084792 (216h29m19.072182039s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113558948 (216h29m19.072656274s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114047415 (216h29m19.073144674s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114605691 (216h29m19.073702941s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114974808 (216h29m19.074072057s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115315904 (216h29m19.074413158s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115743712 (216h29m19.074840959s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116132198 (216h29m19.075229448s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116482202 (216h29m19.075579457s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116805842 (216h29m19.07590309s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117031876 (216h29m19.07612913s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117707837 (216h29m19.076805096s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.118485640 (216h29m19.077582897s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119068244 (216h29m19.078165502s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119585875 (216h29m19.078683131s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.680745192 (216h29m19.639842438s) [upload=225414]: Next returned nil segment
Aug 17 17:54:57.680761285 (216h29m19.639858529s) [upload=225414]: Waiting for error group managing segments...
Aug 17 17:54:57.845470529 (216h29m19.804567777s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.849020399 (216h29m19.808117634s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.857547681 (216h29m19.816644913s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.860270755 (216h29m19.819367992s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.862896987 (216h29m19.821994225s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.863099946 (216h29m19.822197206s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871626479 (216h29m19.830723731s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871873189 (216h29m19.830970421s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.872997484 (216h29m19.832094716s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.916986864 (216h29m19.876084112s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.918384963 (216h29m19.877482195s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.972661918 (216h29m19.931759283s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.984719175 (216h29m19.943816427s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033694344 (216h29m19.992791582s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033732846 (216h29m19.992830093s) [seg_pos={0 0}, upload=225414]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:54:58.034040813 (216h29m19.993138049s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034068341 (216h29m19.993165577s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034146397 (216h29m19.993243631s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mg8ujbdjncZ8aiGM1mL3m7D6B58MGspzMT3qztj5iG4WqHYVk): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034252187 (216h29m19.993349433s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection
Aug 17 17:54:58.034275446 (216h29m19.993372681s) [seg_pos={0 0}, upload=225414]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:54:58.034353252 (216h29m19.993450487s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:54:58.034358061 (216h29m19.993455307s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:54:58.216473979 (216h29m20.175571233s) [upload=225414]: Done uploading segments...
Aug 17 17:54:58.216502767 (216h29m20.175600024s) [upload=225414]: Upload finished. err: <nil>
Duration: 2.577002685s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X...............X...X..............] duration:
2.694295898s
FAIL (2025-08-17 18:04:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:54:56.910242388 (216h29m18.869339647s) [upload=225414]: Starting upload
Aug 17 17:54:56.910346363 (216h29m18.869443611s) [upload=225414]: Done starting upload
Aug 17 17:54:56.910592380 (216h29m18.869689634s) [upload=225414]: Uploading segments...
Aug 17 17:54:56.910774401 (216h29m18.869871673s) [upload=225414]: Got next segment. Inline: false
Aug 17 17:54:56.910874125 (216h29m18.869971398s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:54:56.910882610 (216h29m18.869979901s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:54:57.111146615 (216h29m19.070243865s) [seg_pos={0 0}, upload=225414]: Begin upload segment...
Aug 17 17:54:57.111213660 (216h29m19.070310906s) [seg_pos={0 0}, upload=225414]: Done begin upload segment.
Aug 17 17:54:57.111249315 (216h29m19.070346561s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112064139 (216h29m19.071161388s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112587186 (216h29m19.071684444s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113084792 (216h29m19.072182039s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113558948 (216h29m19.072656274s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114047415 (216h29m19.073144674s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114605691 (216h29m19.073702941s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114974808 (216h29m19.074072057s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115315904 (216h29m19.074413158s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115743712 (216h29m19.074840959s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116132198 (216h29m19.075229448s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116482202 (216h29m19.075579457s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116805842 (216h29m19.07590309s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117031876 (216h29m19.07612913s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117707837 (216h29m19.076805096s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.118485640 (216h29m19.077582897s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119068244 (216h29m19.078165502s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119585875 (216h29m19.078683131s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.680745192 (216h29m19.639842438s) [upload=225414]: Next returned nil segment
Aug 17 17:54:57.680761285 (216h29m19.639858529s) [upload=225414]: Waiting for error group managing segments...
Aug 17 17:54:57.845470529 (216h29m19.804567777s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.849020399 (216h29m19.808117634s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.857547681 (216h29m19.816644913s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.860270755 (216h29m19.819367992s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.862896987 (216h29m19.821994225s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.863099946 (216h29m19.822197206s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871626479 (216h29m19.830723731s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871873189 (216h29m19.830970421s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.872997484 (216h29m19.832094716s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.916986864 (216h29m19.876084112s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.918384963 (216h29m19.877482195s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.972661918 (216h29m19.931759283s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.984719175 (216h29m19.943816427s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033694344 (216h29m19.992791582s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033732846 (216h29m19.992830093s) [seg_pos={0 0}, upload=225414]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:54:58.034040813 (216h29m19.993138049s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034068341 (216h29m19.993165577s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034146397 (216h29m19.993243631s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mg8ujbdjncZ8aiGM1mL3m7D6B58MGspzMT3qztj5iG4WqHYVk): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034252187 (216h29m19.993349433s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection
Aug 17 17:54:58.034275446 (216h29m19.993372681s) [seg_pos={0 0}, upload=225414]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:54:58.034353252 (216h29m19.993450487s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:54:58.034358061 (216h29m19.993455307s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:54:58.216473979 (216h29m20.175571233s) [upload=225414]: Done uploading segments...
Aug 17 17:54:58.216502767 (216h29m20.175600024s) [upload=225414]: Upload finished. err: <nil>
Duration: 2.694328745s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X..............X.................X.............] duration:
883.069343ms
FAIL (2025-08-17 18:04:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:53:06.985398044 (216h27m28.944495304s) [upload=225382]: Starting upload Aug 17 17:53:06.985484690 (216h27m28.94458194s) [upload=225382]: Done starting upload Aug 17 17:53:06.985611641 (216h27m28.944708891s) [upload=225382]: Uploading segments... Aug 17 17:53:06.985670994 (216h27m28.944768253s) [upload=225382]: Got next segment. Inline: true Aug 17 17:53:06.985679072 (216h27m28.944776324s) [upload=225382]: Waiting for error group managing segments... Aug 17 17:53:06.985739535 (216h27m28.944836796s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:53:06.985747190 (216h27m28.944844445s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:53:06.985751879 (216h27m28.944849129s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:53:07.074193501 (216h27m29.033290747s) [upload=225382]: Done uploading segments... Aug 17 17:53:07.074225738 (216h27m29.033322985s) [upload=225382]: Upload finished. err: metaclient: Too Many Requests
Duration: 883.100354ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X...............X...X.............] duration:
2.921407117s
FAIL (2025-08-17 18:03:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:54:56.910242388 (216h29m18.869339647s) [upload=225414]: Starting upload
Aug 17 17:54:56.910346363 (216h29m18.869443611s) [upload=225414]: Done starting upload
Aug 17 17:54:56.910592380 (216h29m18.869689634s) [upload=225414]: Uploading segments...
Aug 17 17:54:56.910774401 (216h29m18.869871673s) [upload=225414]: Got next segment. Inline: false
Aug 17 17:54:56.910874125 (216h29m18.869971398s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:54:56.910882610 (216h29m18.869979901s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:54:57.111146615 (216h29m19.070243865s) [seg_pos={0 0}, upload=225414]: Begin upload segment...
Aug 17 17:54:57.111213660 (216h29m19.070310906s) [seg_pos={0 0}, upload=225414]: Done begin upload segment.
Aug 17 17:54:57.111249315 (216h29m19.070346561s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112064139 (216h29m19.071161388s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112587186 (216h29m19.071684444s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113084792 (216h29m19.072182039s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113558948 (216h29m19.072656274s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114047415 (216h29m19.073144674s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114605691 (216h29m19.073702941s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114974808 (216h29m19.074072057s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115315904 (216h29m19.074413158s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115743712 (216h29m19.074840959s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116132198 (216h29m19.075229448s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116482202 (216h29m19.075579457s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116805842 (216h29m19.07590309s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117031876 (216h29m19.07612913s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117707837 (216h29m19.076805096s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.118485640 (216h29m19.077582897s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119068244 (216h29m19.078165502s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119585875 (216h29m19.078683131s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.680745192 (216h29m19.639842438s) [upload=225414]: Next returned nil segment
Aug 17 17:54:57.680761285 (216h29m19.639858529s) [upload=225414]: Waiting for error group managing segments...
Aug 17 17:54:57.845470529 (216h29m19.804567777s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.849020399 (216h29m19.808117634s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.857547681 (216h29m19.816644913s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.860270755 (216h29m19.819367992s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.862896987 (216h29m19.821994225s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.863099946 (216h29m19.822197206s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871626479 (216h29m19.830723731s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871873189 (216h29m19.830970421s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.872997484 (216h29m19.832094716s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.916986864 (216h29m19.876084112s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.918384963 (216h29m19.877482195s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.972661918 (216h29m19.931759283s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.984719175 (216h29m19.943816427s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033694344 (216h29m19.992791582s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033732846 (216h29m19.992830093s) [seg_pos={0 0}, upload=225414]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:54:58.034040813 (216h29m19.993138049s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034068341 (216h29m19.993165577s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034146397 (216h29m19.993243631s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mg8ujbdjncZ8aiGM1mL3m7D6B58MGspzMT3qztj5iG4WqHYVk): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034252187 (216h29m19.993349433s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection
Aug 17 17:54:58.034275446 (216h29m19.993372681s) [seg_pos={0 0}, upload=225414]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:54:58.034353252 (216h29m19.993450487s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:54:58.034358061 (216h29m19.993455307s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:54:58.216473979 (216h29m20.175571233s) [upload=225414]: Done uploading segments...
Aug 17 17:54:58.216502767 (216h29m20.175600024s) [upload=225414]: Upload finished. err: <nil>
Duration: 2.921435233s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X..............X.................X............] duration:
962.974188ms
FAIL (2025-08-17 18:03:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:53:06.985398044 (216h27m28.944495304s) [upload=225382]: Starting upload Aug 17 17:53:06.985484690 (216h27m28.94458194s) [upload=225382]: Done starting upload Aug 17 17:53:06.985611641 (216h27m28.944708891s) [upload=225382]: Uploading segments... Aug 17 17:53:06.985670994 (216h27m28.944768253s) [upload=225382]: Got next segment. Inline: true Aug 17 17:53:06.985679072 (216h27m28.944776324s) [upload=225382]: Waiting for error group managing segments... Aug 17 17:53:06.985739535 (216h27m28.944836796s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:53:06.985747190 (216h27m28.944844445s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:53:06.985751879 (216h27m28.944849129s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:53:07.074193501 (216h27m29.033290747s) [upload=225382]: Done uploading segments... Aug 17 17:53:07.074225738 (216h27m29.033322985s) [upload=225382]: Upload finished. err: metaclient: Too Many Requests
Duration: 963.007213ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X...............X...X............] duration:
2.491351209s
FAIL (2025-08-17 18:02:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:54:56.910242388 (216h29m18.869339647s) [upload=225414]: Starting upload
Aug 17 17:54:56.910346363 (216h29m18.869443611s) [upload=225414]: Done starting upload
Aug 17 17:54:56.910592380 (216h29m18.869689634s) [upload=225414]: Uploading segments...
Aug 17 17:54:56.910774401 (216h29m18.869871673s) [upload=225414]: Got next segment. Inline: false
Aug 17 17:54:56.910874125 (216h29m18.869971398s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:54:56.910882610 (216h29m18.869979901s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:54:57.111146615 (216h29m19.070243865s) [seg_pos={0 0}, upload=225414]: Begin upload segment...
Aug 17 17:54:57.111213660 (216h29m19.070310906s) [seg_pos={0 0}, upload=225414]: Done begin upload segment.
Aug 17 17:54:57.111249315 (216h29m19.070346561s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112064139 (216h29m19.071161388s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112587186 (216h29m19.071684444s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113084792 (216h29m19.072182039s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113558948 (216h29m19.072656274s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114047415 (216h29m19.073144674s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114605691 (216h29m19.073702941s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114974808 (216h29m19.074072057s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115315904 (216h29m19.074413158s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115743712 (216h29m19.074840959s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116132198 (216h29m19.075229448s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116482202 (216h29m19.075579457s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116805842 (216h29m19.07590309s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117031876 (216h29m19.07612913s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117707837 (216h29m19.076805096s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.118485640 (216h29m19.077582897s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119068244 (216h29m19.078165502s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119585875 (216h29m19.078683131s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.680745192 (216h29m19.639842438s) [upload=225414]: Next returned nil segment
Aug 17 17:54:57.680761285 (216h29m19.639858529s) [upload=225414]: Waiting for error group managing segments...
Aug 17 17:54:57.845470529 (216h29m19.804567777s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.849020399 (216h29m19.808117634s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.857547681 (216h29m19.816644913s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.860270755 (216h29m19.819367992s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.862896987 (216h29m19.821994225s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.863099946 (216h29m19.822197206s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871626479 (216h29m19.830723731s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871873189 (216h29m19.830970421s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.872997484 (216h29m19.832094716s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.916986864 (216h29m19.876084112s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.918384963 (216h29m19.877482195s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.972661918 (216h29m19.931759283s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.984719175 (216h29m19.943816427s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033694344 (216h29m19.992791582s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033732846 (216h29m19.992830093s) [seg_pos={0 0}, upload=225414]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:54:58.034040813 (216h29m19.993138049s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034068341 (216h29m19.993165577s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034146397 (216h29m19.993243631s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mg8ujbdjncZ8aiGM1mL3m7D6B58MGspzMT3qztj5iG4WqHYVk): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034252187 (216h29m19.993349433s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection
Aug 17 17:54:58.034275446 (216h29m19.993372681s) [seg_pos={0 0}, upload=225414]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:54:58.034353252 (216h29m19.993450487s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:54:58.034358061 (216h29m19.993455307s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:54:58.216473979 (216h29m20.175571233s) [upload=225414]: Done uploading segments...
Aug 17 17:54:58.216502767 (216h29m20.175600024s) [upload=225414]: Upload finished. err: <nil>
Duration: 2.49138376s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X..............X.................X...........] duration:
908.76112ms
FAIL (2025-08-17 18:02:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:53:06.985398044 (216h27m28.944495304s) [upload=225382]: Starting upload Aug 17 17:53:06.985484690 (216h27m28.94458194s) [upload=225382]: Done starting upload Aug 17 17:53:06.985611641 (216h27m28.944708891s) [upload=225382]: Uploading segments... Aug 17 17:53:06.985670994 (216h27m28.944768253s) [upload=225382]: Got next segment. Inline: true Aug 17 17:53:06.985679072 (216h27m28.944776324s) [upload=225382]: Waiting for error group managing segments... Aug 17 17:53:06.985739535 (216h27m28.944836796s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:53:06.985747190 (216h27m28.944844445s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:53:06.985751879 (216h27m28.944849129s) [upload=225382]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:53:07.074193501 (216h27m29.033290747s) [upload=225382]: Done uploading segments... Aug 17 17:53:07.074225738 (216h27m29.033322985s) [upload=225382]: Upload finished. err: metaclient: Too Many Requests
Duration: 908.802197ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................X...............X...X...........] duration:
2.681843189s
FAIL (2025-08-17 18:01:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:54:56.910242388 (216h29m18.869339647s) [upload=225414]: Starting upload
Aug 17 17:54:56.910346363 (216h29m18.869443611s) [upload=225414]: Done starting upload
Aug 17 17:54:56.910592380 (216h29m18.869689634s) [upload=225414]: Uploading segments...
Aug 17 17:54:56.910774401 (216h29m18.869871673s) [upload=225414]: Got next segment. Inline: false
Aug 17 17:54:56.910874125 (216h29m18.869971398s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:54:56.910882610 (216h29m18.869979901s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:54:57.111146615 (216h29m19.070243865s) [seg_pos={0 0}, upload=225414]: Begin upload segment...
Aug 17 17:54:57.111213660 (216h29m19.070310906s) [seg_pos={0 0}, upload=225414]: Done begin upload segment.
Aug 17 17:54:57.111249315 (216h29m19.070346561s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112064139 (216h29m19.071161388s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.112587186 (216h29m19.071684444s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113084792 (216h29m19.072182039s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.113558948 (216h29m19.072656274s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114047415 (216h29m19.073144674s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114605691 (216h29m19.073702941s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.114974808 (216h29m19.074072057s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115315904 (216h29m19.074413158s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.115743712 (216h29m19.074840959s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116132198 (216h29m19.075229448s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116482202 (216h29m19.075579457s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.116805842 (216h29m19.07590309s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117031876 (216h29m19.07612913s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.117707837 (216h29m19.076805096s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.118485640 (216h29m19.077582897s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119068244 (216h29m19.078165502s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.119585875 (216h29m19.078683131s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Uploading piece...
Aug 17 17:54:57.680745192 (216h29m19.639842438s) [upload=225414]: Next returned nil segment
Aug 17 17:54:57.680761285 (216h29m19.639858529s) [upload=225414]: Waiting for error group managing segments...
Aug 17 17:54:57.845470529 (216h29m19.804567777s) [noise=true , address=77.90.31.11:4580 , piece_id=7EZ2DIMPGXAS2WU62I7PGRNUUO4T5AGNUI6IXLK3FA7P3TLKSTRA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.849020399 (216h29m19.808117634s) [noise=true , address=77.90.31.12:4605 , piece_id=EVQOON475LDTMW3PY7W3C64W66KTOGPEZ5PX3V6LFCGQAFHAL54A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.857547681 (216h29m19.816644913s) [noise=true , address=77.90.31.13:4639 , piece_id=QUHIS5NL7IWLLHGGGQEQMFHNQYEKTT6URAPWR6P2O2ATKN5GSTVQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.860270755 (216h29m19.819367992s) [noise=true , address=77.90.31.19:4857 , piece_id=NJX3DBTL3RVIVCCV2XZ32RT3ZVIMHAH7KS5MJPGNESTCJLML4ETQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.862896987 (216h29m19.821994225s) [noise=true , address=77.90.31.21:4902 , piece_id=D5ZWMYUVFRYR7ACG4GV42WSADZ3YOOKZ5KAOXBRSD3BJM6THWGJQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.863099946 (216h29m19.822197206s) [noise=true , address=104.36.82.5:4866 , piece_id=ELPZMK55KTSLBQTQ3LSKUL6W7BSWVWASK2B2Q4COLNYGD2RS2G4Q, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871626479 (216h29m19.830723731s) [noise=true , address=104.36.82.23:4447 , piece_id=U6AN4COYZ34MOTAQQUYFUW5OVVTW4QFB22ANV6BZOMDMV55P5INA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.871873189 (216h29m19.830970421s) [noise=true , address=104.36.82.39:4752 , piece_id=N3YGVZGQGGDWVDL54GUXLOFJONOHHX4SWEGBSNLSPDEFYPJHQBNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.872997484 (216h29m19.832094716s) [noise=true , address=77.90.31.12:4621 , piece_id=XO456I4LHG5EYUKLSYJFGY3DIPZ56IYC7ZTP6VX7TNC5HGHBDDNQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.916986864 (216h29m19.876084112s) [noise=true , address=104.36.82.22:4522 , piece_id=E6N3HQXOMPO4N7GY3BDMCZ4GVP64SQHHAPAJUAMAQHSKDYYB5KOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.918384963 (216h29m19.877482195s) [noise=true , address=77.90.31.15:4702 , piece_id=CX6Q2H77G2L5AVQ4FFZ3GKQHM3GW2T42JNHBWH3BBEECJ2UJI6DQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.972661918 (216h29m19.931759283s) [noise=true , address=77.90.31.14:4693 , piece_id=TPIJXO3XOOABBAQ4NTKPAFYNJNJZZK7N4Y5ZRXJ3PMMEW42TT7OA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:57.984719175 (216h29m19.943816427s) [noise=true , address=104.36.82.35:4588 , piece_id=CMXJARYCTZDKGQ3YO7UTRIDGCCKZS6Z2MZX5SIV4QKVD7IHR66CA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033694344 (216h29m19.992791582s) [noise=true , address=45.91.116.11:4151 , piece_id=7KXYLZXRCG7T2GVFBU3J6ESDGYA7LO3VKAXBWIJ5SIIM3ZEACX7A, seg_pos={0 0}, upload=225414]: Done uploading piece. err: <nil>
Aug 17 17:54:58.033732846 (216h29m19.992830093s) [seg_pos={0 0}, upload=225414]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:54:58.034040813 (216h29m19.993138049s) [noise=true , address=104.36.82.16:4296 , piece_id=HTJQ7GEOD3XB7RP4IBE3PZNXDIU27FSNTIX6Y4YCSGOAQKINZKYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034068341 (216h29m19.993165577s) [noise=true , address=104.36.82.62:4431 , piece_id=6LIDSZEB3Y2HDBZ7FYGACRFNRKUP4HGM7MXHDDREPIX5IRX2QBAA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KBe2tkkC8f4gXvHFRiZNNaUYoVVd6scwbxWDDBCbcZJPd5kbj): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034146397 (216h29m19.993243631s) [noise=true , address=79.127.220.98:4423 , piece_id=2QQOVOANVCAMR45OFFGBJY4QR55N72DWBMH6P7FRBUGQNXI75TOQ, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Mg8ujbdjncZ8aiGM1mL3m7D6B58MGspzMT3qztj5iG4WqHYVk): protocol: expected piece hash; context canceled; EOF
Aug 17 17:54:58.034252187 (216h29m19.993349433s) [noise=true , address=64.49.13.137:4493 , piece_id=DBC4YLBZ5IYRXVOT6OL4Y5GJS6JSVLEMQKTNYL7RIAVBN7LQDJYA, seg_pos={0 0}, upload=225414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49090->64.49.13.137:4493: use of closed network connection
Aug 17 17:54:58.034275446 (216h29m19.993372681s) [seg_pos={0 0}, upload=225414]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:54:58.034353252 (216h29m19.993450487s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:54:58.034358061 (216h29m19.993455307s) [upload=225414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:54:58.216473979 (216h29m20.175571233s) [upload=225414]: Done uploading segments...
Aug 17 17:54:58.216502767 (216h29m20.175600024s) [upload=225414]: Upload finished. err: <nil>
Duration: 2.681876837s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|