Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.160932055s
FAIL (2025-08-19 06:43:26 UTC)
orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 19 06:38:44.764639559 (253h13m6.723736805s) [upload=263587]: Starting upload Aug 19 06:38:44.764722805 (253h13m6.723820074s) [upload=263587]: Done starting upload Aug 19 06:38:44.764968851 (253h13m6.724066098s) [upload=263587]: Uploading segments... Aug 19 06:38:44.765051465 (253h13m6.72414872s) [upload=263587]: Got next segment. Inline: true Aug 19 06:38:44.765058669 (253h13m6.724155915s) [upload=263587]: Waiting for error group managing segments... Aug 19 06:38:44.765130283 (253h13m6.724227532s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:38:44.765136103 (253h13m6.72423336s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:38:44.765140387 (253h13m6.724237637s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:38:44.919946054 (253h13m6.879043293s) [upload=263587]: Done uploading segments... Aug 19 06:38:44.919980537 (253h13m6.879077782s) [upload=263587]: Upload finished. err: <nil>
Duration: 1.160968027s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
994.27118ms
FAIL (2025-08-19 06:43:01 UTC)
orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 19 06:38:44.764639559 (253h13m6.723736805s) [upload=263587]: Starting upload Aug 19 06:38:44.764722805 (253h13m6.723820074s) [upload=263587]: Done starting upload Aug 19 06:38:44.764968851 (253h13m6.724066098s) [upload=263587]: Uploading segments... Aug 19 06:38:44.765051465 (253h13m6.72414872s) [upload=263587]: Got next segment. Inline: true Aug 19 06:38:44.765058669 (253h13m6.724155915s) [upload=263587]: Waiting for error group managing segments... Aug 19 06:38:44.765130283 (253h13m6.724227532s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:38:44.765136103 (253h13m6.72423336s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:38:44.765140387 (253h13m6.724237637s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:38:44.919946054 (253h13m6.879043293s) [upload=263587]: Done uploading segments... Aug 19 06:38:44.919980537 (253h13m6.879077782s) [upload=263587]: Upload finished. err: <nil>
Duration: 994.309026ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
882.933109ms
FAIL (2025-08-19 06:42:41 UTC)
orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 19 06:38:44.764639559 (253h13m6.723736805s) [upload=263587]: Starting upload Aug 19 06:38:44.764722805 (253h13m6.723820074s) [upload=263587]: Done starting upload Aug 19 06:38:44.764968851 (253h13m6.724066098s) [upload=263587]: Uploading segments... Aug 19 06:38:44.765051465 (253h13m6.72414872s) [upload=263587]: Got next segment. Inline: true Aug 19 06:38:44.765058669 (253h13m6.724155915s) [upload=263587]: Waiting for error group managing segments... Aug 19 06:38:44.765130283 (253h13m6.724227532s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:38:44.765136103 (253h13m6.72423336s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:38:44.765140387 (253h13m6.724237637s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:38:44.919946054 (253h13m6.879043293s) [upload=263587]: Done uploading segments... Aug 19 06:38:44.919980537 (253h13m6.879077782s) [upload=263587]: Upload finished. err: <nil>
Duration: 882.964539ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X..........................X...............] duration:
874.118502ms
FAIL (2025-08-19 06:42:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:31:13.926153326 (253h5m35.885250565s) [upload=263460]: Starting upload Aug 19 06:31:13.926270390 (253h5m35.885367636s) [upload=263460]: Done starting upload Aug 19 06:31:13.926369925 (253h5m35.885467166s) [upload=263460]: Uploading segments... Aug 19 06:31:13.926437753 (253h5m35.885535003s) [upload=263460]: Got next segment. Inline: true Aug 19 06:31:13.926444406 (253h5m35.885541653s) [upload=263460]: Waiting for error group managing segments... Aug 19 06:31:13.926512263 (253h5m35.88560951s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:31:13.926518167 (253h5m35.885615414s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:31:13.926522412 (253h5m35.885619659s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:31:14.017173910 (253h5m35.976271184s) [upload=263460]: Done uploading segments... Aug 19 06:31:14.017197149 (253h5m35.976294413s) [upload=263460]: Upload finished. err: metaclient: Too Many Requests
Duration: 874.227745ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X..........................X..............] duration:
867.255262ms
FAIL (2025-08-19 06:42:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:31:13.926153326 (253h5m35.885250565s) [upload=263460]: Starting upload Aug 19 06:31:13.926270390 (253h5m35.885367636s) [upload=263460]: Done starting upload Aug 19 06:31:13.926369925 (253h5m35.885467166s) [upload=263460]: Uploading segments... Aug 19 06:31:13.926437753 (253h5m35.885535003s) [upload=263460]: Got next segment. Inline: true Aug 19 06:31:13.926444406 (253h5m35.885541653s) [upload=263460]: Waiting for error group managing segments... Aug 19 06:31:13.926512263 (253h5m35.88560951s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:31:13.926518167 (253h5m35.885615414s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:31:13.926522412 (253h5m35.885619659s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:31:14.017173910 (253h5m35.976271184s) [upload=263460]: Done uploading segments... Aug 19 06:31:14.017197149 (253h5m35.976294413s) [upload=263460]: Upload finished. err: metaclient: Too Many Requests
Duration: 867.287463ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
875.969319ms
FAIL (2025-08-19 06:42:13 UTC)
orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 19 06:38:44.764639559 (253h13m6.723736805s) [upload=263587]: Starting upload Aug 19 06:38:44.764722805 (253h13m6.723820074s) [upload=263587]: Done starting upload Aug 19 06:38:44.764968851 (253h13m6.724066098s) [upload=263587]: Uploading segments... Aug 19 06:38:44.765051465 (253h13m6.72414872s) [upload=263587]: Got next segment. Inline: true Aug 19 06:38:44.765058669 (253h13m6.724155915s) [upload=263587]: Waiting for error group managing segments... Aug 19 06:38:44.765130283 (253h13m6.724227532s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:38:44.765136103 (253h13m6.72423336s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:38:44.765140387 (253h13m6.724237637s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:38:44.919946054 (253h13m6.879043293s) [upload=263587]: Done uploading segments... Aug 19 06:38:44.919980537 (253h13m6.879077782s) [upload=263587]: Upload finished. err: <nil>
Duration: 876.088386ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X..........................X.............] duration:
974.086921ms
FAIL (2025-08-19 06:41:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:31:13.926153326 (253h5m35.885250565s) [upload=263460]: Starting upload Aug 19 06:31:13.926270390 (253h5m35.885367636s) [upload=263460]: Done starting upload Aug 19 06:31:13.926369925 (253h5m35.885467166s) [upload=263460]: Uploading segments... Aug 19 06:31:13.926437753 (253h5m35.885535003s) [upload=263460]: Got next segment. Inline: true Aug 19 06:31:13.926444406 (253h5m35.885541653s) [upload=263460]: Waiting for error group managing segments... Aug 19 06:31:13.926512263 (253h5m35.88560951s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:31:13.926518167 (253h5m35.885615414s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:31:13.926522412 (253h5m35.885619659s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:31:14.017173910 (253h5m35.976271184s) [upload=263460]: Done uploading segments... Aug 19 06:31:14.017197149 (253h5m35.976294413s) [upload=263460]: Upload finished. err: metaclient: Too Many Requests
Duration: 974.116512ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
841.294641ms
FAIL (2025-08-19 06:40:59 UTC)
orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 19 06:38:44.764639559 (253h13m6.723736805s) [upload=263587]: Starting upload Aug 19 06:38:44.764722805 (253h13m6.723820074s) [upload=263587]: Done starting upload Aug 19 06:38:44.764968851 (253h13m6.724066098s) [upload=263587]: Uploading segments... Aug 19 06:38:44.765051465 (253h13m6.72414872s) [upload=263587]: Got next segment. Inline: true Aug 19 06:38:44.765058669 (253h13m6.724155915s) [upload=263587]: Waiting for error group managing segments... Aug 19 06:38:44.765130283 (253h13m6.724227532s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:38:44.765136103 (253h13m6.72423336s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:38:44.765140387 (253h13m6.724237637s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:38:44.919946054 (253h13m6.879043293s) [upload=263587]: Done uploading segments... Aug 19 06:38:44.919980537 (253h13m6.879077782s) [upload=263587]: Upload finished. err: <nil>
Duration: 841.341564ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X..........................X............] duration:
1.097736415s
FAIL (2025-08-19 06:40:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:31:13.926153326 (253h5m35.885250565s) [upload=263460]: Starting upload Aug 19 06:31:13.926270390 (253h5m35.885367636s) [upload=263460]: Done starting upload Aug 19 06:31:13.926369925 (253h5m35.885467166s) [upload=263460]: Uploading segments... Aug 19 06:31:13.926437753 (253h5m35.885535003s) [upload=263460]: Got next segment. Inline: true Aug 19 06:31:13.926444406 (253h5m35.885541653s) [upload=263460]: Waiting for error group managing segments... Aug 19 06:31:13.926512263 (253h5m35.88560951s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:31:13.926518167 (253h5m35.885615414s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:31:13.926522412 (253h5m35.885619659s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:31:14.017173910 (253h5m35.976271184s) [upload=263460]: Done uploading segments... Aug 19 06:31:14.017197149 (253h5m35.976294413s) [upload=263460]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.097770999s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
917.028299ms
FAIL (2025-08-19 06:39:45 UTC)
orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 19 06:38:44.764639559 (253h13m6.723736805s) [upload=263587]: Starting upload Aug 19 06:38:44.764722805 (253h13m6.723820074s) [upload=263587]: Done starting upload Aug 19 06:38:44.764968851 (253h13m6.724066098s) [upload=263587]: Uploading segments... Aug 19 06:38:44.765051465 (253h13m6.72414872s) [upload=263587]: Got next segment. Inline: true Aug 19 06:38:44.765058669 (253h13m6.724155915s) [upload=263587]: Waiting for error group managing segments... Aug 19 06:38:44.765130283 (253h13m6.724227532s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:38:44.765136103 (253h13m6.72423336s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:38:44.765140387 (253h13m6.724237637s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:38:44.919946054 (253h13m6.879043293s) [upload=263587]: Done uploading segments... Aug 19 06:38:44.919980537 (253h13m6.879077782s) [upload=263587]: Upload finished. err: <nil>
Duration: 917.053817ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.001100252s
FAIL (2025-08-19 06:39:44 UTC)
orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 19 06:38:44.764639559 (253h13m6.723736805s) [upload=263587]: Starting upload Aug 19 06:38:44.764722805 (253h13m6.723820074s) [upload=263587]: Done starting upload Aug 19 06:38:44.764968851 (253h13m6.724066098s) [upload=263587]: Uploading segments... Aug 19 06:38:44.765051465 (253h13m6.72414872s) [upload=263587]: Got next segment. Inline: true Aug 19 06:38:44.765058669 (253h13m6.724155915s) [upload=263587]: Waiting for error group managing segments... Aug 19 06:38:44.765130283 (253h13m6.724227532s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:38:44.765136103 (253h13m6.72423336s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:38:44.765140387 (253h13m6.724237637s) [upload=263587]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:38:44.919946054 (253h13m6.879043293s) [upload=263587]: Done uploading segments... Aug 19 06:38:44.919980537 (253h13m6.879077782s) [upload=263587]: Upload finished. err: <nil>
Duration: 1m0.001150164s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X..........................X...........] duration:
856.380247ms
FAIL (2025-08-19 06:39:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:31:13.926153326 (253h5m35.885250565s) [upload=263460]: Starting upload Aug 19 06:31:13.926270390 (253h5m35.885367636s) [upload=263460]: Done starting upload Aug 19 06:31:13.926369925 (253h5m35.885467166s) [upload=263460]: Uploading segments... Aug 19 06:31:13.926437753 (253h5m35.885535003s) [upload=263460]: Got next segment. Inline: true Aug 19 06:31:13.926444406 (253h5m35.885541653s) [upload=263460]: Waiting for error group managing segments... Aug 19 06:31:13.926512263 (253h5m35.88560951s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:31:13.926518167 (253h5m35.885615414s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:31:13.926522412 (253h5m35.885619659s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:31:14.017173910 (253h5m35.976271184s) [upload=263460]: Done uploading segments... Aug 19 06:31:14.017197149 (253h5m35.976294413s) [upload=263460]: Upload finished. err: metaclient: Too Many Requests
Duration: 856.421343ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X..........................X..........] duration:
1.160466694s
FAIL (2025-08-19 06:38:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:31:13.926153326 (253h5m35.885250565s) [upload=263460]: Starting upload Aug 19 06:31:13.926270390 (253h5m35.885367636s) [upload=263460]: Done starting upload Aug 19 06:31:13.926369925 (253h5m35.885467166s) [upload=263460]: Uploading segments... Aug 19 06:31:13.926437753 (253h5m35.885535003s) [upload=263460]: Got next segment. Inline: true Aug 19 06:31:13.926444406 (253h5m35.885541653s) [upload=263460]: Waiting for error group managing segments... Aug 19 06:31:13.926512263 (253h5m35.88560951s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:31:13.926518167 (253h5m35.885615414s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:31:13.926522412 (253h5m35.885619659s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:31:14.017173910 (253h5m35.976271184s) [upload=263460]: Done uploading segments... Aug 19 06:31:14.017197149 (253h5m35.976294413s) [upload=263460]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.160501368s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X..........................X.........] duration:
1.56190155s
FAIL (2025-08-19 06:37:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:31:13.926153326 (253h5m35.885250565s) [upload=263460]: Starting upload Aug 19 06:31:13.926270390 (253h5m35.885367636s) [upload=263460]: Done starting upload Aug 19 06:31:13.926369925 (253h5m35.885467166s) [upload=263460]: Uploading segments... Aug 19 06:31:13.926437753 (253h5m35.885535003s) [upload=263460]: Got next segment. Inline: true Aug 19 06:31:13.926444406 (253h5m35.885541653s) [upload=263460]: Waiting for error group managing segments... Aug 19 06:31:13.926512263 (253h5m35.88560951s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:31:13.926518167 (253h5m35.885615414s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:31:13.926522412 (253h5m35.885619659s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:31:14.017173910 (253h5m35.976271184s) [upload=263460]: Done uploading segments... Aug 19 06:31:14.017197149 (253h5m35.976294413s) [upload=263460]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.561956463s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X..........................X........] duration:
823.773462ms
FAIL (2025-08-19 06:37:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:31:13.926153326 (253h5m35.885250565s) [upload=263460]: Starting upload Aug 19 06:31:13.926270390 (253h5m35.885367636s) [upload=263460]: Done starting upload Aug 19 06:31:13.926369925 (253h5m35.885467166s) [upload=263460]: Uploading segments... Aug 19 06:31:13.926437753 (253h5m35.885535003s) [upload=263460]: Got next segment. Inline: true Aug 19 06:31:13.926444406 (253h5m35.885541653s) [upload=263460]: Waiting for error group managing segments... Aug 19 06:31:13.926512263 (253h5m35.88560951s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:31:13.926518167 (253h5m35.885615414s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:31:13.926522412 (253h5m35.885619659s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:31:14.017173910 (253h5m35.976271184s) [upload=263460]: Done uploading segments... Aug 19 06:31:14.017197149 (253h5m35.976294413s) [upload=263460]: Upload finished. err: metaclient: Too Many Requests
Duration: 823.889542ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X..........................X.......] duration:
796.66765ms
FAIL (2025-08-19 06:37:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:31:13.926153326 (253h5m35.885250565s) [upload=263460]: Starting upload Aug 19 06:31:13.926270390 (253h5m35.885367636s) [upload=263460]: Done starting upload Aug 19 06:31:13.926369925 (253h5m35.885467166s) [upload=263460]: Uploading segments... Aug 19 06:31:13.926437753 (253h5m35.885535003s) [upload=263460]: Got next segment. Inline: true Aug 19 06:31:13.926444406 (253h5m35.885541653s) [upload=263460]: Waiting for error group managing segments... Aug 19 06:31:13.926512263 (253h5m35.88560951s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:31:13.926518167 (253h5m35.885615414s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:31:13.926522412 (253h5m35.885619659s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:31:14.017173910 (253h5m35.976271184s) [upload=263460]: Done uploading segments... Aug 19 06:31:14.017197149 (253h5m35.976294413s) [upload=263460]: Upload finished. err: metaclient: Too Many Requests
Duration: 796.698062ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X..........................X......] duration:
829.173028ms
FAIL (2025-08-19 06:36:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:31:13.926153326 (253h5m35.885250565s) [upload=263460]: Starting upload Aug 19 06:31:13.926270390 (253h5m35.885367636s) [upload=263460]: Done starting upload Aug 19 06:31:13.926369925 (253h5m35.885467166s) [upload=263460]: Uploading segments... Aug 19 06:31:13.926437753 (253h5m35.885535003s) [upload=263460]: Got next segment. Inline: true Aug 19 06:31:13.926444406 (253h5m35.885541653s) [upload=263460]: Waiting for error group managing segments... Aug 19 06:31:13.926512263 (253h5m35.88560951s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:31:13.926518167 (253h5m35.885615414s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:31:13.926522412 (253h5m35.885619659s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:31:14.017173910 (253h5m35.976271184s) [upload=263460]: Done uploading segments... Aug 19 06:31:14.017197149 (253h5m35.976294413s) [upload=263460]: Upload finished. err: metaclient: Too Many Requests
Duration: 829.21008ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X..........................X.....] duration:
845.038632ms
FAIL (2025-08-19 06:35:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:31:13.926153326 (253h5m35.885250565s) [upload=263460]: Starting upload Aug 19 06:31:13.926270390 (253h5m35.885367636s) [upload=263460]: Done starting upload Aug 19 06:31:13.926369925 (253h5m35.885467166s) [upload=263460]: Uploading segments... Aug 19 06:31:13.926437753 (253h5m35.885535003s) [upload=263460]: Got next segment. Inline: true Aug 19 06:31:13.926444406 (253h5m35.885541653s) [upload=263460]: Waiting for error group managing segments... Aug 19 06:31:13.926512263 (253h5m35.88560951s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:31:13.926518167 (253h5m35.885615414s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:31:13.926522412 (253h5m35.885619659s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:31:14.017173910 (253h5m35.976271184s) [upload=263460]: Done uploading segments... Aug 19 06:31:14.017197149 (253h5m35.976294413s) [upload=263460]: Upload finished. err: metaclient: Too Many Requests
Duration: 845.07062ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X..........................X....] duration:
1.032733229s
FAIL (2025-08-19 06:34:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:31:13.926153326 (253h5m35.885250565s) [upload=263460]: Starting upload Aug 19 06:31:13.926270390 (253h5m35.885367636s) [upload=263460]: Done starting upload Aug 19 06:31:13.926369925 (253h5m35.885467166s) [upload=263460]: Uploading segments... Aug 19 06:31:13.926437753 (253h5m35.885535003s) [upload=263460]: Got next segment. Inline: true Aug 19 06:31:13.926444406 (253h5m35.885541653s) [upload=263460]: Waiting for error group managing segments... Aug 19 06:31:13.926512263 (253h5m35.88560951s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:31:13.926518167 (253h5m35.885615414s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:31:13.926522412 (253h5m35.885619659s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:31:14.017173910 (253h5m35.976271184s) [upload=263460]: Done uploading segments... Aug 19 06:31:14.017197149 (253h5m35.976294413s) [upload=263460]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.032762262s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X..........................X...] duration:
824.651582ms
FAIL (2025-08-19 06:33:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:31:13.926153326 (253h5m35.885250565s) [upload=263460]: Starting upload Aug 19 06:31:13.926270390 (253h5m35.885367636s) [upload=263460]: Done starting upload Aug 19 06:31:13.926369925 (253h5m35.885467166s) [upload=263460]: Uploading segments... Aug 19 06:31:13.926437753 (253h5m35.885535003s) [upload=263460]: Got next segment. Inline: true Aug 19 06:31:13.926444406 (253h5m35.885541653s) [upload=263460]: Waiting for error group managing segments... Aug 19 06:31:13.926512263 (253h5m35.88560951s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:31:13.926518167 (253h5m35.885615414s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:31:13.926522412 (253h5m35.885619659s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:31:14.017173910 (253h5m35.976271184s) [upload=263460]: Done uploading segments... Aug 19 06:31:14.017197149 (253h5m35.976294413s) [upload=263460]: Upload finished. err: metaclient: Too Many Requests
Duration: 824.696005ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X..........................X..] duration:
908.750614ms
FAIL (2025-08-19 06:32:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:31:13.926153326 (253h5m35.885250565s) [upload=263460]: Starting upload Aug 19 06:31:13.926270390 (253h5m35.885367636s) [upload=263460]: Done starting upload Aug 19 06:31:13.926369925 (253h5m35.885467166s) [upload=263460]: Uploading segments... Aug 19 06:31:13.926437753 (253h5m35.885535003s) [upload=263460]: Got next segment. Inline: true Aug 19 06:31:13.926444406 (253h5m35.885541653s) [upload=263460]: Waiting for error group managing segments... Aug 19 06:31:13.926512263 (253h5m35.88560951s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:31:13.926518167 (253h5m35.885615414s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:31:13.926522412 (253h5m35.885619659s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:31:14.017173910 (253h5m35.976271184s) [upload=263460]: Done uploading segments... Aug 19 06:31:14.017197149 (253h5m35.976294413s) [upload=263460]: Upload finished. err: metaclient: Too Many Requests
Duration: 908.786573ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X..........................X.] duration:
1.022487195s
FAIL (2025-08-19 06:32:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:31:13.926153326 (253h5m35.885250565s) [upload=263460]: Starting upload Aug 19 06:31:13.926270390 (253h5m35.885367636s) [upload=263460]: Done starting upload Aug 19 06:31:13.926369925 (253h5m35.885467166s) [upload=263460]: Uploading segments... Aug 19 06:31:13.926437753 (253h5m35.885535003s) [upload=263460]: Got next segment. Inline: true Aug 19 06:31:13.926444406 (253h5m35.885541653s) [upload=263460]: Waiting for error group managing segments... Aug 19 06:31:13.926512263 (253h5m35.88560951s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:31:13.926518167 (253h5m35.885615414s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:31:13.926522412 (253h5m35.885619659s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:31:14.017173910 (253h5m35.976271184s) [upload=263460]: Done uploading segments... Aug 19 06:31:14.017197149 (253h5m35.976294413s) [upload=263460]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.022509112s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X..........................X] duration:
369.622784ms
FAIL (2025-08-19 06:31:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:31:13.926153326 (253h5m35.885250565s) [upload=263460]: Starting upload Aug 19 06:31:13.926270390 (253h5m35.885367636s) [upload=263460]: Done starting upload Aug 19 06:31:13.926369925 (253h5m35.885467166s) [upload=263460]: Uploading segments... Aug 19 06:31:13.926437753 (253h5m35.885535003s) [upload=263460]: Got next segment. Inline: true Aug 19 06:31:13.926444406 (253h5m35.885541653s) [upload=263460]: Waiting for error group managing segments... Aug 19 06:31:13.926512263 (253h5m35.88560951s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:31:13.926518167 (253h5m35.885615414s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:31:13.926522412 (253h5m35.885619659s) [upload=263460]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:31:14.017173910 (253h5m35.976271184s) [upload=263460]: Done uploading segments... Aug 19 06:31:14.017197149 (253h5m35.976294413s) [upload=263460]: Upload finished. err: metaclient: Too Many Requests
Duration: 369.648215ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
867.958261ms
FAIL (2025-08-19 06:30:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 867.99352ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.459587131s
FAIL (2025-08-19 06:29:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.459626588s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
989.833092ms
FAIL (2025-08-19 06:29:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 989.870069ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.439063988s
FAIL (2025-08-19 06:29:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.439099444s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
1.055792394s
FAIL (2025-08-19 06:28:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.055841561s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.281120376s
FAIL (2025-08-19 06:28:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.281167241s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
964.750301ms
FAIL (2025-08-19 06:28:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 964.792177ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.271990242s
FAIL (2025-08-19 06:27:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.272029602s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.511779957s
FAIL (2025-08-19 06:26:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.511872817s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
820.692602ms
FAIL (2025-08-19 06:26:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 820.720176ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.478231574s
FAIL (2025-08-19 06:26:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.47835322s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
1.062777012s
FAIL (2025-08-19 06:25:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.062813482s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
997.588656ms
FAIL (2025-08-19 06:25:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 997.624882ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.484054366s
FAIL (2025-08-19 06:24:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.484089758s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.421058988s
FAIL (2025-08-19 06:24:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.42124676s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
803.252059ms
FAIL (2025-08-19 06:24:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 803.287489ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.282783624s
FAIL (2025-08-19 06:23:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.282829336s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.406702844s
FAIL (2025-08-19 06:23:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.40679272s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
981.352204ms
FAIL (2025-08-19 06:23:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 981.405876ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.487697412s
FAIL (2025-08-19 06:23:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.487732362s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
854.618027ms
FAIL (2025-08-19 06:22:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 854.655095ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.28525805s
FAIL (2025-08-19 06:22:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.285292217s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
807.516888ms
FAIL (2025-08-19 06:22:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 807.548113ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
915.599666ms
FAIL (2025-08-19 06:21:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 915.629453ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.361474196s
FAIL (2025-08-19 06:21:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.36151212s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
813.332611ms
FAIL (2025-08-19 06:21:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 06:12:51.266384994 (252h47m13.22548224s) [upload=263135]: Starting upload Aug 19 06:12:51.266445636 (252h47m13.225542872s) [upload=263135]: Done starting upload Aug 19 06:12:51.266552473 (252h47m13.225649707s) [upload=263135]: Uploading segments... Aug 19 06:12:51.266643048 (252h47m13.225740293s) [upload=263135]: Got next segment. Inline: true Aug 19 06:12:51.266650135 (252h47m13.22574738s) [upload=263135]: Waiting for error group managing segments... Aug 19 06:12:51.266723288 (252h47m13.225820522s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 06:12:51.266730305 (252h47m13.225827551s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 06:12:51.266734069 (252h47m13.225831316s) [upload=263135]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 06:12:51.361675946 (252h47m13.320773192s) [upload=263135]: Done uploading segments... Aug 19 06:12:51.361696033 (252h47m13.320793278s) [upload=263135]: Upload finished. err: metaclient: Too Many Requests
Duration: 813.369985ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.271543985s
FAIL (2025-08-19 06:20:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 05:51:27.023019670 (252h25m48.982116908s) [upload=262748]: Starting upload
Aug 19 05:51:27.023079007 (252h25m48.982176252s) [upload=262748]: Done starting upload
Aug 19 05:51:27.023196853 (252h25m48.982294091s) [upload=262748]: Uploading segments...
Aug 19 05:51:27.023336757 (252h25m48.982433995s) [upload=262748]: Got next segment. Inline: false
Aug 19 05:51:27.023382720 (252h25m48.982479966s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:51:27.023388633 (252h25m48.982485872s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:51:27.223926226 (252h25m49.183023493s) [seg_pos={0 0}, upload=262748]: Begin upload segment...
Aug 19 05:51:27.223983890 (252h25m49.183081145s) [seg_pos={0 0}, upload=262748]: Done begin upload segment.
Aug 19 05:51:27.224038583 (252h25m49.183135837s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.224755879 (252h25m49.183853188s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225153357 (252h25m49.184250607s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225378744 (252h25m49.184475998s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.225741442 (252h25m49.184838689s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226130696 (252h25m49.18522795s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226380915 (252h25m49.185478163s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.226627749 (252h25m49.185725s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227222192 (252h25m49.186319447s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.227650182 (252h25m49.186747437s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228021209 (252h25m49.187118465s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228370136 (252h25m49.187467391s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.228835705 (252h25m49.187932963s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229189003 (252h25m49.188286259s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229354638 (252h25m49.188451892s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.229776216 (252h25m49.188873466s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230182800 (252h25m49.189280048s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.230560029 (252h25m49.189657277s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Uploading piece...
Aug 19 05:51:27.796290217 (252h25m49.755387456s) [upload=262748]: Next returned nil segment
Aug 19 05:51:27.796305550 (252h25m49.755402785s) [upload=262748]: Waiting for error group managing segments...
Aug 19 05:51:27.934848048 (252h25m49.893945294s) [noise=true , address=77.90.31.19:4865 , piece_id=GRSMEKXTLIJIN7M5OK2FTUNOUXVAZFOSXPROMAXQJSDS6IZGDPBQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.938129286 (252h25m49.897226519s) [noise=true , address=45.91.116.13:4186 , piece_id=M32CYH6TIQUVISB2UKYVTIT4HI24QAKTMYHMGUA7EGQX6ZDSH6QQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.944870492 (252h25m49.903967731s) [noise=true , address=45.91.116.10:4113 , piece_id=KZFOBFE6MPFFRBQ7YXD72FC2A2VHEVZ5WGQ4CKY2A4EFN7QR6TXQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.946065607 (252h25m49.905162858s) [noise=true , address=104.36.82.58:4267 , piece_id=BTLANEFXYSR4RPP36CYEIFQO6J524ROUYK4TT24KYGGXYQGDB4PQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.948009513 (252h25m49.907106752s) [noise=true , address=45.91.116.7:4022 , piece_id=GQGNO3EEQV7RYV5I2P33AGLABEQZNIYPRIS26SG5KRO5GHNYPVBA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.954678899 (252h25m49.913776131s) [noise=true , address=45.91.116.8:4060 , piece_id=KA3AGPPNHG2TO2KFN6UIIBPSUH5TXHGUOO3MMT2W5N6AKA473EJA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.973474920 (252h25m49.932572154s) [noise=true , address=104.36.82.60:4354 , piece_id=W7L67TXVWTMGDUQAZ6CZ56PWZJCCP2O7U4SRRYP3WHI5ADEBMGXA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.991385454 (252h25m49.950482707s) [noise=true , address=45.91.116.9:4278 , piece_id=GSPMXRYZ6OEXPABCYHORYPS5QVDJ5GGUGENPWSRLSTPATGMM7WTQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:27.993429719 (252h25m49.952526953s) [noise=true , address=79.127.219.38:4033 , piece_id=5ERJUCBSLYWBCK23MNBBCQ7KIR33DLXMOXB4J5IERJHZ7XWD7E6Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.021823672 (252h25m49.980920938s) [noise=true , address=77.90.31.12:4595 , piece_id=QEXEDUGZ5H4BV5QQ4PEGLFXUYC6ZJLAGZWH5AFOFRVGLM2YIT3DQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.028814547 (252h25m49.987911791s) [noise=true , address=77.90.31.10:4541 , piece_id=3UMTX3XXYELUS26M5YCR5YJEWZ24QXPVSMQMN3SCAAVKPC4O2LRQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.097221909 (252h25m50.056319147s) [noise=true , address=79.127.220.97:4384 , piece_id=B6AZSV4U6YIQRRJYWGGI3QUZHJY4LKWTFW2S2IBAFO7TWQSLINKQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.180278903 (252h25m50.13937614s) [noise=true , address=77.90.31.11:4563 , piece_id=DCNMB2PXX3X2S6VWA7REXBRMLI332EVC5B7ZCTL7ETGGWAG4QGHA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243664334 (252h25m50.202761572s) [noise=true , address=79.127.201.215:4357 , piece_id=7A6G553VPHO7KLBSA24SFXZETUDLVWNQULSSJOJW4IQHOIWIXYMQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: <nil>
Aug 19 05:51:28.243705084 (252h25m50.20280233s) [seg_pos={0 0}, upload=262748]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:51:28.244032154 (252h25m50.203129387s) [noise=true , address=66.23.193.175:4556 , piece_id=L7LHCCMZCB4EEL3WP5EJQJC3QEQJTJM5ZYX5UZ4U6GNYCRZGUN5A, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244228783 (252h25m50.203326016s) [noise=true , address=77.90.31.17:4769 , piece_id=Z64KWJM3NHP73FHBHXWP3CPRAJC6F2T4A3GWXIDVM2TRURI3XP3Q, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244358947 (252h25m50.203456182s) [noise=true , address=77.90.31.18:4838 , piece_id=EP67M5GS2LBQ57FKWB3YEBPEOXVO64IF3WLFZE5OSCDUDKDSA2FQ, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1if7vf1cNTBwAhb6owi6tuGLYqSfa3feWhsvGSevwuwykhz2RY): protocol: expected piece hash; context canceled; EOF
Aug 19 05:51:28.244564421 (252h25m50.203661674s) [noise=true , address=77.90.31.13:4633 , piece_id=6CER3QED7A4GU5CSZ3KERPYCF4PBT5HSIJOGZERJAWUSYLPANRNA, seg_pos={0 0}, upload=262748]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs): protocol: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57578->77.90.31.13:4633: use of closed network connection
Aug 19 05:51:28.244588194 (252h25m50.203685427s) [seg_pos={0 0}, upload=262748]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:51:28.245007022 (252h25m50.204104268s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:51:28.245015081 (252h25m50.204112327s) [upload=262748]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:51:28.466260926 (252h25m50.425358171s) [upload=262748]: Done uploading segments...
Aug 19 05:51:28.466295046 (252h25m50.425392291s) [upload=262748]: Upload finished. err: <nil>
Duration: 2.271578114s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|