Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [X......X......X......X.........................X.....X......] duration:
2.55859094s
FAIL (2025-08-19 11:47:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:43:04.009020798 (258h17m25.968118051s) [upload=268914]: Starting upload Aug 19 11:43:04.009132012 (258h17m25.968229269s) [upload=268914]: Done starting upload Aug 19 11:43:04.010218663 (258h17m25.969315914s) [upload=268914]: Uploading segments... Aug 19 11:43:04.010361161 (258h17m25.969458423s) [upload=268914]: Got next segment. Inline: false Aug 19 11:43:04.010898872 (258h17m25.96999612s) [upload=268914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:43:04.010920171 (258h17m25.970017421s) [upload=268914]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:43:04.107633051 (258h17m26.066730302s) [upload=268914]: Next segment err: metaclient: Too Many Requests Aug 19 11:43:04.107694364 (258h17m26.066791619s) [upload=268914]: Done uploading segments... Aug 19 11:43:04.107719680 (258h17m26.066816928s) [upload=268914]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.558626364s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X.......................X................] duration:
981.564341ms
FAIL (2025-08-19 11:47:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 490878781e1ea8e8cd6744799db88c339bda649181c8484b7767ab5a9081a558 != before f3eb7f08955a4df7505935be177c550883be751cbad269f169d76a80ae86dfbf ======LOGS====== Aug 19 11:33:30.219497611 (258h7m52.178594866s) [upload=268745]: Starting upload Aug 19 11:33:30.219613119 (258h7m52.178710358s) [upload=268745]: Done starting upload Aug 19 11:33:30.219663567 (258h7m52.178760805s) [upload=268745]: Uploading segments... Aug 19 11:33:30.219812467 (258h7m52.178909719s) [upload=268745]: Got next segment. Inline: true Aug 19 11:33:30.219832065 (258h7m52.178929295s) [upload=268745]: Waiting for error group managing segments... Aug 19 11:33:30.219911126 (258h7m52.179008378s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:33:30.219917917 (258h7m52.179015161s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:33:30.219921673 (258h7m52.179018986s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:33:30.552868796 (258h7m52.511966061s) [upload=268745]: Done uploading segments... Aug 19 11:33:30.552910407 (258h7m52.512007652s) [upload=268745]: Upload finished. err: <nil>
Duration: 981.678364ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.X......X......X......X.........................X.....X.....] duration:
2.60360885s
FAIL (2025-08-19 11:46:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:43:04.009020798 (258h17m25.968118051s) [upload=268914]: Starting upload Aug 19 11:43:04.009132012 (258h17m25.968229269s) [upload=268914]: Done starting upload Aug 19 11:43:04.010218663 (258h17m25.969315914s) [upload=268914]: Uploading segments... Aug 19 11:43:04.010361161 (258h17m25.969458423s) [upload=268914]: Got next segment. Inline: false Aug 19 11:43:04.010898872 (258h17m25.96999612s) [upload=268914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:43:04.010920171 (258h17m25.970017421s) [upload=268914]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:43:04.107633051 (258h17m26.066730302s) [upload=268914]: Next segment err: metaclient: Too Many Requests Aug 19 11:43:04.107694364 (258h17m26.066791619s) [upload=268914]: Done uploading segments... Aug 19 11:43:04.107719680 (258h17m26.066816928s) [upload=268914]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.603642748s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X.......................X...............] duration:
902.188532ms
FAIL (2025-08-19 11:46:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 490878781e1ea8e8cd6744799db88c339bda649181c8484b7767ab5a9081a558 != before f3eb7f08955a4df7505935be177c550883be751cbad269f169d76a80ae86dfbf ======LOGS====== Aug 19 11:33:30.219497611 (258h7m52.178594866s) [upload=268745]: Starting upload Aug 19 11:33:30.219613119 (258h7m52.178710358s) [upload=268745]: Done starting upload Aug 19 11:33:30.219663567 (258h7m52.178760805s) [upload=268745]: Uploading segments... Aug 19 11:33:30.219812467 (258h7m52.178909719s) [upload=268745]: Got next segment. Inline: true Aug 19 11:33:30.219832065 (258h7m52.178929295s) [upload=268745]: Waiting for error group managing segments... Aug 19 11:33:30.219911126 (258h7m52.179008378s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:33:30.219917917 (258h7m52.179015161s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:33:30.219921673 (258h7m52.179018986s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:33:30.552868796 (258h7m52.511966061s) [upload=268745]: Done uploading segments... Aug 19 11:33:30.552910407 (258h7m52.512007652s) [upload=268745]: Upload finished. err: <nil>
Duration: 902.240501ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..X......X......X......X.........................X.....X....] duration:
2.897997622s
FAIL (2025-08-19 11:46:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:43:04.009020798 (258h17m25.968118051s) [upload=268914]: Starting upload Aug 19 11:43:04.009132012 (258h17m25.968229269s) [upload=268914]: Done starting upload Aug 19 11:43:04.010218663 (258h17m25.969315914s) [upload=268914]: Uploading segments... Aug 19 11:43:04.010361161 (258h17m25.969458423s) [upload=268914]: Got next segment. Inline: false Aug 19 11:43:04.010898872 (258h17m25.96999612s) [upload=268914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:43:04.010920171 (258h17m25.970017421s) [upload=268914]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:43:04.107633051 (258h17m26.066730302s) [upload=268914]: Next segment err: metaclient: Too Many Requests Aug 19 11:43:04.107694364 (258h17m26.066791619s) [upload=268914]: Done uploading segments... Aug 19 11:43:04.107719680 (258h17m26.066816928s) [upload=268914]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.898106885s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...X......X......X......X.........................X.....X...] duration:
2.551195342s
FAIL (2025-08-19 11:46:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:43:04.009020798 (258h17m25.968118051s) [upload=268914]: Starting upload Aug 19 11:43:04.009132012 (258h17m25.968229269s) [upload=268914]: Done starting upload Aug 19 11:43:04.010218663 (258h17m25.969315914s) [upload=268914]: Uploading segments... Aug 19 11:43:04.010361161 (258h17m25.969458423s) [upload=268914]: Got next segment. Inline: false Aug 19 11:43:04.010898872 (258h17m25.96999612s) [upload=268914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:43:04.010920171 (258h17m25.970017421s) [upload=268914]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:43:04.107633051 (258h17m26.066730302s) [upload=268914]: Next segment err: metaclient: Too Many Requests Aug 19 11:43:04.107694364 (258h17m26.066791619s) [upload=268914]: Done uploading segments... Aug 19 11:43:04.107719680 (258h17m26.066816928s) [upload=268914]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.551232492s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X.......................X..............] duration:
869.594902ms
FAIL (2025-08-19 11:45:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 490878781e1ea8e8cd6744799db88c339bda649181c8484b7767ab5a9081a558 != before f3eb7f08955a4df7505935be177c550883be751cbad269f169d76a80ae86dfbf ======LOGS====== Aug 19 11:33:30.219497611 (258h7m52.178594866s) [upload=268745]: Starting upload Aug 19 11:33:30.219613119 (258h7m52.178710358s) [upload=268745]: Done starting upload Aug 19 11:33:30.219663567 (258h7m52.178760805s) [upload=268745]: Uploading segments... Aug 19 11:33:30.219812467 (258h7m52.178909719s) [upload=268745]: Got next segment. Inline: true Aug 19 11:33:30.219832065 (258h7m52.178929295s) [upload=268745]: Waiting for error group managing segments... Aug 19 11:33:30.219911126 (258h7m52.179008378s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:33:30.219917917 (258h7m52.179015161s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:33:30.219921673 (258h7m52.179018986s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:33:30.552868796 (258h7m52.511966061s) [upload=268745]: Done uploading segments... Aug 19 11:33:30.552910407 (258h7m52.512007652s) [upload=268745]: Upload finished. err: <nil>
Duration: 869.640308ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X.......................X.............] duration:
872.490849ms
FAIL (2025-08-19 11:44:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 490878781e1ea8e8cd6744799db88c339bda649181c8484b7767ab5a9081a558 != before f3eb7f08955a4df7505935be177c550883be751cbad269f169d76a80ae86dfbf ======LOGS====== Aug 19 11:33:30.219497611 (258h7m52.178594866s) [upload=268745]: Starting upload Aug 19 11:33:30.219613119 (258h7m52.178710358s) [upload=268745]: Done starting upload Aug 19 11:33:30.219663567 (258h7m52.178760805s) [upload=268745]: Uploading segments... Aug 19 11:33:30.219812467 (258h7m52.178909719s) [upload=268745]: Got next segment. Inline: true Aug 19 11:33:30.219832065 (258h7m52.178929295s) [upload=268745]: Waiting for error group managing segments... Aug 19 11:33:30.219911126 (258h7m52.179008378s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:33:30.219917917 (258h7m52.179015161s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:33:30.219921673 (258h7m52.179018986s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:33:30.552868796 (258h7m52.511966061s) [upload=268745]: Done uploading segments... Aug 19 11:33:30.552910407 (258h7m52.512007652s) [upload=268745]: Upload finished. err: <nil>
Duration: 872.53112ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [....X......X......X......X.........................X.....X..] duration:
2.697669698s
FAIL (2025-08-19 11:44:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:43:04.009020798 (258h17m25.968118051s) [upload=268914]: Starting upload Aug 19 11:43:04.009132012 (258h17m25.968229269s) [upload=268914]: Done starting upload Aug 19 11:43:04.010218663 (258h17m25.969315914s) [upload=268914]: Uploading segments... Aug 19 11:43:04.010361161 (258h17m25.969458423s) [upload=268914]: Got next segment. Inline: false Aug 19 11:43:04.010898872 (258h17m25.96999612s) [upload=268914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:43:04.010920171 (258h17m25.970017421s) [upload=268914]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:43:04.107633051 (258h17m26.066730302s) [upload=268914]: Next segment err: metaclient: Too Many Requests Aug 19 11:43:04.107694364 (258h17m26.066791619s) [upload=268914]: Done uploading segments... Aug 19 11:43:04.107719680 (258h17m26.066816928s) [upload=268914]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.697712265s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X.......................X............] duration:
1.176463362s
FAIL (2025-08-19 11:44:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 490878781e1ea8e8cd6744799db88c339bda649181c8484b7767ab5a9081a558 != before f3eb7f08955a4df7505935be177c550883be751cbad269f169d76a80ae86dfbf ======LOGS====== Aug 19 11:33:30.219497611 (258h7m52.178594866s) [upload=268745]: Starting upload Aug 19 11:33:30.219613119 (258h7m52.178710358s) [upload=268745]: Done starting upload Aug 19 11:33:30.219663567 (258h7m52.178760805s) [upload=268745]: Uploading segments... Aug 19 11:33:30.219812467 (258h7m52.178909719s) [upload=268745]: Got next segment. Inline: true Aug 19 11:33:30.219832065 (258h7m52.178929295s) [upload=268745]: Waiting for error group managing segments... Aug 19 11:33:30.219911126 (258h7m52.179008378s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:33:30.219917917 (258h7m52.179015161s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:33:30.219921673 (258h7m52.179018986s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:33:30.552868796 (258h7m52.511966061s) [upload=268745]: Done uploading segments... Aug 19 11:33:30.552910407 (258h7m52.512007652s) [upload=268745]: Upload finished. err: <nil>
Duration: 1.176498739s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.....X......X......X......X.........................X.....X.] duration:
2.862192985s
FAIL (2025-08-19 11:44:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:43:04.009020798 (258h17m25.968118051s) [upload=268914]: Starting upload Aug 19 11:43:04.009132012 (258h17m25.968229269s) [upload=268914]: Done starting upload Aug 19 11:43:04.010218663 (258h17m25.969315914s) [upload=268914]: Uploading segments... Aug 19 11:43:04.010361161 (258h17m25.969458423s) [upload=268914]: Got next segment. Inline: false Aug 19 11:43:04.010898872 (258h17m25.96999612s) [upload=268914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:43:04.010920171 (258h17m25.970017421s) [upload=268914]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:43:04.107633051 (258h17m26.066730302s) [upload=268914]: Next segment err: metaclient: Too Many Requests Aug 19 11:43:04.107694364 (258h17m26.066791619s) [upload=268914]: Done uploading segments... Aug 19 11:43:04.107719680 (258h17m26.066816928s) [upload=268914]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.86230798s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X.......................X...........] duration:
893.645077ms
FAIL (2025-08-19 11:43:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 490878781e1ea8e8cd6744799db88c339bda649181c8484b7767ab5a9081a558 != before f3eb7f08955a4df7505935be177c550883be751cbad269f169d76a80ae86dfbf ======LOGS====== Aug 19 11:33:30.219497611 (258h7m52.178594866s) [upload=268745]: Starting upload Aug 19 11:33:30.219613119 (258h7m52.178710358s) [upload=268745]: Done starting upload Aug 19 11:33:30.219663567 (258h7m52.178760805s) [upload=268745]: Uploading segments... Aug 19 11:33:30.219812467 (258h7m52.178909719s) [upload=268745]: Got next segment. Inline: true Aug 19 11:33:30.219832065 (258h7m52.178929295s) [upload=268745]: Waiting for error group managing segments... Aug 19 11:33:30.219911126 (258h7m52.179008378s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:33:30.219917917 (258h7m52.179015161s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:33:30.219921673 (258h7m52.179018986s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:33:30.552868796 (258h7m52.511966061s) [upload=268745]: Done uploading segments... Aug 19 11:33:30.552910407 (258h7m52.512007652s) [upload=268745]: Upload finished. err: <nil>
Duration: 893.676478ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [......X......X......X......X.........................X.....X] duration:
427.269718ms
FAIL (2025-08-19 11:43:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:43:04.009020798 (258h17m25.968118051s) [upload=268914]: Starting upload Aug 19 11:43:04.009132012 (258h17m25.968229269s) [upload=268914]: Done starting upload Aug 19 11:43:04.010218663 (258h17m25.969315914s) [upload=268914]: Uploading segments... Aug 19 11:43:04.010361161 (258h17m25.969458423s) [upload=268914]: Got next segment. Inline: false Aug 19 11:43:04.010898872 (258h17m25.96999612s) [upload=268914]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:43:04.010920171 (258h17m25.970017421s) [upload=268914]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:43:04.107633051 (258h17m26.066730302s) [upload=268914]: Next segment err: metaclient: Too Many Requests Aug 19 11:43:04.107694364 (258h17m26.066791619s) [upload=268914]: Done uploading segments... Aug 19 11:43:04.107719680 (258h17m26.066816928s) [upload=268914]: Upload finished. err: metaclient: Too Many Requests
Duration: 427.399967ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.......................X..........] duration:
1.048615278s
FAIL (2025-08-19 11:42:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 490878781e1ea8e8cd6744799db88c339bda649181c8484b7767ab5a9081a558 != before f3eb7f08955a4df7505935be177c550883be751cbad269f169d76a80ae86dfbf ======LOGS====== Aug 19 11:33:30.219497611 (258h7m52.178594866s) [upload=268745]: Starting upload Aug 19 11:33:30.219613119 (258h7m52.178710358s) [upload=268745]: Done starting upload Aug 19 11:33:30.219663567 (258h7m52.178760805s) [upload=268745]: Uploading segments... Aug 19 11:33:30.219812467 (258h7m52.178909719s) [upload=268745]: Got next segment. Inline: true Aug 19 11:33:30.219832065 (258h7m52.178929295s) [upload=268745]: Waiting for error group managing segments... Aug 19 11:33:30.219911126 (258h7m52.179008378s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:33:30.219917917 (258h7m52.179015161s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:33:30.219921673 (258h7m52.179018986s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:33:30.552868796 (258h7m52.511966061s) [upload=268745]: Done uploading segments... Aug 19 11:33:30.552910407 (258h7m52.512007652s) [upload=268745]: Upload finished. err: <nil>
Duration: 1.048657186s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......X......X......X......X.........................X.....] duration:
2.693652379s
FAIL (2025-08-19 11:42:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 11:38:41.772901638 (258h13m3.731998895s) [upload=268838]: Starting upload
Aug 19 11:38:41.773007477 (258h13m3.732104731s) [upload=268838]: Done starting upload
Aug 19 11:38:41.773324635 (258h13m3.732421873s) [upload=268838]: Uploading segments...
Aug 19 11:38:41.774149077 (258h13m3.733246328s) [upload=268838]: Got next segment. Inline: false
Aug 19 11:38:41.774258233 (258h13m3.733355484s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:38:41.774265595 (258h13m3.733362844s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:38:42.013197547 (258h13m3.972294794s) [seg_pos={0 0}, upload=268838]: Begin upload segment...
Aug 19 11:38:42.013279795 (258h13m3.972377041s) [seg_pos={0 0}, upload=268838]: Done begin upload segment.
Aug 19 11:38:42.013324468 (258h13m3.97242172s) [noise=true , address=45.91.116.6:4994 , piece_id=SE3FW7YSNP2S6PTX7756TGDM54CSYNTI6XT3RWHTLPFBN5O7GQ7Q, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.013378365 (258h13m3.972475623s) [noise=true , address=77.90.31.16:4746 , piece_id=LIQHF4LLRA7FV32M7W24LPTXH5QXNKBM262MJBZWTPMMSYZ2X5RQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.013911330 (258h13m3.973008589s) [noise=true , address=77.90.31.17:4789 , piece_id=GYAP3HUV3OTMJVI4OAIQ5DIWJWJ3G25JHTGITPYO4GRW5QAZTYIQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014038288 (258h13m3.973135545s) [noise=true , address=45.91.116.8:4046 , piece_id=RHS4AMYX7SGJTWMTTY7MON3PFAWA7XSZRCHFATYIZEJSOXZXNGBA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014415379 (258h13m3.973512631s) [noise=true , address=45.91.116.14:4203 , piece_id=ILJGHH6YLJULVQE5CJ6IYLXKZF26QUJPUKD3KUEMAHUJVFYCGIDA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014690739 (258h13m3.973787997s) [noise=true , address=45.91.116.13:4161 , piece_id=SQQRZMF44IC2N23X2CS6KPG476UXC7DJFYKN6MNOS2UJPOG2DSLQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014751818 (258h13m3.973849065s) [noise=true , address=77.90.31.10:4524 , piece_id=KPN7D2FI6PXVSJ4BDJ5QE57GKTBRQDW4OEDQXYIQBFONJC5UBOSQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015133472 (258h13m3.974230719s) [noise=true , address=77.90.31.19:4847 , piece_id=ADBZWEUEO7OY2J67FZQNXRW4OPSPSWUIUW6AQT7RBYLP2ICRJHMQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015261076 (258h13m3.974358332s) [noise=true , address=77.90.31.18:4819 , piece_id=5YS2VUVBZ5AGYH4QUPHBKBMJRXFXRIJFV22QL5PNSGAUMMJ5IYBA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015505066 (258h13m3.974602323s) [noise=true , address=104.36.82.60:4359 , piece_id=B7SYXKDFTKZWRHV5RNFLZW6EC2Y7CAPEKDW3GRDA2MMV4BEPF2TA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015825207 (258h13m3.974922464s) [noise=true , address=104.36.82.44:4890 , piece_id=4GKMKWHJRA56FFMONL3TSSOIB7EZHDKNLRTRZZ2XPCEGMSA2337Q, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015928589 (258h13m3.975025838s) [noise=true , address=45.91.116.7:4029 , piece_id=I6KMTHQZTRCZB3YFD4ILKGRPTSOOGFBPQVA6IQSMVGF7NN6AQ5OQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016478408 (258h13m3.975575661s) [noise=true , address=104.36.82.5:4848 , piece_id=SVABQD3C6CN7HOHKNCB6GR5PUBRVVPOERGCMYCRSRESJWXWKZXOA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016523654 (258h13m3.975620901s) [noise=true , address=77.90.31.13:4643 , piece_id=5ALMRQ5GUJM2FAROTUAQX3BAAIM34L6VPTS7MFB72SO3A3SFERQA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016881352 (258h13m3.975978605s) [noise=true , address=104.36.82.6:4908 , piece_id=64QRBUPLSKUWNDE5NSVA7NEOYRGABZQEBHFIY7LVYCFORGSJD6BA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016904287 (258h13m3.976001536s) [noise=true , address=45.91.116.12:4259 , piece_id=DX53HDZGPV3JLUOJAVJGHID4QVA6OZBYPNPC7S52BGS4D73UQ5HA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.017312973 (258h13m3.976410226s) [noise=true , address=79.127.201.215:4349 , piece_id=FX5FWDIDYRSOOPH5YIVLWGBKWPO6DWPEMJJDT3UGOEURJHN3ZU3Q, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.017743670 (258h13m3.976840938s) [noise=true , address=104.36.82.23:4462 , piece_id=IKU755UMGAVBHPGFPFXGE3Q3RZ5GFN3EB5QIGCNI6FYMRNJC4IVA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.573047494 (258h13m4.53214474s) [upload=268838]: Next returned nil segment
Aug 19 11:38:42.573068772 (258h13m4.532166021s) [upload=268838]: Waiting for error group managing segments...
Aug 19 11:38:42.713527532 (258h13m4.672624764s) [noise=true , address=45.91.116.8:4046 , piece_id=RHS4AMYX7SGJTWMTTY7MON3PFAWA7XSZRCHFATYIZEJSOXZXNGBA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.739774851 (258h13m4.698872102s) [noise=true , address=77.90.31.17:4789 , piece_id=GYAP3HUV3OTMJVI4OAIQ5DIWJWJ3G25JHTGITPYO4GRW5QAZTYIQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.744677036 (258h13m4.703774268s) [noise=true , address=45.91.116.14:4203 , piece_id=ILJGHH6YLJULVQE5CJ6IYLXKZF26QUJPUKD3KUEMAHUJVFYCGIDA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.747169666 (258h13m4.706266905s) [noise=true , address=104.36.82.44:4890 , piece_id=4GKMKWHJRA56FFMONL3TSSOIB7EZHDKNLRTRZZ2XPCEGMSA2337Q, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.748659999 (258h13m4.707757248s) [noise=true , address=45.91.116.13:4161 , piece_id=SQQRZMF44IC2N23X2CS6KPG476UXC7DJFYKN6MNOS2UJPOG2DSLQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.753965398 (258h13m4.713062653s) [noise=true , address=45.91.116.12:4259 , piece_id=DX53HDZGPV3JLUOJAVJGHID4QVA6OZBYPNPC7S52BGS4D73UQ5HA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.756042378 (258h13m4.715139616s) [noise=true , address=77.90.31.10:4524 , piece_id=KPN7D2FI6PXVSJ4BDJ5QE57GKTBRQDW4OEDQXYIQBFONJC5UBOSQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.769593684 (258h13m4.728690921s) [noise=true , address=104.36.82.6:4908 , piece_id=64QRBUPLSKUWNDE5NSVA7NEOYRGABZQEBHFIY7LVYCFORGSJD6BA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.771623884 (258h13m4.73072113s) [noise=true , address=45.91.116.6:4994 , piece_id=SE3FW7YSNP2S6PTX7756TGDM54CSYNTI6XT3RWHTLPFBN5O7GQ7Q, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.779371734 (258h13m4.738468972s) [noise=true , address=77.90.31.13:4643 , piece_id=5ALMRQ5GUJM2FAROTUAQX3BAAIM34L6VPTS7MFB72SO3A3SFERQA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.789505813 (258h13m4.748603052s) [noise=true , address=104.36.82.5:4848 , piece_id=SVABQD3C6CN7HOHKNCB6GR5PUBRVVPOERGCMYCRSRESJWXWKZXOA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.804156621 (258h13m4.763253859s) [noise=true , address=77.90.31.18:4819 , piece_id=5YS2VUVBZ5AGYH4QUPHBKBMJRXFXRIJFV22QL5PNSGAUMMJ5IYBA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.805124578 (258h13m4.764221811s) [noise=true , address=104.36.82.60:4359 , piece_id=B7SYXKDFTKZWRHV5RNFLZW6EC2Y7CAPEKDW3GRDA2MMV4BEPF2TA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.808733857 (258h13m4.767831096s) [noise=true , address=77.90.31.16:4746 , piece_id=LIQHF4LLRA7FV32M7W24LPTXH5QXNKBM262MJBZWTPMMSYZ2X5RQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.808761609 (258h13m4.767858853s) [seg_pos={0 0}, upload=268838]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:38:42.809230409 (258h13m4.768327658s) [noise=true , address=45.91.116.7:4029 , piece_id=I6KMTHQZTRCZB3YFD4ILKGRPTSOOGFBPQVA6IQSMVGF7NN6AQ5OQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rWqAGD7Vrj2yzEVyNbfPp278Gga42xPLyAcdzGvUSuz3EgJYh): protocol: write tcp 139.59.144.22:35650->45.91.116.7:4029: use of closed network connection; write tcp 139.59.144.22:35650->45.91.116.7:4029: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35650->45.91.116.7:4029: use of closed network connection
Aug 19 11:38:42.809569384 (258h13m4.768666633s) [noise=true , address=79.127.201.215:4349 , piece_id=FX5FWDIDYRSOOPH5YIVLWGBKWPO6DWPEMJJDT3UGOEURJHN3ZU3Q, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: write tcp 139.59.144.22:40522->79.127.201.215:4349: use of closed network connection; write tcp 139.59.144.22:40522->79.127.201.215:4349: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40522->79.127.201.215:4349: use of closed network connection
Aug 19 11:38:42.809689448 (258h13m4.768786696s) [noise=true , address=104.36.82.23:4462 , piece_id=IKU755UMGAVBHPGFPFXGE3Q3RZ5GFN3EB5QIGCNI6FYMRNJC4IVA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: expected piece hash; context canceled; EOF
Aug 19 11:38:42.809880200 (258h13m4.768977445s) [noise=true , address=77.90.31.19:4847 , piece_id=ADBZWEUEO7OY2J67FZQNXRW4OPSPSWUIUW6AQT7RBYLP2ICRJHMQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 11:38:42.809948727 (258h13m4.769045973s) [seg_pos={0 0}, upload=268838]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:38:42.810065525 (258h13m4.769162774s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:38:42.810070740 (258h13m4.76916799s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:38:43.322368416 (258h13m5.281465668s) [upload=268838]: Done uploading segments...
Aug 19 11:38:43.322396606 (258h13m5.281493859s) [upload=268838]: Upload finished. err: <nil>
Duration: 2.69369563s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X.......................X.........] duration:
1.131751116s
FAIL (2025-08-19 11:42:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 490878781e1ea8e8cd6744799db88c339bda649181c8484b7767ab5a9081a558 != before f3eb7f08955a4df7505935be177c550883be751cbad269f169d76a80ae86dfbf ======LOGS====== Aug 19 11:33:30.219497611 (258h7m52.178594866s) [upload=268745]: Starting upload Aug 19 11:33:30.219613119 (258h7m52.178710358s) [upload=268745]: Done starting upload Aug 19 11:33:30.219663567 (258h7m52.178760805s) [upload=268745]: Uploading segments... Aug 19 11:33:30.219812467 (258h7m52.178909719s) [upload=268745]: Got next segment. Inline: true Aug 19 11:33:30.219832065 (258h7m52.178929295s) [upload=268745]: Waiting for error group managing segments... Aug 19 11:33:30.219911126 (258h7m52.179008378s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:33:30.219917917 (258h7m52.179015161s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:33:30.219921673 (258h7m52.179018986s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:33:30.552868796 (258h7m52.511966061s) [upload=268745]: Done uploading segments... Aug 19 11:33:30.552910407 (258h7m52.512007652s) [upload=268745]: Upload finished. err: <nil>
Duration: 1.131782342s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [........X......X......X......X.........................X....] duration:
2.860034719s
FAIL (2025-08-19 11:41:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 11:38:41.772901638 (258h13m3.731998895s) [upload=268838]: Starting upload
Aug 19 11:38:41.773007477 (258h13m3.732104731s) [upload=268838]: Done starting upload
Aug 19 11:38:41.773324635 (258h13m3.732421873s) [upload=268838]: Uploading segments...
Aug 19 11:38:41.774149077 (258h13m3.733246328s) [upload=268838]: Got next segment. Inline: false
Aug 19 11:38:41.774258233 (258h13m3.733355484s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:38:41.774265595 (258h13m3.733362844s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:38:42.013197547 (258h13m3.972294794s) [seg_pos={0 0}, upload=268838]: Begin upload segment...
Aug 19 11:38:42.013279795 (258h13m3.972377041s) [seg_pos={0 0}, upload=268838]: Done begin upload segment.
Aug 19 11:38:42.013324468 (258h13m3.97242172s) [noise=true , address=45.91.116.6:4994 , piece_id=SE3FW7YSNP2S6PTX7756TGDM54CSYNTI6XT3RWHTLPFBN5O7GQ7Q, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.013378365 (258h13m3.972475623s) [noise=true , address=77.90.31.16:4746 , piece_id=LIQHF4LLRA7FV32M7W24LPTXH5QXNKBM262MJBZWTPMMSYZ2X5RQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.013911330 (258h13m3.973008589s) [noise=true , address=77.90.31.17:4789 , piece_id=GYAP3HUV3OTMJVI4OAIQ5DIWJWJ3G25JHTGITPYO4GRW5QAZTYIQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014038288 (258h13m3.973135545s) [noise=true , address=45.91.116.8:4046 , piece_id=RHS4AMYX7SGJTWMTTY7MON3PFAWA7XSZRCHFATYIZEJSOXZXNGBA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014415379 (258h13m3.973512631s) [noise=true , address=45.91.116.14:4203 , piece_id=ILJGHH6YLJULVQE5CJ6IYLXKZF26QUJPUKD3KUEMAHUJVFYCGIDA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014690739 (258h13m3.973787997s) [noise=true , address=45.91.116.13:4161 , piece_id=SQQRZMF44IC2N23X2CS6KPG476UXC7DJFYKN6MNOS2UJPOG2DSLQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014751818 (258h13m3.973849065s) [noise=true , address=77.90.31.10:4524 , piece_id=KPN7D2FI6PXVSJ4BDJ5QE57GKTBRQDW4OEDQXYIQBFONJC5UBOSQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015133472 (258h13m3.974230719s) [noise=true , address=77.90.31.19:4847 , piece_id=ADBZWEUEO7OY2J67FZQNXRW4OPSPSWUIUW6AQT7RBYLP2ICRJHMQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015261076 (258h13m3.974358332s) [noise=true , address=77.90.31.18:4819 , piece_id=5YS2VUVBZ5AGYH4QUPHBKBMJRXFXRIJFV22QL5PNSGAUMMJ5IYBA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015505066 (258h13m3.974602323s) [noise=true , address=104.36.82.60:4359 , piece_id=B7SYXKDFTKZWRHV5RNFLZW6EC2Y7CAPEKDW3GRDA2MMV4BEPF2TA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015825207 (258h13m3.974922464s) [noise=true , address=104.36.82.44:4890 , piece_id=4GKMKWHJRA56FFMONL3TSSOIB7EZHDKNLRTRZZ2XPCEGMSA2337Q, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015928589 (258h13m3.975025838s) [noise=true , address=45.91.116.7:4029 , piece_id=I6KMTHQZTRCZB3YFD4ILKGRPTSOOGFBPQVA6IQSMVGF7NN6AQ5OQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016478408 (258h13m3.975575661s) [noise=true , address=104.36.82.5:4848 , piece_id=SVABQD3C6CN7HOHKNCB6GR5PUBRVVPOERGCMYCRSRESJWXWKZXOA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016523654 (258h13m3.975620901s) [noise=true , address=77.90.31.13:4643 , piece_id=5ALMRQ5GUJM2FAROTUAQX3BAAIM34L6VPTS7MFB72SO3A3SFERQA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016881352 (258h13m3.975978605s) [noise=true , address=104.36.82.6:4908 , piece_id=64QRBUPLSKUWNDE5NSVA7NEOYRGABZQEBHFIY7LVYCFORGSJD6BA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016904287 (258h13m3.976001536s) [noise=true , address=45.91.116.12:4259 , piece_id=DX53HDZGPV3JLUOJAVJGHID4QVA6OZBYPNPC7S52BGS4D73UQ5HA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.017312973 (258h13m3.976410226s) [noise=true , address=79.127.201.215:4349 , piece_id=FX5FWDIDYRSOOPH5YIVLWGBKWPO6DWPEMJJDT3UGOEURJHN3ZU3Q, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.017743670 (258h13m3.976840938s) [noise=true , address=104.36.82.23:4462 , piece_id=IKU755UMGAVBHPGFPFXGE3Q3RZ5GFN3EB5QIGCNI6FYMRNJC4IVA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.573047494 (258h13m4.53214474s) [upload=268838]: Next returned nil segment
Aug 19 11:38:42.573068772 (258h13m4.532166021s) [upload=268838]: Waiting for error group managing segments...
Aug 19 11:38:42.713527532 (258h13m4.672624764s) [noise=true , address=45.91.116.8:4046 , piece_id=RHS4AMYX7SGJTWMTTY7MON3PFAWA7XSZRCHFATYIZEJSOXZXNGBA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.739774851 (258h13m4.698872102s) [noise=true , address=77.90.31.17:4789 , piece_id=GYAP3HUV3OTMJVI4OAIQ5DIWJWJ3G25JHTGITPYO4GRW5QAZTYIQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.744677036 (258h13m4.703774268s) [noise=true , address=45.91.116.14:4203 , piece_id=ILJGHH6YLJULVQE5CJ6IYLXKZF26QUJPUKD3KUEMAHUJVFYCGIDA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.747169666 (258h13m4.706266905s) [noise=true , address=104.36.82.44:4890 , piece_id=4GKMKWHJRA56FFMONL3TSSOIB7EZHDKNLRTRZZ2XPCEGMSA2337Q, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.748659999 (258h13m4.707757248s) [noise=true , address=45.91.116.13:4161 , piece_id=SQQRZMF44IC2N23X2CS6KPG476UXC7DJFYKN6MNOS2UJPOG2DSLQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.753965398 (258h13m4.713062653s) [noise=true , address=45.91.116.12:4259 , piece_id=DX53HDZGPV3JLUOJAVJGHID4QVA6OZBYPNPC7S52BGS4D73UQ5HA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.756042378 (258h13m4.715139616s) [noise=true , address=77.90.31.10:4524 , piece_id=KPN7D2FI6PXVSJ4BDJ5QE57GKTBRQDW4OEDQXYIQBFONJC5UBOSQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.769593684 (258h13m4.728690921s) [noise=true , address=104.36.82.6:4908 , piece_id=64QRBUPLSKUWNDE5NSVA7NEOYRGABZQEBHFIY7LVYCFORGSJD6BA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.771623884 (258h13m4.73072113s) [noise=true , address=45.91.116.6:4994 , piece_id=SE3FW7YSNP2S6PTX7756TGDM54CSYNTI6XT3RWHTLPFBN5O7GQ7Q, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.779371734 (258h13m4.738468972s) [noise=true , address=77.90.31.13:4643 , piece_id=5ALMRQ5GUJM2FAROTUAQX3BAAIM34L6VPTS7MFB72SO3A3SFERQA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.789505813 (258h13m4.748603052s) [noise=true , address=104.36.82.5:4848 , piece_id=SVABQD3C6CN7HOHKNCB6GR5PUBRVVPOERGCMYCRSRESJWXWKZXOA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.804156621 (258h13m4.763253859s) [noise=true , address=77.90.31.18:4819 , piece_id=5YS2VUVBZ5AGYH4QUPHBKBMJRXFXRIJFV22QL5PNSGAUMMJ5IYBA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.805124578 (258h13m4.764221811s) [noise=true , address=104.36.82.60:4359 , piece_id=B7SYXKDFTKZWRHV5RNFLZW6EC2Y7CAPEKDW3GRDA2MMV4BEPF2TA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.808733857 (258h13m4.767831096s) [noise=true , address=77.90.31.16:4746 , piece_id=LIQHF4LLRA7FV32M7W24LPTXH5QXNKBM262MJBZWTPMMSYZ2X5RQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.808761609 (258h13m4.767858853s) [seg_pos={0 0}, upload=268838]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:38:42.809230409 (258h13m4.768327658s) [noise=true , address=45.91.116.7:4029 , piece_id=I6KMTHQZTRCZB3YFD4ILKGRPTSOOGFBPQVA6IQSMVGF7NN6AQ5OQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rWqAGD7Vrj2yzEVyNbfPp278Gga42xPLyAcdzGvUSuz3EgJYh): protocol: write tcp 139.59.144.22:35650->45.91.116.7:4029: use of closed network connection; write tcp 139.59.144.22:35650->45.91.116.7:4029: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35650->45.91.116.7:4029: use of closed network connection
Aug 19 11:38:42.809569384 (258h13m4.768666633s) [noise=true , address=79.127.201.215:4349 , piece_id=FX5FWDIDYRSOOPH5YIVLWGBKWPO6DWPEMJJDT3UGOEURJHN3ZU3Q, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: write tcp 139.59.144.22:40522->79.127.201.215:4349: use of closed network connection; write tcp 139.59.144.22:40522->79.127.201.215:4349: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40522->79.127.201.215:4349: use of closed network connection
Aug 19 11:38:42.809689448 (258h13m4.768786696s) [noise=true , address=104.36.82.23:4462 , piece_id=IKU755UMGAVBHPGFPFXGE3Q3RZ5GFN3EB5QIGCNI6FYMRNJC4IVA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: expected piece hash; context canceled; EOF
Aug 19 11:38:42.809880200 (258h13m4.768977445s) [noise=true , address=77.90.31.19:4847 , piece_id=ADBZWEUEO7OY2J67FZQNXRW4OPSPSWUIUW6AQT7RBYLP2ICRJHMQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 11:38:42.809948727 (258h13m4.769045973s) [seg_pos={0 0}, upload=268838]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:38:42.810065525 (258h13m4.769162774s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:38:42.810070740 (258h13m4.76916799s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:38:43.322368416 (258h13m5.281465668s) [upload=268838]: Done uploading segments...
Aug 19 11:38:43.322396606 (258h13m5.281493859s) [upload=268838]: Upload finished. err: <nil>
Duration: 2.860061911s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X.......................X........] duration:
966.532292ms
FAIL (2025-08-19 11:41:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 490878781e1ea8e8cd6744799db88c339bda649181c8484b7767ab5a9081a558 != before f3eb7f08955a4df7505935be177c550883be751cbad269f169d76a80ae86dfbf ======LOGS====== Aug 19 11:33:30.219497611 (258h7m52.178594866s) [upload=268745]: Starting upload Aug 19 11:33:30.219613119 (258h7m52.178710358s) [upload=268745]: Done starting upload Aug 19 11:33:30.219663567 (258h7m52.178760805s) [upload=268745]: Uploading segments... Aug 19 11:33:30.219812467 (258h7m52.178909719s) [upload=268745]: Got next segment. Inline: true Aug 19 11:33:30.219832065 (258h7m52.178929295s) [upload=268745]: Waiting for error group managing segments... Aug 19 11:33:30.219911126 (258h7m52.179008378s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:33:30.219917917 (258h7m52.179015161s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:33:30.219921673 (258h7m52.179018986s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:33:30.552868796 (258h7m52.511966061s) [upload=268745]: Done uploading segments... Aug 19 11:33:30.552910407 (258h7m52.512007652s) [upload=268745]: Upload finished. err: <nil>
Duration: 966.581652ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.........X......X......X......X.........................X...] duration:
2.591243511s
FAIL (2025-08-19 11:40:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 11:38:41.772901638 (258h13m3.731998895s) [upload=268838]: Starting upload
Aug 19 11:38:41.773007477 (258h13m3.732104731s) [upload=268838]: Done starting upload
Aug 19 11:38:41.773324635 (258h13m3.732421873s) [upload=268838]: Uploading segments...
Aug 19 11:38:41.774149077 (258h13m3.733246328s) [upload=268838]: Got next segment. Inline: false
Aug 19 11:38:41.774258233 (258h13m3.733355484s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:38:41.774265595 (258h13m3.733362844s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:38:42.013197547 (258h13m3.972294794s) [seg_pos={0 0}, upload=268838]: Begin upload segment...
Aug 19 11:38:42.013279795 (258h13m3.972377041s) [seg_pos={0 0}, upload=268838]: Done begin upload segment.
Aug 19 11:38:42.013324468 (258h13m3.97242172s) [noise=true , address=45.91.116.6:4994 , piece_id=SE3FW7YSNP2S6PTX7756TGDM54CSYNTI6XT3RWHTLPFBN5O7GQ7Q, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.013378365 (258h13m3.972475623s) [noise=true , address=77.90.31.16:4746 , piece_id=LIQHF4LLRA7FV32M7W24LPTXH5QXNKBM262MJBZWTPMMSYZ2X5RQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.013911330 (258h13m3.973008589s) [noise=true , address=77.90.31.17:4789 , piece_id=GYAP3HUV3OTMJVI4OAIQ5DIWJWJ3G25JHTGITPYO4GRW5QAZTYIQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014038288 (258h13m3.973135545s) [noise=true , address=45.91.116.8:4046 , piece_id=RHS4AMYX7SGJTWMTTY7MON3PFAWA7XSZRCHFATYIZEJSOXZXNGBA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014415379 (258h13m3.973512631s) [noise=true , address=45.91.116.14:4203 , piece_id=ILJGHH6YLJULVQE5CJ6IYLXKZF26QUJPUKD3KUEMAHUJVFYCGIDA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014690739 (258h13m3.973787997s) [noise=true , address=45.91.116.13:4161 , piece_id=SQQRZMF44IC2N23X2CS6KPG476UXC7DJFYKN6MNOS2UJPOG2DSLQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014751818 (258h13m3.973849065s) [noise=true , address=77.90.31.10:4524 , piece_id=KPN7D2FI6PXVSJ4BDJ5QE57GKTBRQDW4OEDQXYIQBFONJC5UBOSQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015133472 (258h13m3.974230719s) [noise=true , address=77.90.31.19:4847 , piece_id=ADBZWEUEO7OY2J67FZQNXRW4OPSPSWUIUW6AQT7RBYLP2ICRJHMQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015261076 (258h13m3.974358332s) [noise=true , address=77.90.31.18:4819 , piece_id=5YS2VUVBZ5AGYH4QUPHBKBMJRXFXRIJFV22QL5PNSGAUMMJ5IYBA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015505066 (258h13m3.974602323s) [noise=true , address=104.36.82.60:4359 , piece_id=B7SYXKDFTKZWRHV5RNFLZW6EC2Y7CAPEKDW3GRDA2MMV4BEPF2TA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015825207 (258h13m3.974922464s) [noise=true , address=104.36.82.44:4890 , piece_id=4GKMKWHJRA56FFMONL3TSSOIB7EZHDKNLRTRZZ2XPCEGMSA2337Q, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015928589 (258h13m3.975025838s) [noise=true , address=45.91.116.7:4029 , piece_id=I6KMTHQZTRCZB3YFD4ILKGRPTSOOGFBPQVA6IQSMVGF7NN6AQ5OQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016478408 (258h13m3.975575661s) [noise=true , address=104.36.82.5:4848 , piece_id=SVABQD3C6CN7HOHKNCB6GR5PUBRVVPOERGCMYCRSRESJWXWKZXOA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016523654 (258h13m3.975620901s) [noise=true , address=77.90.31.13:4643 , piece_id=5ALMRQ5GUJM2FAROTUAQX3BAAIM34L6VPTS7MFB72SO3A3SFERQA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016881352 (258h13m3.975978605s) [noise=true , address=104.36.82.6:4908 , piece_id=64QRBUPLSKUWNDE5NSVA7NEOYRGABZQEBHFIY7LVYCFORGSJD6BA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016904287 (258h13m3.976001536s) [noise=true , address=45.91.116.12:4259 , piece_id=DX53HDZGPV3JLUOJAVJGHID4QVA6OZBYPNPC7S52BGS4D73UQ5HA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.017312973 (258h13m3.976410226s) [noise=true , address=79.127.201.215:4349 , piece_id=FX5FWDIDYRSOOPH5YIVLWGBKWPO6DWPEMJJDT3UGOEURJHN3ZU3Q, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.017743670 (258h13m3.976840938s) [noise=true , address=104.36.82.23:4462 , piece_id=IKU755UMGAVBHPGFPFXGE3Q3RZ5GFN3EB5QIGCNI6FYMRNJC4IVA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.573047494 (258h13m4.53214474s) [upload=268838]: Next returned nil segment
Aug 19 11:38:42.573068772 (258h13m4.532166021s) [upload=268838]: Waiting for error group managing segments...
Aug 19 11:38:42.713527532 (258h13m4.672624764s) [noise=true , address=45.91.116.8:4046 , piece_id=RHS4AMYX7SGJTWMTTY7MON3PFAWA7XSZRCHFATYIZEJSOXZXNGBA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.739774851 (258h13m4.698872102s) [noise=true , address=77.90.31.17:4789 , piece_id=GYAP3HUV3OTMJVI4OAIQ5DIWJWJ3G25JHTGITPYO4GRW5QAZTYIQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.744677036 (258h13m4.703774268s) [noise=true , address=45.91.116.14:4203 , piece_id=ILJGHH6YLJULVQE5CJ6IYLXKZF26QUJPUKD3KUEMAHUJVFYCGIDA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.747169666 (258h13m4.706266905s) [noise=true , address=104.36.82.44:4890 , piece_id=4GKMKWHJRA56FFMONL3TSSOIB7EZHDKNLRTRZZ2XPCEGMSA2337Q, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.748659999 (258h13m4.707757248s) [noise=true , address=45.91.116.13:4161 , piece_id=SQQRZMF44IC2N23X2CS6KPG476UXC7DJFYKN6MNOS2UJPOG2DSLQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.753965398 (258h13m4.713062653s) [noise=true , address=45.91.116.12:4259 , piece_id=DX53HDZGPV3JLUOJAVJGHID4QVA6OZBYPNPC7S52BGS4D73UQ5HA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.756042378 (258h13m4.715139616s) [noise=true , address=77.90.31.10:4524 , piece_id=KPN7D2FI6PXVSJ4BDJ5QE57GKTBRQDW4OEDQXYIQBFONJC5UBOSQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.769593684 (258h13m4.728690921s) [noise=true , address=104.36.82.6:4908 , piece_id=64QRBUPLSKUWNDE5NSVA7NEOYRGABZQEBHFIY7LVYCFORGSJD6BA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.771623884 (258h13m4.73072113s) [noise=true , address=45.91.116.6:4994 , piece_id=SE3FW7YSNP2S6PTX7756TGDM54CSYNTI6XT3RWHTLPFBN5O7GQ7Q, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.779371734 (258h13m4.738468972s) [noise=true , address=77.90.31.13:4643 , piece_id=5ALMRQ5GUJM2FAROTUAQX3BAAIM34L6VPTS7MFB72SO3A3SFERQA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.789505813 (258h13m4.748603052s) [noise=true , address=104.36.82.5:4848 , piece_id=SVABQD3C6CN7HOHKNCB6GR5PUBRVVPOERGCMYCRSRESJWXWKZXOA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.804156621 (258h13m4.763253859s) [noise=true , address=77.90.31.18:4819 , piece_id=5YS2VUVBZ5AGYH4QUPHBKBMJRXFXRIJFV22QL5PNSGAUMMJ5IYBA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.805124578 (258h13m4.764221811s) [noise=true , address=104.36.82.60:4359 , piece_id=B7SYXKDFTKZWRHV5RNFLZW6EC2Y7CAPEKDW3GRDA2MMV4BEPF2TA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.808733857 (258h13m4.767831096s) [noise=true , address=77.90.31.16:4746 , piece_id=LIQHF4LLRA7FV32M7W24LPTXH5QXNKBM262MJBZWTPMMSYZ2X5RQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.808761609 (258h13m4.767858853s) [seg_pos={0 0}, upload=268838]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:38:42.809230409 (258h13m4.768327658s) [noise=true , address=45.91.116.7:4029 , piece_id=I6KMTHQZTRCZB3YFD4ILKGRPTSOOGFBPQVA6IQSMVGF7NN6AQ5OQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rWqAGD7Vrj2yzEVyNbfPp278Gga42xPLyAcdzGvUSuz3EgJYh): protocol: write tcp 139.59.144.22:35650->45.91.116.7:4029: use of closed network connection; write tcp 139.59.144.22:35650->45.91.116.7:4029: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35650->45.91.116.7:4029: use of closed network connection
Aug 19 11:38:42.809569384 (258h13m4.768666633s) [noise=true , address=79.127.201.215:4349 , piece_id=FX5FWDIDYRSOOPH5YIVLWGBKWPO6DWPEMJJDT3UGOEURJHN3ZU3Q, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: write tcp 139.59.144.22:40522->79.127.201.215:4349: use of closed network connection; write tcp 139.59.144.22:40522->79.127.201.215:4349: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40522->79.127.201.215:4349: use of closed network connection
Aug 19 11:38:42.809689448 (258h13m4.768786696s) [noise=true , address=104.36.82.23:4462 , piece_id=IKU755UMGAVBHPGFPFXGE3Q3RZ5GFN3EB5QIGCNI6FYMRNJC4IVA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: expected piece hash; context canceled; EOF
Aug 19 11:38:42.809880200 (258h13m4.768977445s) [noise=true , address=77.90.31.19:4847 , piece_id=ADBZWEUEO7OY2J67FZQNXRW4OPSPSWUIUW6AQT7RBYLP2ICRJHMQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 11:38:42.809948727 (258h13m4.769045973s) [seg_pos={0 0}, upload=268838]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:38:42.810065525 (258h13m4.769162774s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:38:42.810070740 (258h13m4.76916799s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:38:43.322368416 (258h13m5.281465668s) [upload=268838]: Done uploading segments...
Aug 19 11:38:43.322396606 (258h13m5.281493859s) [upload=268838]: Upload finished. err: <nil>
Duration: 2.591277506s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X.......................X.......] duration:
991.220825ms
FAIL (2025-08-19 11:40:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 490878781e1ea8e8cd6744799db88c339bda649181c8484b7767ab5a9081a558 != before f3eb7f08955a4df7505935be177c550883be751cbad269f169d76a80ae86dfbf ======LOGS====== Aug 19 11:33:30.219497611 (258h7m52.178594866s) [upload=268745]: Starting upload Aug 19 11:33:30.219613119 (258h7m52.178710358s) [upload=268745]: Done starting upload Aug 19 11:33:30.219663567 (258h7m52.178760805s) [upload=268745]: Uploading segments... Aug 19 11:33:30.219812467 (258h7m52.178909719s) [upload=268745]: Got next segment. Inline: true Aug 19 11:33:30.219832065 (258h7m52.178929295s) [upload=268745]: Waiting for error group managing segments... Aug 19 11:33:30.219911126 (258h7m52.179008378s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:33:30.219917917 (258h7m52.179015161s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:33:30.219921673 (258h7m52.179018986s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:33:30.552868796 (258h7m52.511966061s) [upload=268745]: Done uploading segments... Aug 19 11:33:30.552910407 (258h7m52.512007652s) [upload=268745]: Upload finished. err: <nil>
Duration: 991.276598ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..........X......X......X......X.........................X..] duration:
2.971320104s
FAIL (2025-08-19 11:39:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 11:38:41.772901638 (258h13m3.731998895s) [upload=268838]: Starting upload
Aug 19 11:38:41.773007477 (258h13m3.732104731s) [upload=268838]: Done starting upload
Aug 19 11:38:41.773324635 (258h13m3.732421873s) [upload=268838]: Uploading segments...
Aug 19 11:38:41.774149077 (258h13m3.733246328s) [upload=268838]: Got next segment. Inline: false
Aug 19 11:38:41.774258233 (258h13m3.733355484s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:38:41.774265595 (258h13m3.733362844s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:38:42.013197547 (258h13m3.972294794s) [seg_pos={0 0}, upload=268838]: Begin upload segment...
Aug 19 11:38:42.013279795 (258h13m3.972377041s) [seg_pos={0 0}, upload=268838]: Done begin upload segment.
Aug 19 11:38:42.013324468 (258h13m3.97242172s) [noise=true , address=45.91.116.6:4994 , piece_id=SE3FW7YSNP2S6PTX7756TGDM54CSYNTI6XT3RWHTLPFBN5O7GQ7Q, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.013378365 (258h13m3.972475623s) [noise=true , address=77.90.31.16:4746 , piece_id=LIQHF4LLRA7FV32M7W24LPTXH5QXNKBM262MJBZWTPMMSYZ2X5RQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.013911330 (258h13m3.973008589s) [noise=true , address=77.90.31.17:4789 , piece_id=GYAP3HUV3OTMJVI4OAIQ5DIWJWJ3G25JHTGITPYO4GRW5QAZTYIQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014038288 (258h13m3.973135545s) [noise=true , address=45.91.116.8:4046 , piece_id=RHS4AMYX7SGJTWMTTY7MON3PFAWA7XSZRCHFATYIZEJSOXZXNGBA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014415379 (258h13m3.973512631s) [noise=true , address=45.91.116.14:4203 , piece_id=ILJGHH6YLJULVQE5CJ6IYLXKZF26QUJPUKD3KUEMAHUJVFYCGIDA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014690739 (258h13m3.973787997s) [noise=true , address=45.91.116.13:4161 , piece_id=SQQRZMF44IC2N23X2CS6KPG476UXC7DJFYKN6MNOS2UJPOG2DSLQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014751818 (258h13m3.973849065s) [noise=true , address=77.90.31.10:4524 , piece_id=KPN7D2FI6PXVSJ4BDJ5QE57GKTBRQDW4OEDQXYIQBFONJC5UBOSQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015133472 (258h13m3.974230719s) [noise=true , address=77.90.31.19:4847 , piece_id=ADBZWEUEO7OY2J67FZQNXRW4OPSPSWUIUW6AQT7RBYLP2ICRJHMQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015261076 (258h13m3.974358332s) [noise=true , address=77.90.31.18:4819 , piece_id=5YS2VUVBZ5AGYH4QUPHBKBMJRXFXRIJFV22QL5PNSGAUMMJ5IYBA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015505066 (258h13m3.974602323s) [noise=true , address=104.36.82.60:4359 , piece_id=B7SYXKDFTKZWRHV5RNFLZW6EC2Y7CAPEKDW3GRDA2MMV4BEPF2TA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015825207 (258h13m3.974922464s) [noise=true , address=104.36.82.44:4890 , piece_id=4GKMKWHJRA56FFMONL3TSSOIB7EZHDKNLRTRZZ2XPCEGMSA2337Q, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015928589 (258h13m3.975025838s) [noise=true , address=45.91.116.7:4029 , piece_id=I6KMTHQZTRCZB3YFD4ILKGRPTSOOGFBPQVA6IQSMVGF7NN6AQ5OQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016478408 (258h13m3.975575661s) [noise=true , address=104.36.82.5:4848 , piece_id=SVABQD3C6CN7HOHKNCB6GR5PUBRVVPOERGCMYCRSRESJWXWKZXOA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016523654 (258h13m3.975620901s) [noise=true , address=77.90.31.13:4643 , piece_id=5ALMRQ5GUJM2FAROTUAQX3BAAIM34L6VPTS7MFB72SO3A3SFERQA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016881352 (258h13m3.975978605s) [noise=true , address=104.36.82.6:4908 , piece_id=64QRBUPLSKUWNDE5NSVA7NEOYRGABZQEBHFIY7LVYCFORGSJD6BA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016904287 (258h13m3.976001536s) [noise=true , address=45.91.116.12:4259 , piece_id=DX53HDZGPV3JLUOJAVJGHID4QVA6OZBYPNPC7S52BGS4D73UQ5HA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.017312973 (258h13m3.976410226s) [noise=true , address=79.127.201.215:4349 , piece_id=FX5FWDIDYRSOOPH5YIVLWGBKWPO6DWPEMJJDT3UGOEURJHN3ZU3Q, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.017743670 (258h13m3.976840938s) [noise=true , address=104.36.82.23:4462 , piece_id=IKU755UMGAVBHPGFPFXGE3Q3RZ5GFN3EB5QIGCNI6FYMRNJC4IVA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.573047494 (258h13m4.53214474s) [upload=268838]: Next returned nil segment
Aug 19 11:38:42.573068772 (258h13m4.532166021s) [upload=268838]: Waiting for error group managing segments...
Aug 19 11:38:42.713527532 (258h13m4.672624764s) [noise=true , address=45.91.116.8:4046 , piece_id=RHS4AMYX7SGJTWMTTY7MON3PFAWA7XSZRCHFATYIZEJSOXZXNGBA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.739774851 (258h13m4.698872102s) [noise=true , address=77.90.31.17:4789 , piece_id=GYAP3HUV3OTMJVI4OAIQ5DIWJWJ3G25JHTGITPYO4GRW5QAZTYIQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.744677036 (258h13m4.703774268s) [noise=true , address=45.91.116.14:4203 , piece_id=ILJGHH6YLJULVQE5CJ6IYLXKZF26QUJPUKD3KUEMAHUJVFYCGIDA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.747169666 (258h13m4.706266905s) [noise=true , address=104.36.82.44:4890 , piece_id=4GKMKWHJRA56FFMONL3TSSOIB7EZHDKNLRTRZZ2XPCEGMSA2337Q, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.748659999 (258h13m4.707757248s) [noise=true , address=45.91.116.13:4161 , piece_id=SQQRZMF44IC2N23X2CS6KPG476UXC7DJFYKN6MNOS2UJPOG2DSLQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.753965398 (258h13m4.713062653s) [noise=true , address=45.91.116.12:4259 , piece_id=DX53HDZGPV3JLUOJAVJGHID4QVA6OZBYPNPC7S52BGS4D73UQ5HA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.756042378 (258h13m4.715139616s) [noise=true , address=77.90.31.10:4524 , piece_id=KPN7D2FI6PXVSJ4BDJ5QE57GKTBRQDW4OEDQXYIQBFONJC5UBOSQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.769593684 (258h13m4.728690921s) [noise=true , address=104.36.82.6:4908 , piece_id=64QRBUPLSKUWNDE5NSVA7NEOYRGABZQEBHFIY7LVYCFORGSJD6BA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.771623884 (258h13m4.73072113s) [noise=true , address=45.91.116.6:4994 , piece_id=SE3FW7YSNP2S6PTX7756TGDM54CSYNTI6XT3RWHTLPFBN5O7GQ7Q, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.779371734 (258h13m4.738468972s) [noise=true , address=77.90.31.13:4643 , piece_id=5ALMRQ5GUJM2FAROTUAQX3BAAIM34L6VPTS7MFB72SO3A3SFERQA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.789505813 (258h13m4.748603052s) [noise=true , address=104.36.82.5:4848 , piece_id=SVABQD3C6CN7HOHKNCB6GR5PUBRVVPOERGCMYCRSRESJWXWKZXOA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.804156621 (258h13m4.763253859s) [noise=true , address=77.90.31.18:4819 , piece_id=5YS2VUVBZ5AGYH4QUPHBKBMJRXFXRIJFV22QL5PNSGAUMMJ5IYBA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.805124578 (258h13m4.764221811s) [noise=true , address=104.36.82.60:4359 , piece_id=B7SYXKDFTKZWRHV5RNFLZW6EC2Y7CAPEKDW3GRDA2MMV4BEPF2TA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.808733857 (258h13m4.767831096s) [noise=true , address=77.90.31.16:4746 , piece_id=LIQHF4LLRA7FV32M7W24LPTXH5QXNKBM262MJBZWTPMMSYZ2X5RQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.808761609 (258h13m4.767858853s) [seg_pos={0 0}, upload=268838]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:38:42.809230409 (258h13m4.768327658s) [noise=true , address=45.91.116.7:4029 , piece_id=I6KMTHQZTRCZB3YFD4ILKGRPTSOOGFBPQVA6IQSMVGF7NN6AQ5OQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rWqAGD7Vrj2yzEVyNbfPp278Gga42xPLyAcdzGvUSuz3EgJYh): protocol: write tcp 139.59.144.22:35650->45.91.116.7:4029: use of closed network connection; write tcp 139.59.144.22:35650->45.91.116.7:4029: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35650->45.91.116.7:4029: use of closed network connection
Aug 19 11:38:42.809569384 (258h13m4.768666633s) [noise=true , address=79.127.201.215:4349 , piece_id=FX5FWDIDYRSOOPH5YIVLWGBKWPO6DWPEMJJDT3UGOEURJHN3ZU3Q, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: write tcp 139.59.144.22:40522->79.127.201.215:4349: use of closed network connection; write tcp 139.59.144.22:40522->79.127.201.215:4349: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40522->79.127.201.215:4349: use of closed network connection
Aug 19 11:38:42.809689448 (258h13m4.768786696s) [noise=true , address=104.36.82.23:4462 , piece_id=IKU755UMGAVBHPGFPFXGE3Q3RZ5GFN3EB5QIGCNI6FYMRNJC4IVA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: expected piece hash; context canceled; EOF
Aug 19 11:38:42.809880200 (258h13m4.768977445s) [noise=true , address=77.90.31.19:4847 , piece_id=ADBZWEUEO7OY2J67FZQNXRW4OPSPSWUIUW6AQT7RBYLP2ICRJHMQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 11:38:42.809948727 (258h13m4.769045973s) [seg_pos={0 0}, upload=268838]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:38:42.810065525 (258h13m4.769162774s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:38:42.810070740 (258h13m4.76916799s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:38:43.322368416 (258h13m5.281465668s) [upload=268838]: Done uploading segments...
Aug 19 11:38:43.322396606 (258h13m5.281493859s) [upload=268838]: Upload finished. err: <nil>
Duration: 2.971352517s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...........X......X......X......X.........................X.] duration:
2.42965816s
FAIL (2025-08-19 11:39:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 11:38:41.772901638 (258h13m3.731998895s) [upload=268838]: Starting upload
Aug 19 11:38:41.773007477 (258h13m3.732104731s) [upload=268838]: Done starting upload
Aug 19 11:38:41.773324635 (258h13m3.732421873s) [upload=268838]: Uploading segments...
Aug 19 11:38:41.774149077 (258h13m3.733246328s) [upload=268838]: Got next segment. Inline: false
Aug 19 11:38:41.774258233 (258h13m3.733355484s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:38:41.774265595 (258h13m3.733362844s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:38:42.013197547 (258h13m3.972294794s) [seg_pos={0 0}, upload=268838]: Begin upload segment...
Aug 19 11:38:42.013279795 (258h13m3.972377041s) [seg_pos={0 0}, upload=268838]: Done begin upload segment.
Aug 19 11:38:42.013324468 (258h13m3.97242172s) [noise=true , address=45.91.116.6:4994 , piece_id=SE3FW7YSNP2S6PTX7756TGDM54CSYNTI6XT3RWHTLPFBN5O7GQ7Q, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.013378365 (258h13m3.972475623s) [noise=true , address=77.90.31.16:4746 , piece_id=LIQHF4LLRA7FV32M7W24LPTXH5QXNKBM262MJBZWTPMMSYZ2X5RQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.013911330 (258h13m3.973008589s) [noise=true , address=77.90.31.17:4789 , piece_id=GYAP3HUV3OTMJVI4OAIQ5DIWJWJ3G25JHTGITPYO4GRW5QAZTYIQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014038288 (258h13m3.973135545s) [noise=true , address=45.91.116.8:4046 , piece_id=RHS4AMYX7SGJTWMTTY7MON3PFAWA7XSZRCHFATYIZEJSOXZXNGBA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014415379 (258h13m3.973512631s) [noise=true , address=45.91.116.14:4203 , piece_id=ILJGHH6YLJULVQE5CJ6IYLXKZF26QUJPUKD3KUEMAHUJVFYCGIDA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014690739 (258h13m3.973787997s) [noise=true , address=45.91.116.13:4161 , piece_id=SQQRZMF44IC2N23X2CS6KPG476UXC7DJFYKN6MNOS2UJPOG2DSLQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014751818 (258h13m3.973849065s) [noise=true , address=77.90.31.10:4524 , piece_id=KPN7D2FI6PXVSJ4BDJ5QE57GKTBRQDW4OEDQXYIQBFONJC5UBOSQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015133472 (258h13m3.974230719s) [noise=true , address=77.90.31.19:4847 , piece_id=ADBZWEUEO7OY2J67FZQNXRW4OPSPSWUIUW6AQT7RBYLP2ICRJHMQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015261076 (258h13m3.974358332s) [noise=true , address=77.90.31.18:4819 , piece_id=5YS2VUVBZ5AGYH4QUPHBKBMJRXFXRIJFV22QL5PNSGAUMMJ5IYBA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015505066 (258h13m3.974602323s) [noise=true , address=104.36.82.60:4359 , piece_id=B7SYXKDFTKZWRHV5RNFLZW6EC2Y7CAPEKDW3GRDA2MMV4BEPF2TA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015825207 (258h13m3.974922464s) [noise=true , address=104.36.82.44:4890 , piece_id=4GKMKWHJRA56FFMONL3TSSOIB7EZHDKNLRTRZZ2XPCEGMSA2337Q, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015928589 (258h13m3.975025838s) [noise=true , address=45.91.116.7:4029 , piece_id=I6KMTHQZTRCZB3YFD4ILKGRPTSOOGFBPQVA6IQSMVGF7NN6AQ5OQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016478408 (258h13m3.975575661s) [noise=true , address=104.36.82.5:4848 , piece_id=SVABQD3C6CN7HOHKNCB6GR5PUBRVVPOERGCMYCRSRESJWXWKZXOA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016523654 (258h13m3.975620901s) [noise=true , address=77.90.31.13:4643 , piece_id=5ALMRQ5GUJM2FAROTUAQX3BAAIM34L6VPTS7MFB72SO3A3SFERQA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016881352 (258h13m3.975978605s) [noise=true , address=104.36.82.6:4908 , piece_id=64QRBUPLSKUWNDE5NSVA7NEOYRGABZQEBHFIY7LVYCFORGSJD6BA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016904287 (258h13m3.976001536s) [noise=true , address=45.91.116.12:4259 , piece_id=DX53HDZGPV3JLUOJAVJGHID4QVA6OZBYPNPC7S52BGS4D73UQ5HA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.017312973 (258h13m3.976410226s) [noise=true , address=79.127.201.215:4349 , piece_id=FX5FWDIDYRSOOPH5YIVLWGBKWPO6DWPEMJJDT3UGOEURJHN3ZU3Q, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.017743670 (258h13m3.976840938s) [noise=true , address=104.36.82.23:4462 , piece_id=IKU755UMGAVBHPGFPFXGE3Q3RZ5GFN3EB5QIGCNI6FYMRNJC4IVA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.573047494 (258h13m4.53214474s) [upload=268838]: Next returned nil segment
Aug 19 11:38:42.573068772 (258h13m4.532166021s) [upload=268838]: Waiting for error group managing segments...
Aug 19 11:38:42.713527532 (258h13m4.672624764s) [noise=true , address=45.91.116.8:4046 , piece_id=RHS4AMYX7SGJTWMTTY7MON3PFAWA7XSZRCHFATYIZEJSOXZXNGBA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.739774851 (258h13m4.698872102s) [noise=true , address=77.90.31.17:4789 , piece_id=GYAP3HUV3OTMJVI4OAIQ5DIWJWJ3G25JHTGITPYO4GRW5QAZTYIQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.744677036 (258h13m4.703774268s) [noise=true , address=45.91.116.14:4203 , piece_id=ILJGHH6YLJULVQE5CJ6IYLXKZF26QUJPUKD3KUEMAHUJVFYCGIDA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.747169666 (258h13m4.706266905s) [noise=true , address=104.36.82.44:4890 , piece_id=4GKMKWHJRA56FFMONL3TSSOIB7EZHDKNLRTRZZ2XPCEGMSA2337Q, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.748659999 (258h13m4.707757248s) [noise=true , address=45.91.116.13:4161 , piece_id=SQQRZMF44IC2N23X2CS6KPG476UXC7DJFYKN6MNOS2UJPOG2DSLQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.753965398 (258h13m4.713062653s) [noise=true , address=45.91.116.12:4259 , piece_id=DX53HDZGPV3JLUOJAVJGHID4QVA6OZBYPNPC7S52BGS4D73UQ5HA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.756042378 (258h13m4.715139616s) [noise=true , address=77.90.31.10:4524 , piece_id=KPN7D2FI6PXVSJ4BDJ5QE57GKTBRQDW4OEDQXYIQBFONJC5UBOSQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.769593684 (258h13m4.728690921s) [noise=true , address=104.36.82.6:4908 , piece_id=64QRBUPLSKUWNDE5NSVA7NEOYRGABZQEBHFIY7LVYCFORGSJD6BA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.771623884 (258h13m4.73072113s) [noise=true , address=45.91.116.6:4994 , piece_id=SE3FW7YSNP2S6PTX7756TGDM54CSYNTI6XT3RWHTLPFBN5O7GQ7Q, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.779371734 (258h13m4.738468972s) [noise=true , address=77.90.31.13:4643 , piece_id=5ALMRQ5GUJM2FAROTUAQX3BAAIM34L6VPTS7MFB72SO3A3SFERQA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.789505813 (258h13m4.748603052s) [noise=true , address=104.36.82.5:4848 , piece_id=SVABQD3C6CN7HOHKNCB6GR5PUBRVVPOERGCMYCRSRESJWXWKZXOA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.804156621 (258h13m4.763253859s) [noise=true , address=77.90.31.18:4819 , piece_id=5YS2VUVBZ5AGYH4QUPHBKBMJRXFXRIJFV22QL5PNSGAUMMJ5IYBA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.805124578 (258h13m4.764221811s) [noise=true , address=104.36.82.60:4359 , piece_id=B7SYXKDFTKZWRHV5RNFLZW6EC2Y7CAPEKDW3GRDA2MMV4BEPF2TA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.808733857 (258h13m4.767831096s) [noise=true , address=77.90.31.16:4746 , piece_id=LIQHF4LLRA7FV32M7W24LPTXH5QXNKBM262MJBZWTPMMSYZ2X5RQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.808761609 (258h13m4.767858853s) [seg_pos={0 0}, upload=268838]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:38:42.809230409 (258h13m4.768327658s) [noise=true , address=45.91.116.7:4029 , piece_id=I6KMTHQZTRCZB3YFD4ILKGRPTSOOGFBPQVA6IQSMVGF7NN6AQ5OQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rWqAGD7Vrj2yzEVyNbfPp278Gga42xPLyAcdzGvUSuz3EgJYh): protocol: write tcp 139.59.144.22:35650->45.91.116.7:4029: use of closed network connection; write tcp 139.59.144.22:35650->45.91.116.7:4029: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35650->45.91.116.7:4029: use of closed network connection
Aug 19 11:38:42.809569384 (258h13m4.768666633s) [noise=true , address=79.127.201.215:4349 , piece_id=FX5FWDIDYRSOOPH5YIVLWGBKWPO6DWPEMJJDT3UGOEURJHN3ZU3Q, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: write tcp 139.59.144.22:40522->79.127.201.215:4349: use of closed network connection; write tcp 139.59.144.22:40522->79.127.201.215:4349: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40522->79.127.201.215:4349: use of closed network connection
Aug 19 11:38:42.809689448 (258h13m4.768786696s) [noise=true , address=104.36.82.23:4462 , piece_id=IKU755UMGAVBHPGFPFXGE3Q3RZ5GFN3EB5QIGCNI6FYMRNJC4IVA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: expected piece hash; context canceled; EOF
Aug 19 11:38:42.809880200 (258h13m4.768977445s) [noise=true , address=77.90.31.19:4847 , piece_id=ADBZWEUEO7OY2J67FZQNXRW4OPSPSWUIUW6AQT7RBYLP2ICRJHMQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 11:38:42.809948727 (258h13m4.769045973s) [seg_pos={0 0}, upload=268838]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:38:42.810065525 (258h13m4.769162774s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:38:42.810070740 (258h13m4.76916799s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:38:43.322368416 (258h13m5.281465668s) [upload=268838]: Done uploading segments...
Aug 19 11:38:43.322396606 (258h13m5.281493859s) [upload=268838]: Upload finished. err: <nil>
Duration: 2.429708063s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X.......................X......] duration:
978.630063ms
FAIL (2025-08-19 11:39:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 490878781e1ea8e8cd6744799db88c339bda649181c8484b7767ab5a9081a558 != before f3eb7f08955a4df7505935be177c550883be751cbad269f169d76a80ae86dfbf ======LOGS====== Aug 19 11:33:30.219497611 (258h7m52.178594866s) [upload=268745]: Starting upload Aug 19 11:33:30.219613119 (258h7m52.178710358s) [upload=268745]: Done starting upload Aug 19 11:33:30.219663567 (258h7m52.178760805s) [upload=268745]: Uploading segments... Aug 19 11:33:30.219812467 (258h7m52.178909719s) [upload=268745]: Got next segment. Inline: true Aug 19 11:33:30.219832065 (258h7m52.178929295s) [upload=268745]: Waiting for error group managing segments... Aug 19 11:33:30.219911126 (258h7m52.179008378s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:33:30.219917917 (258h7m52.179015161s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:33:30.219921673 (258h7m52.179018986s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:33:30.552868796 (258h7m52.511966061s) [upload=268745]: Done uploading segments... Aug 19 11:33:30.552910407 (258h7m52.512007652s) [upload=268745]: Upload finished. err: <nil>
Duration: 978.661076ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [............X......X......X......X.........................X] duration:
2.098836182s
FAIL (2025-08-19 11:38:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 11:38:41.772901638 (258h13m3.731998895s) [upload=268838]: Starting upload
Aug 19 11:38:41.773007477 (258h13m3.732104731s) [upload=268838]: Done starting upload
Aug 19 11:38:41.773324635 (258h13m3.732421873s) [upload=268838]: Uploading segments...
Aug 19 11:38:41.774149077 (258h13m3.733246328s) [upload=268838]: Got next segment. Inline: false
Aug 19 11:38:41.774258233 (258h13m3.733355484s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:38:41.774265595 (258h13m3.733362844s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:38:42.013197547 (258h13m3.972294794s) [seg_pos={0 0}, upload=268838]: Begin upload segment...
Aug 19 11:38:42.013279795 (258h13m3.972377041s) [seg_pos={0 0}, upload=268838]: Done begin upload segment.
Aug 19 11:38:42.013324468 (258h13m3.97242172s) [noise=true , address=45.91.116.6:4994 , piece_id=SE3FW7YSNP2S6PTX7756TGDM54CSYNTI6XT3RWHTLPFBN5O7GQ7Q, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.013378365 (258h13m3.972475623s) [noise=true , address=77.90.31.16:4746 , piece_id=LIQHF4LLRA7FV32M7W24LPTXH5QXNKBM262MJBZWTPMMSYZ2X5RQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.013911330 (258h13m3.973008589s) [noise=true , address=77.90.31.17:4789 , piece_id=GYAP3HUV3OTMJVI4OAIQ5DIWJWJ3G25JHTGITPYO4GRW5QAZTYIQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014038288 (258h13m3.973135545s) [noise=true , address=45.91.116.8:4046 , piece_id=RHS4AMYX7SGJTWMTTY7MON3PFAWA7XSZRCHFATYIZEJSOXZXNGBA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014415379 (258h13m3.973512631s) [noise=true , address=45.91.116.14:4203 , piece_id=ILJGHH6YLJULVQE5CJ6IYLXKZF26QUJPUKD3KUEMAHUJVFYCGIDA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014690739 (258h13m3.973787997s) [noise=true , address=45.91.116.13:4161 , piece_id=SQQRZMF44IC2N23X2CS6KPG476UXC7DJFYKN6MNOS2UJPOG2DSLQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.014751818 (258h13m3.973849065s) [noise=true , address=77.90.31.10:4524 , piece_id=KPN7D2FI6PXVSJ4BDJ5QE57GKTBRQDW4OEDQXYIQBFONJC5UBOSQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015133472 (258h13m3.974230719s) [noise=true , address=77.90.31.19:4847 , piece_id=ADBZWEUEO7OY2J67FZQNXRW4OPSPSWUIUW6AQT7RBYLP2ICRJHMQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015261076 (258h13m3.974358332s) [noise=true , address=77.90.31.18:4819 , piece_id=5YS2VUVBZ5AGYH4QUPHBKBMJRXFXRIJFV22QL5PNSGAUMMJ5IYBA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015505066 (258h13m3.974602323s) [noise=true , address=104.36.82.60:4359 , piece_id=B7SYXKDFTKZWRHV5RNFLZW6EC2Y7CAPEKDW3GRDA2MMV4BEPF2TA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015825207 (258h13m3.974922464s) [noise=true , address=104.36.82.44:4890 , piece_id=4GKMKWHJRA56FFMONL3TSSOIB7EZHDKNLRTRZZ2XPCEGMSA2337Q, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.015928589 (258h13m3.975025838s) [noise=true , address=45.91.116.7:4029 , piece_id=I6KMTHQZTRCZB3YFD4ILKGRPTSOOGFBPQVA6IQSMVGF7NN6AQ5OQ, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016478408 (258h13m3.975575661s) [noise=true , address=104.36.82.5:4848 , piece_id=SVABQD3C6CN7HOHKNCB6GR5PUBRVVPOERGCMYCRSRESJWXWKZXOA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016523654 (258h13m3.975620901s) [noise=true , address=77.90.31.13:4643 , piece_id=5ALMRQ5GUJM2FAROTUAQX3BAAIM34L6VPTS7MFB72SO3A3SFERQA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016881352 (258h13m3.975978605s) [noise=true , address=104.36.82.6:4908 , piece_id=64QRBUPLSKUWNDE5NSVA7NEOYRGABZQEBHFIY7LVYCFORGSJD6BA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.016904287 (258h13m3.976001536s) [noise=true , address=45.91.116.12:4259 , piece_id=DX53HDZGPV3JLUOJAVJGHID4QVA6OZBYPNPC7S52BGS4D73UQ5HA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.017312973 (258h13m3.976410226s) [noise=true , address=79.127.201.215:4349 , piece_id=FX5FWDIDYRSOOPH5YIVLWGBKWPO6DWPEMJJDT3UGOEURJHN3ZU3Q, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.017743670 (258h13m3.976840938s) [noise=true , address=104.36.82.23:4462 , piece_id=IKU755UMGAVBHPGFPFXGE3Q3RZ5GFN3EB5QIGCNI6FYMRNJC4IVA, seg_pos={0 0}, upload=268838]: Uploading piece...
Aug 19 11:38:42.573047494 (258h13m4.53214474s) [upload=268838]: Next returned nil segment
Aug 19 11:38:42.573068772 (258h13m4.532166021s) [upload=268838]: Waiting for error group managing segments...
Aug 19 11:38:42.713527532 (258h13m4.672624764s) [noise=true , address=45.91.116.8:4046 , piece_id=RHS4AMYX7SGJTWMTTY7MON3PFAWA7XSZRCHFATYIZEJSOXZXNGBA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.739774851 (258h13m4.698872102s) [noise=true , address=77.90.31.17:4789 , piece_id=GYAP3HUV3OTMJVI4OAIQ5DIWJWJ3G25JHTGITPYO4GRW5QAZTYIQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.744677036 (258h13m4.703774268s) [noise=true , address=45.91.116.14:4203 , piece_id=ILJGHH6YLJULVQE5CJ6IYLXKZF26QUJPUKD3KUEMAHUJVFYCGIDA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.747169666 (258h13m4.706266905s) [noise=true , address=104.36.82.44:4890 , piece_id=4GKMKWHJRA56FFMONL3TSSOIB7EZHDKNLRTRZZ2XPCEGMSA2337Q, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.748659999 (258h13m4.707757248s) [noise=true , address=45.91.116.13:4161 , piece_id=SQQRZMF44IC2N23X2CS6KPG476UXC7DJFYKN6MNOS2UJPOG2DSLQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.753965398 (258h13m4.713062653s) [noise=true , address=45.91.116.12:4259 , piece_id=DX53HDZGPV3JLUOJAVJGHID4QVA6OZBYPNPC7S52BGS4D73UQ5HA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.756042378 (258h13m4.715139616s) [noise=true , address=77.90.31.10:4524 , piece_id=KPN7D2FI6PXVSJ4BDJ5QE57GKTBRQDW4OEDQXYIQBFONJC5UBOSQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.769593684 (258h13m4.728690921s) [noise=true , address=104.36.82.6:4908 , piece_id=64QRBUPLSKUWNDE5NSVA7NEOYRGABZQEBHFIY7LVYCFORGSJD6BA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.771623884 (258h13m4.73072113s) [noise=true , address=45.91.116.6:4994 , piece_id=SE3FW7YSNP2S6PTX7756TGDM54CSYNTI6XT3RWHTLPFBN5O7GQ7Q, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.779371734 (258h13m4.738468972s) [noise=true , address=77.90.31.13:4643 , piece_id=5ALMRQ5GUJM2FAROTUAQX3BAAIM34L6VPTS7MFB72SO3A3SFERQA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.789505813 (258h13m4.748603052s) [noise=true , address=104.36.82.5:4848 , piece_id=SVABQD3C6CN7HOHKNCB6GR5PUBRVVPOERGCMYCRSRESJWXWKZXOA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.804156621 (258h13m4.763253859s) [noise=true , address=77.90.31.18:4819 , piece_id=5YS2VUVBZ5AGYH4QUPHBKBMJRXFXRIJFV22QL5PNSGAUMMJ5IYBA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.805124578 (258h13m4.764221811s) [noise=true , address=104.36.82.60:4359 , piece_id=B7SYXKDFTKZWRHV5RNFLZW6EC2Y7CAPEKDW3GRDA2MMV4BEPF2TA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.808733857 (258h13m4.767831096s) [noise=true , address=77.90.31.16:4746 , piece_id=LIQHF4LLRA7FV32M7W24LPTXH5QXNKBM262MJBZWTPMMSYZ2X5RQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: <nil>
Aug 19 11:38:42.808761609 (258h13m4.767858853s) [seg_pos={0 0}, upload=268838]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:38:42.809230409 (258h13m4.768327658s) [noise=true , address=45.91.116.7:4029 , piece_id=I6KMTHQZTRCZB3YFD4ILKGRPTSOOGFBPQVA6IQSMVGF7NN6AQ5OQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rWqAGD7Vrj2yzEVyNbfPp278Gga42xPLyAcdzGvUSuz3EgJYh): protocol: write tcp 139.59.144.22:35650->45.91.116.7:4029: use of closed network connection; write tcp 139.59.144.22:35650->45.91.116.7:4029: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35650->45.91.116.7:4029: use of closed network connection
Aug 19 11:38:42.809569384 (258h13m4.768666633s) [noise=true , address=79.127.201.215:4349 , piece_id=FX5FWDIDYRSOOPH5YIVLWGBKWPO6DWPEMJJDT3UGOEURJHN3ZU3Q, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: write tcp 139.59.144.22:40522->79.127.201.215:4349: use of closed network connection; write tcp 139.59.144.22:40522->79.127.201.215:4349: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40522->79.127.201.215:4349: use of closed network connection
Aug 19 11:38:42.809689448 (258h13m4.768786696s) [noise=true , address=104.36.82.23:4462 , piece_id=IKU755UMGAVBHPGFPFXGE3Q3RZ5GFN3EB5QIGCNI6FYMRNJC4IVA, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: expected piece hash; context canceled; EOF
Aug 19 11:38:42.809880200 (258h13m4.768977445s) [noise=true , address=77.90.31.19:4847 , piece_id=ADBZWEUEO7OY2J67FZQNXRW4OPSPSWUIUW6AQT7RBYLP2ICRJHMQ, seg_pos={0 0}, upload=268838]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 11:38:42.809948727 (258h13m4.769045973s) [seg_pos={0 0}, upload=268838]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:38:42.810065525 (258h13m4.769162774s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:38:42.810070740 (258h13m4.76916799s) [upload=268838]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:38:43.322368416 (258h13m5.281465668s) [upload=268838]: Done uploading segments...
Aug 19 11:38:43.322396606 (258h13m5.281493859s) [upload=268838]: Upload finished. err: <nil>
Duration: 2.098863974s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X.......................X.....] duration:
836.628335ms
FAIL (2025-08-19 11:38:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 490878781e1ea8e8cd6744799db88c339bda649181c8484b7767ab5a9081a558 != before f3eb7f08955a4df7505935be177c550883be751cbad269f169d76a80ae86dfbf ======LOGS====== Aug 19 11:33:30.219497611 (258h7m52.178594866s) [upload=268745]: Starting upload Aug 19 11:33:30.219613119 (258h7m52.178710358s) [upload=268745]: Done starting upload Aug 19 11:33:30.219663567 (258h7m52.178760805s) [upload=268745]: Uploading segments... Aug 19 11:33:30.219812467 (258h7m52.178909719s) [upload=268745]: Got next segment. Inline: true Aug 19 11:33:30.219832065 (258h7m52.178929295s) [upload=268745]: Waiting for error group managing segments... Aug 19 11:33:30.219911126 (258h7m52.179008378s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:33:30.219917917 (258h7m52.179015161s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:33:30.219921673 (258h7m52.179018986s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:33:30.552868796 (258h7m52.511966061s) [upload=268745]: Done uploading segments... Aug 19 11:33:30.552910407 (258h7m52.512007652s) [upload=268745]: Upload finished. err: <nil>
Duration: 836.662782ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.............X......X......X......X.........................] duration:
2.969177292s
FAIL (2025-08-19 11:38:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.969222701s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X.......................X....] duration:
910.779019ms
FAIL (2025-08-19 11:37:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 490878781e1ea8e8cd6744799db88c339bda649181c8484b7767ab5a9081a558 != before f3eb7f08955a4df7505935be177c550883be751cbad269f169d76a80ae86dfbf ======LOGS====== Aug 19 11:33:30.219497611 (258h7m52.178594866s) [upload=268745]: Starting upload Aug 19 11:33:30.219613119 (258h7m52.178710358s) [upload=268745]: Done starting upload Aug 19 11:33:30.219663567 (258h7m52.178760805s) [upload=268745]: Uploading segments... Aug 19 11:33:30.219812467 (258h7m52.178909719s) [upload=268745]: Got next segment. Inline: true Aug 19 11:33:30.219832065 (258h7m52.178929295s) [upload=268745]: Waiting for error group managing segments... Aug 19 11:33:30.219911126 (258h7m52.179008378s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:33:30.219917917 (258h7m52.179015161s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:33:30.219921673 (258h7m52.179018986s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:33:30.552868796 (258h7m52.511966061s) [upload=268745]: Done uploading segments... Aug 19 11:33:30.552910407 (258h7m52.512007652s) [upload=268745]: Upload finished. err: <nil>
Duration: 910.812719ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..............X......X......X......X........................] duration:
2.511144407s
FAIL (2025-08-19 11:37:15 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.511177324s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............X......X......X......X.......................] duration:
2.347468874s
FAIL (2025-08-19 11:36:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.347510572s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X.......................X...] duration:
1.136876297s
FAIL (2025-08-19 11:36:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 490878781e1ea8e8cd6744799db88c339bda649181c8484b7767ab5a9081a558 != before f3eb7f08955a4df7505935be177c550883be751cbad269f169d76a80ae86dfbf ======LOGS====== Aug 19 11:33:30.219497611 (258h7m52.178594866s) [upload=268745]: Starting upload Aug 19 11:33:30.219613119 (258h7m52.178710358s) [upload=268745]: Done starting upload Aug 19 11:33:30.219663567 (258h7m52.178760805s) [upload=268745]: Uploading segments... Aug 19 11:33:30.219812467 (258h7m52.178909719s) [upload=268745]: Got next segment. Inline: true Aug 19 11:33:30.219832065 (258h7m52.178929295s) [upload=268745]: Waiting for error group managing segments... Aug 19 11:33:30.219911126 (258h7m52.179008378s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:33:30.219917917 (258h7m52.179015161s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:33:30.219921673 (258h7m52.179018986s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:33:30.552868796 (258h7m52.511966061s) [upload=268745]: Done uploading segments... Aug 19 11:33:30.552910407 (258h7m52.512007652s) [upload=268745]: Upload finished. err: <nil>
Duration: 1.136907673s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [................X......X......X......X......................] duration:
2.592327735s
FAIL (2025-08-19 11:35:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.592496198s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X.......................X..] duration:
1.06353004s
FAIL (2025-08-19 11:35:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 490878781e1ea8e8cd6744799db88c339bda649181c8484b7767ab5a9081a558 != before f3eb7f08955a4df7505935be177c550883be751cbad269f169d76a80ae86dfbf ======LOGS====== Aug 19 11:33:30.219497611 (258h7m52.178594866s) [upload=268745]: Starting upload Aug 19 11:33:30.219613119 (258h7m52.178710358s) [upload=268745]: Done starting upload Aug 19 11:33:30.219663567 (258h7m52.178760805s) [upload=268745]: Uploading segments... Aug 19 11:33:30.219812467 (258h7m52.178909719s) [upload=268745]: Got next segment. Inline: true Aug 19 11:33:30.219832065 (258h7m52.178929295s) [upload=268745]: Waiting for error group managing segments... Aug 19 11:33:30.219911126 (258h7m52.179008378s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:33:30.219917917 (258h7m52.179015161s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:33:30.219921673 (258h7m52.179018986s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:33:30.552868796 (258h7m52.511966061s) [upload=268745]: Done uploading segments... Aug 19 11:33:30.552910407 (258h7m52.512007652s) [upload=268745]: Upload finished. err: <nil>
Duration: 1.06364075s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................X......X......X......X.....................] duration:
2.423970356s
FAIL (2025-08-19 11:35:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.424005816s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X.......................X.] duration:
1.11905847s
FAIL (2025-08-19 11:34:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 490878781e1ea8e8cd6744799db88c339bda649181c8484b7767ab5a9081a558 != before f3eb7f08955a4df7505935be177c550883be751cbad269f169d76a80ae86dfbf ======LOGS====== Aug 19 11:33:30.219497611 (258h7m52.178594866s) [upload=268745]: Starting upload Aug 19 11:33:30.219613119 (258h7m52.178710358s) [upload=268745]: Done starting upload Aug 19 11:33:30.219663567 (258h7m52.178760805s) [upload=268745]: Uploading segments... Aug 19 11:33:30.219812467 (258h7m52.178909719s) [upload=268745]: Got next segment. Inline: true Aug 19 11:33:30.219832065 (258h7m52.178929295s) [upload=268745]: Waiting for error group managing segments... Aug 19 11:33:30.219911126 (258h7m52.179008378s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:33:30.219917917 (258h7m52.179015161s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:33:30.219921673 (258h7m52.179018986s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:33:30.552868796 (258h7m52.511966061s) [upload=268745]: Done uploading segments... Aug 19 11:33:30.552910407 (258h7m52.512007652s) [upload=268745]: Upload finished. err: <nil>
Duration: 1.119086937s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................X......X......X......X....................] duration:
2.436420586s
FAIL (2025-08-19 11:34:37 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.436468638s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X..................X......X......X......X...................] duration:
2.904886862s
FAIL (2025-08-19 11:34:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.904930722s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X..................X......X......X......X..................] duration:
2.997155476s
FAIL (2025-08-19 11:33:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.997185559s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X.......................X] duration:
993.614712ms
FAIL (2025-08-19 11:33:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 490878781e1ea8e8cd6744799db88c339bda649181c8484b7767ab5a9081a558 != before f3eb7f08955a4df7505935be177c550883be751cbad269f169d76a80ae86dfbf ======LOGS====== Aug 19 11:33:30.219497611 (258h7m52.178594866s) [upload=268745]: Starting upload Aug 19 11:33:30.219613119 (258h7m52.178710358s) [upload=268745]: Done starting upload Aug 19 11:33:30.219663567 (258h7m52.178760805s) [upload=268745]: Uploading segments... Aug 19 11:33:30.219812467 (258h7m52.178909719s) [upload=268745]: Got next segment. Inline: true Aug 19 11:33:30.219832065 (258h7m52.178929295s) [upload=268745]: Waiting for error group managing segments... Aug 19 11:33:30.219911126 (258h7m52.179008378s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:33:30.219917917 (258h7m52.179015161s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:33:30.219921673 (258h7m52.179018986s) [upload=268745]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:33:30.552868796 (258h7m52.511966061s) [upload=268745]: Done uploading segments... Aug 19 11:33:30.552910407 (258h7m52.512007652s) [upload=268745]: Upload finished. err: <nil>
Duration: 993.644064ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X..................X......X......X......X.................] duration:
2.654641737s
FAIL (2025-08-19 11:32:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.654692787s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
867.163837ms
FAIL (2025-08-19 11:32:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 867.19797ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.015520919s
FAIL (2025-08-19 11:31:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.015555542s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...X..................X......X......X......X................] duration:
2.772137725s
FAIL (2025-08-19 11:31:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.772185506s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
898.70166ms
FAIL (2025-08-19 11:30:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 898.744427ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....X..................X......X......X......X...............] duration:
2.572091809s
FAIL (2025-08-19 11:30:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.572126737s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X......................................X....................] duration:
997.975795ms
FAIL (2025-08-19 11:29:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 998.006834ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....X..................X......X......X......X..............] duration:
2.627796939s
FAIL (2025-08-19 11:29:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.627833794s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......X..................X......X......X......X.............] duration:
2.750016308s
FAIL (2025-08-19 11:29:03 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.750137091s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X......................................X...................] duration:
1.241425159s
FAIL (2025-08-19 11:28:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.241463334s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [X......X..................X......X......X......X............] duration:
2.383489501s
FAIL (2025-08-19 11:28:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.38352643s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X......................................X..................] duration:
823.896451ms
FAIL (2025-08-19 11:28:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 823.930713ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|