Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
3.187111088s
FAIL (2025-08-09 17:02:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 16:46:17.762337236 (23h20m39.721434468s) [upload=24333]: Starting upload Aug 9 16:46:17.762391453 (23h20m39.721488707s) [upload=24333]: Done starting upload Aug 9 16:46:17.762569542 (23h20m39.721666782s) [upload=24333]: Uploading segments... Aug 9 16:46:17.762753040 (23h20m39.721850286s) [upload=24333]: Got next segment. Inline: false Aug 9 16:46:17.762791531 (23h20m39.721888775s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:46:17.762795831 (23h20m39.721893077s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 16:46:17.853210130 (23h20m39.812307393s) [upload=24333]: Next segment err: metaclient: Too Many Requests Aug 9 16:46:17.853242310 (23h20m39.812339556s) [upload=24333]: Done uploading segments... Aug 9 16:46:17.853262897 (23h20m39.812360145s) [upload=24333]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.187145721s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X....................X........X......................] duration:
1.138848052s
FAIL (2025-08-09 17:02:12 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 1.138872019s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
3.464699092s
FAIL (2025-08-09 17:01:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 16:46:17.762337236 (23h20m39.721434468s) [upload=24333]: Starting upload Aug 9 16:46:17.762391453 (23h20m39.721488707s) [upload=24333]: Done starting upload Aug 9 16:46:17.762569542 (23h20m39.721666782s) [upload=24333]: Uploading segments... Aug 9 16:46:17.762753040 (23h20m39.721850286s) [upload=24333]: Got next segment. Inline: false Aug 9 16:46:17.762791531 (23h20m39.721888775s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:46:17.762795831 (23h20m39.721893077s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 16:46:17.853210130 (23h20m39.812307393s) [upload=24333]: Next segment err: metaclient: Too Many Requests Aug 9 16:46:17.853242310 (23h20m39.812339556s) [upload=24333]: Done uploading segments... Aug 9 16:46:17.853262897 (23h20m39.812360145s) [upload=24333]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.464765908s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X....................X........X.....................] duration:
958.009322ms
FAIL (2025-08-09 17:01:14 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 958.040777ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X....................X........X....................] duration:
1.256153253s
FAIL (2025-08-09 17:00:33 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 1.256235393s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.553014339s
FAIL (2025-08-09 17:00:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 16:46:17.762337236 (23h20m39.721434468s) [upload=24333]: Starting upload Aug 9 16:46:17.762391453 (23h20m39.721488707s) [upload=24333]: Done starting upload Aug 9 16:46:17.762569542 (23h20m39.721666782s) [upload=24333]: Uploading segments... Aug 9 16:46:17.762753040 (23h20m39.721850286s) [upload=24333]: Got next segment. Inline: false Aug 9 16:46:17.762791531 (23h20m39.721888775s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:46:17.762795831 (23h20m39.721893077s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 16:46:17.853210130 (23h20m39.812307393s) [upload=24333]: Next segment err: metaclient: Too Many Requests Aug 9 16:46:17.853242310 (23h20m39.812339556s) [upload=24333]: Done uploading segments... Aug 9 16:46:17.853262897 (23h20m39.812360145s) [upload=24333]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.553046094s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.778645085s
FAIL (2025-08-09 16:59:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 16:46:17.762337236 (23h20m39.721434468s) [upload=24333]: Starting upload Aug 9 16:46:17.762391453 (23h20m39.721488707s) [upload=24333]: Done starting upload Aug 9 16:46:17.762569542 (23h20m39.721666782s) [upload=24333]: Uploading segments... Aug 9 16:46:17.762753040 (23h20m39.721850286s) [upload=24333]: Got next segment. Inline: false Aug 9 16:46:17.762791531 (23h20m39.721888775s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:46:17.762795831 (23h20m39.721893077s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 16:46:17.853210130 (23h20m39.812307393s) [upload=24333]: Next segment err: metaclient: Too Many Requests Aug 9 16:46:17.853242310 (23h20m39.812339556s) [upload=24333]: Done uploading segments... Aug 9 16:46:17.853262897 (23h20m39.812360145s) [upload=24333]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.778672689s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X.........X....................X........X...................] duration:
1.100398186s
FAIL (2025-08-09 16:59:32 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 1.10047616s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X.........X....................X........X..................] duration:
1.242101294s
FAIL (2025-08-09 16:58:53 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 1.242131004s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
3.182590652s
FAIL (2025-08-09 16:58:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 16:46:17.762337236 (23h20m39.721434468s) [upload=24333]: Starting upload Aug 9 16:46:17.762391453 (23h20m39.721488707s) [upload=24333]: Done starting upload Aug 9 16:46:17.762569542 (23h20m39.721666782s) [upload=24333]: Uploading segments... Aug 9 16:46:17.762753040 (23h20m39.721850286s) [upload=24333]: Got next segment. Inline: false Aug 9 16:46:17.762791531 (23h20m39.721888775s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:46:17.762795831 (23h20m39.721893077s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 16:46:17.853210130 (23h20m39.812307393s) [upload=24333]: Next segment err: metaclient: Too Many Requests Aug 9 16:46:17.853242310 (23h20m39.812339556s) [upload=24333]: Done uploading segments... Aug 9 16:46:17.853262897 (23h20m39.812360145s) [upload=24333]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.182627471s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X.........X....................X........X.................] duration:
1.148674169s
FAIL (2025-08-09 16:58:32 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 1.148715677s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X.........X....................X........X................] duration:
849.541751ms
FAIL (2025-08-09 16:58:01 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 849.570832ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.571717147s
FAIL (2025-08-09 16:57:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 16:46:17.762337236 (23h20m39.721434468s) [upload=24333]: Starting upload Aug 9 16:46:17.762391453 (23h20m39.721488707s) [upload=24333]: Done starting upload Aug 9 16:46:17.762569542 (23h20m39.721666782s) [upload=24333]: Uploading segments... Aug 9 16:46:17.762753040 (23h20m39.721850286s) [upload=24333]: Got next segment. Inline: false Aug 9 16:46:17.762791531 (23h20m39.721888775s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:46:17.762795831 (23h20m39.721893077s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 16:46:17.853210130 (23h20m39.812307393s) [upload=24333]: Next segment err: metaclient: Too Many Requests Aug 9 16:46:17.853242310 (23h20m39.812339556s) [upload=24333]: Done uploading segments... Aug 9 16:46:17.853262897 (23h20m39.812360145s) [upload=24333]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.571756876s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.975429457s
FAIL (2025-08-09 16:57:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 16:46:17.762337236 (23h20m39.721434468s) [upload=24333]: Starting upload Aug 9 16:46:17.762391453 (23h20m39.721488707s) [upload=24333]: Done starting upload Aug 9 16:46:17.762569542 (23h20m39.721666782s) [upload=24333]: Uploading segments... Aug 9 16:46:17.762753040 (23h20m39.721850286s) [upload=24333]: Got next segment. Inline: false Aug 9 16:46:17.762791531 (23h20m39.721888775s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:46:17.762795831 (23h20m39.721893077s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 16:46:17.853210130 (23h20m39.812307393s) [upload=24333]: Next segment err: metaclient: Too Many Requests Aug 9 16:46:17.853242310 (23h20m39.812339556s) [upload=24333]: Done uploading segments... Aug 9 16:46:17.853262897 (23h20m39.812360145s) [upload=24333]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.975461668s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X.........X....................X........X...............] duration:
970.643194ms
FAIL (2025-08-09 16:57:09 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 970.681077ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
3.079676664s
FAIL (2025-08-09 16:56:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 16:46:17.762337236 (23h20m39.721434468s) [upload=24333]: Starting upload Aug 9 16:46:17.762391453 (23h20m39.721488707s) [upload=24333]: Done starting upload Aug 9 16:46:17.762569542 (23h20m39.721666782s) [upload=24333]: Uploading segments... Aug 9 16:46:17.762753040 (23h20m39.721850286s) [upload=24333]: Got next segment. Inline: false Aug 9 16:46:17.762791531 (23h20m39.721888775s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:46:17.762795831 (23h20m39.721893077s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 16:46:17.853210130 (23h20m39.812307393s) [upload=24333]: Next segment err: metaclient: Too Many Requests Aug 9 16:46:17.853242310 (23h20m39.812339556s) [upload=24333]: Done uploading segments... Aug 9 16:46:17.853262897 (23h20m39.812360145s) [upload=24333]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.079734683s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X.........X....................X........X..............] duration:
1.107253863s
FAIL (2025-08-09 16:56:32 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 1.107283781s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
3.045971649s
FAIL (2025-08-09 16:55:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 16:46:17.762337236 (23h20m39.721434468s) [upload=24333]: Starting upload Aug 9 16:46:17.762391453 (23h20m39.721488707s) [upload=24333]: Done starting upload Aug 9 16:46:17.762569542 (23h20m39.721666782s) [upload=24333]: Uploading segments... Aug 9 16:46:17.762753040 (23h20m39.721850286s) [upload=24333]: Got next segment. Inline: false Aug 9 16:46:17.762791531 (23h20m39.721888775s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:46:17.762795831 (23h20m39.721893077s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 16:46:17.853210130 (23h20m39.812307393s) [upload=24333]: Next segment err: metaclient: Too Many Requests Aug 9 16:46:17.853242310 (23h20m39.812339556s) [upload=24333]: Done uploading segments... Aug 9 16:46:17.853262897 (23h20m39.812360145s) [upload=24333]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.04602445s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X.........X....................X........X.............] duration:
841.860178ms
FAIL (2025-08-09 16:55:29 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 841.906425ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
3.003209001s
FAIL (2025-08-09 16:55:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 16:46:17.762337236 (23h20m39.721434468s) [upload=24333]: Starting upload Aug 9 16:46:17.762391453 (23h20m39.721488707s) [upload=24333]: Done starting upload Aug 9 16:46:17.762569542 (23h20m39.721666782s) [upload=24333]: Uploading segments... Aug 9 16:46:17.762753040 (23h20m39.721850286s) [upload=24333]: Got next segment. Inline: false Aug 9 16:46:17.762791531 (23h20m39.721888775s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:46:17.762795831 (23h20m39.721893077s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 16:46:17.853210130 (23h20m39.812307393s) [upload=24333]: Next segment err: metaclient: Too Many Requests Aug 9 16:46:17.853242310 (23h20m39.812339556s) [upload=24333]: Done uploading segments... Aug 9 16:46:17.853262897 (23h20m39.812360145s) [upload=24333]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.003248715s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X.........X....................X........X............] duration:
1.023181018s
FAIL (2025-08-09 16:54:46 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 1.023218921s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
3.058382969s
FAIL (2025-08-09 16:54:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 16:46:17.762337236 (23h20m39.721434468s) [upload=24333]: Starting upload Aug 9 16:46:17.762391453 (23h20m39.721488707s) [upload=24333]: Done starting upload Aug 9 16:46:17.762569542 (23h20m39.721666782s) [upload=24333]: Uploading segments... Aug 9 16:46:17.762753040 (23h20m39.721850286s) [upload=24333]: Got next segment. Inline: false Aug 9 16:46:17.762791531 (23h20m39.721888775s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:46:17.762795831 (23h20m39.721893077s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 16:46:17.853210130 (23h20m39.812307393s) [upload=24333]: Next segment err: metaclient: Too Many Requests Aug 9 16:46:17.853242310 (23h20m39.812339556s) [upload=24333]: Done uploading segments... Aug 9 16:46:17.853262897 (23h20m39.812360145s) [upload=24333]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.058414355s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X.........X....................X........X...........] duration:
942.059058ms
FAIL (2025-08-09 16:53:52 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 942.106851ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
3.469415318s
FAIL (2025-08-09 16:53:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 16:46:17.762337236 (23h20m39.721434468s) [upload=24333]: Starting upload Aug 9 16:46:17.762391453 (23h20m39.721488707s) [upload=24333]: Done starting upload Aug 9 16:46:17.762569542 (23h20m39.721666782s) [upload=24333]: Uploading segments... Aug 9 16:46:17.762753040 (23h20m39.721850286s) [upload=24333]: Got next segment. Inline: false Aug 9 16:46:17.762791531 (23h20m39.721888775s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:46:17.762795831 (23h20m39.721893077s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 16:46:17.853210130 (23h20m39.812307393s) [upload=24333]: Next segment err: metaclient: Too Many Requests Aug 9 16:46:17.853242310 (23h20m39.812339556s) [upload=24333]: Done uploading segments... Aug 9 16:46:17.853262897 (23h20m39.812360145s) [upload=24333]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.469450918s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X.........X....................X........X..........] duration:
967.721702ms
FAIL (2025-08-09 16:52:50 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 967.750863ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
3.388893466s
FAIL (2025-08-09 16:52:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 16:46:17.762337236 (23h20m39.721434468s) [upload=24333]: Starting upload Aug 9 16:46:17.762391453 (23h20m39.721488707s) [upload=24333]: Done starting upload Aug 9 16:46:17.762569542 (23h20m39.721666782s) [upload=24333]: Uploading segments... Aug 9 16:46:17.762753040 (23h20m39.721850286s) [upload=24333]: Got next segment. Inline: false Aug 9 16:46:17.762791531 (23h20m39.721888775s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:46:17.762795831 (23h20m39.721893077s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 16:46:17.853210130 (23h20m39.812307393s) [upload=24333]: Next segment err: metaclient: Too Many Requests Aug 9 16:46:17.853242310 (23h20m39.812339556s) [upload=24333]: Done uploading segments... Aug 9 16:46:17.853262897 (23h20m39.812360145s) [upload=24333]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.388926193s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X.........X....................X........X.........] duration:
951.26712ms
FAIL (2025-08-09 16:51:46 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 951.3743ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.949952502s
FAIL (2025-08-09 16:51:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 16:46:17.762337236 (23h20m39.721434468s) [upload=24333]: Starting upload Aug 9 16:46:17.762391453 (23h20m39.721488707s) [upload=24333]: Done starting upload Aug 9 16:46:17.762569542 (23h20m39.721666782s) [upload=24333]: Uploading segments... Aug 9 16:46:17.762753040 (23h20m39.721850286s) [upload=24333]: Got next segment. Inline: false Aug 9 16:46:17.762791531 (23h20m39.721888775s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:46:17.762795831 (23h20m39.721893077s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 16:46:17.853210130 (23h20m39.812307393s) [upload=24333]: Next segment err: metaclient: Too Many Requests Aug 9 16:46:17.853242310 (23h20m39.812339556s) [upload=24333]: Done uploading segments... Aug 9 16:46:17.853262897 (23h20m39.812360145s) [upload=24333]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.94999299s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X.........X....................X........X........] duration:
838.31062ms
FAIL (2025-08-09 16:50:43 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 838.349423ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.965705428s
FAIL (2025-08-09 16:50:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 16:46:17.762337236 (23h20m39.721434468s) [upload=24333]: Starting upload Aug 9 16:46:17.762391453 (23h20m39.721488707s) [upload=24333]: Done starting upload Aug 9 16:46:17.762569542 (23h20m39.721666782s) [upload=24333]: Uploading segments... Aug 9 16:46:17.762753040 (23h20m39.721850286s) [upload=24333]: Got next segment. Inline: false Aug 9 16:46:17.762791531 (23h20m39.721888775s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:46:17.762795831 (23h20m39.721893077s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 16:46:17.853210130 (23h20m39.812307393s) [upload=24333]: Next segment err: metaclient: Too Many Requests Aug 9 16:46:17.853242310 (23h20m39.812339556s) [upload=24333]: Done uploading segments... Aug 9 16:46:17.853262897 (23h20m39.812360145s) [upload=24333]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.965736136s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X.........X....................X........X.......] duration:
835.851006ms
FAIL (2025-08-09 16:49:39 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 835.881289ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
3.433821514s
FAIL (2025-08-09 16:49:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 16:46:17.762337236 (23h20m39.721434468s) [upload=24333]: Starting upload Aug 9 16:46:17.762391453 (23h20m39.721488707s) [upload=24333]: Done starting upload Aug 9 16:46:17.762569542 (23h20m39.721666782s) [upload=24333]: Uploading segments... Aug 9 16:46:17.762753040 (23h20m39.721850286s) [upload=24333]: Got next segment. Inline: false Aug 9 16:46:17.762791531 (23h20m39.721888775s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:46:17.762795831 (23h20m39.721893077s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 16:46:17.853210130 (23h20m39.812307393s) [upload=24333]: Next segment err: metaclient: Too Many Requests Aug 9 16:46:17.853242310 (23h20m39.812339556s) [upload=24333]: Done uploading segments... Aug 9 16:46:17.853262897 (23h20m39.812360145s) [upload=24333]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.433848843s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X.........X....................X........X......] duration:
947.609522ms
FAIL (2025-08-09 16:48:37 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 947.642192ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.911639093s
FAIL (2025-08-09 16:48:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 16:46:17.762337236 (23h20m39.721434468s) [upload=24333]: Starting upload Aug 9 16:46:17.762391453 (23h20m39.721488707s) [upload=24333]: Done starting upload Aug 9 16:46:17.762569542 (23h20m39.721666782s) [upload=24333]: Uploading segments... Aug 9 16:46:17.762753040 (23h20m39.721850286s) [upload=24333]: Got next segment. Inline: false Aug 9 16:46:17.762791531 (23h20m39.721888775s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:46:17.762795831 (23h20m39.721893077s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 16:46:17.853210130 (23h20m39.812307393s) [upload=24333]: Next segment err: metaclient: Too Many Requests Aug 9 16:46:17.853242310 (23h20m39.812339556s) [upload=24333]: Done uploading segments... Aug 9 16:46:17.853262897 (23h20m39.812360145s) [upload=24333]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.911673191s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X.........X....................X........X.....] duration:
1.600274321s
FAIL (2025-08-09 16:48:14 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 1.600311794s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............X.........X....................X........X....] duration:
1.048759665s
FAIL (2025-08-09 16:47:27 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 1.048795301s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
3.028348596s
FAIL (2025-08-09 16:47:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 16:46:17.762337236 (23h20m39.721434468s) [upload=24333]: Starting upload Aug 9 16:46:17.762391453 (23h20m39.721488707s) [upload=24333]: Done starting upload Aug 9 16:46:17.762569542 (23h20m39.721666782s) [upload=24333]: Uploading segments... Aug 9 16:46:17.762753040 (23h20m39.721850286s) [upload=24333]: Got next segment. Inline: false Aug 9 16:46:17.762791531 (23h20m39.721888775s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:46:17.762795831 (23h20m39.721893077s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 16:46:17.853210130 (23h20m39.812307393s) [upload=24333]: Next segment err: metaclient: Too Many Requests Aug 9 16:46:17.853242310 (23h20m39.812339556s) [upload=24333]: Done uploading segments... Aug 9 16:46:17.853262897 (23h20m39.812360145s) [upload=24333]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.028448484s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................X.........X....................X........X...] duration:
1.027136199s
FAIL (2025-08-09 16:46:45 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 1.027220938s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................X.........X....................X........X..] duration:
915.864112ms
FAIL (2025-08-09 16:46:22 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 915.894429ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
368.468955ms
FAIL (2025-08-09 16:46:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 16:46:17.762337236 (23h20m39.721434468s) [upload=24333]: Starting upload Aug 9 16:46:17.762391453 (23h20m39.721488707s) [upload=24333]: Done starting upload Aug 9 16:46:17.762569542 (23h20m39.721666782s) [upload=24333]: Uploading segments... Aug 9 16:46:17.762753040 (23h20m39.721850286s) [upload=24333]: Got next segment. Inline: false Aug 9 16:46:17.762791531 (23h20m39.721888775s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:46:17.762795831 (23h20m39.721893077s) [upload=24333]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 16:46:17.853210130 (23h20m39.812307393s) [upload=24333]: Next segment err: metaclient: Too Many Requests Aug 9 16:46:17.853242310 (23h20m39.812339556s) [upload=24333]: Done uploading segments... Aug 9 16:46:17.853262897 (23h20m39.812360145s) [upload=24333]: Upload finished. err: metaclient: Too Many Requests
Duration: 368.507601ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................X.........X....................X........X.] duration:
890.460413ms
FAIL (2025-08-09 16:45:57 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 890.48674ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...................X.........X....................X........X] duration:
664.945622ms
FAIL (2025-08-09 16:44:53 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:44:53.580910331 (23h19m15.540007782s) [upload=24309]: Starting upload Aug 9 16:44:53.581000965 (23h19m15.54009821s) [upload=24309]: Done starting upload Aug 9 16:44:53.581090310 (23h19m15.540187541s) [upload=24309]: Uploading segments... Aug 9 16:44:53.581130738 (23h19m15.540227992s) [upload=24309]: Got next segment. Inline: true Aug 9 16:44:53.581135164 (23h19m15.540232408s) [upload=24309]: Waiting for error group managing segments... Aug 9 16:44:53.581176623 (23h19m15.540273854s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:44:53.581180713 (23h19m15.540277958s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:44:53.581183935 (23h19m15.54028118s) [upload=24309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:44:53.774423285 (23h19m15.733520531s) [upload=24309]: Done uploading segments... Aug 9 16:44:53.774445226 (23h19m15.733542458s) [upload=24309]: Upload finished. err: <nil>
Duration: 664.976122ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.89418803s
FAIL (2025-08-09 16:44:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0c770d746542180eeb44b807b0cf361cb2cebb81feaf44d855b95bc712452cc0 != before 490082c63b99f51367ea69a3c3b3fb75d05a22676845856a3d3a658e9865059c
======LOGS======
Aug 9 16:00:33.666585872 (22h34m55.625683118s) [upload=23543]: Starting upload
Aug 9 16:00:33.666644051 (22h34m55.625741283s) [upload=23543]: Done starting upload
Aug 9 16:00:33.666974455 (22h34m55.6260717s) [upload=23543]: Uploading segments...
Aug 9 16:00:33.667094876 (22h34m55.626192127s) [upload=23543]: Got next segment. Inline: false
Aug 9 16:00:33.667201917 (22h34m55.626299163s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 16:00:33.667209149 (22h34m55.626306398s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 16:00:33.939074109 (22h34m55.898171365s) [seg_pos={0 0}, upload=23543]: Begin upload segment...
Aug 9 16:00:33.939175451 (22h34m55.898272704s) [seg_pos={0 0}, upload=23543]: Done begin upload segment.
Aug 9 16:00:33.939250028 (22h34m55.898347282s) [noise=true , address=104.36.82.60:4352 , piece_id=KFEGYIYC7EH22DFQLGWW4E2CIGUGFXQ2F3CMZJ2IZA6TIPBFBIHA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.940344092 (22h34m55.89944135s) [noise=true , address=104.36.82.23:4448 , piece_id=KDTLTNNPICWD2PX3NFWLY2QHUVMYKXYYV7XP24KLHZOSMXQURKCQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.941112869 (22h34m55.900210128s) [noise=true , address=104.36.82.45:4930 , piece_id=CFNMEWGQE7CONBMDAD7KDW452NNDFT3KOUG5WD7FAITLIC7XSMSQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.941618841 (22h34m55.900716098s) [noise=true , address=104.36.82.46:4511 , piece_id=FLSJP5FV46MELD4S7HUFS7C3JX4UDBOW5YF7NZ6GNQ3Q4PGKU5SQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.942364679 (22h34m55.901461934s) [noise=true , address=104.36.82.8:4002 , piece_id=3RQ6XX3DDQXXMHLK6HZFM7BSPIL3JCIJY7NSVQ4QZN54I2EZ6VJQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.943542485 (22h34m55.90263974s) [noise=true , address=104.36.82.37:4673 , piece_id=T6LQMDTTFUKDPS55RTEBLK5OHGTIM6AVCCDYEH3VIOY3EIPRGZFA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.944146405 (22h34m55.90324366s) [noise=true , address=64.49.13.138:4492 , piece_id=7SSFGLOAZTPSWKIR4D7N7NRYGLBPA672MKZ5YGW5YSHI3Z6LVLFQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.945658251 (22h34m55.904755505s) [noise=true , address=64.49.13.169:4706 , piece_id=JBODHN3QWGY3RQQBCNNIARWL7N4X4THIIUHFVZY44PE2XE3OH2SQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.946280080 (22h34m55.905377335s) [noise=true , address=104.36.82.17:4352 , piece_id=F2O6EREVYG2GYC3VTUVHAILBLANWJ76F7PYZJUAFJPVDSYX2JPEA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.946770611 (22h34m55.905867866s) [noise=true , address=104.36.82.62:4425 , piece_id=PZSMOPLPHJDGB7P4PWZLLVKBJI33UFKJQ4PZDK57AU53WTUKWTXA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.947369772 (22h34m55.906467027s) [noise=true , address=104.36.82.44:4870 , piece_id=TEIXCF2FNSAZ4IRRARFJYQEPT3QOQQBMXZUSPJS7DBQZEIARBY2Q, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.947969505 (22h34m55.90706676s) [noise=true , address=104.36.82.47:4541 , piece_id=KDXXIGT4P2IN3XHAEJUPM4F6DVMQ3SGSBS63FH63UOQY5C7OWNNA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.948745646 (22h34m55.907842901s) [noise=true , address=45.91.116.8:4073 , piece_id=KU76CWQ53LJLMBO47YSIR32CB6O6C6V43EJVURAKOQELESNUFWJQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.949296863 (22h34m55.908394118s) [noise=true , address=64.49.13.139:4476 , piece_id=RVIBEQSFQXQ2K6WFEANFMCF4DRLTJOQ4KV2C24JQNYXIX3QYOJKQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.949852444 (22h34m55.908949698s) [noise=true , address=64.49.13.137:4494 , piece_id=O53BUMXLAFSBSYFQY2PYT3LTU3ZFPHV5WW37QHESKQDJVER5WFBA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.950493872 (22h34m55.909591127s) [noise=true , address=104.36.82.39:4742 , piece_id=7FW3XVRSTAVALD7NTPMBKOVJ36LG3NWH3OHFS7UOIGYX3K3IKSSQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.951002229 (22h34m55.910099484s) [noise=true , address=45.91.116.12:4228 , piece_id=HFFUHH5H4JLFQJELLUNOKSUS3H56BPVMK33FY2D4CWNVJHRTM6PA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.951575101 (22h34m55.910672357s) [noise=true , address=104.36.82.59:4321 , piece_id=Y2RZBJWIQNR2TKE4BLWCTU3VTCE7QFRZC2DE5UR3JBVCAD6XR3GA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:34.544570816 (22h34m56.503668056s) [upload=23543]: Next returned nil segment
Aug 9 16:00:34.544635633 (22h34m56.503732888s) [upload=23543]: Waiting for error group managing segments...
Aug 9 16:00:34.690215867 (22h34m56.649313113s) [noise=true , address=45.91.116.12:4228 , piece_id=HFFUHH5H4JLFQJELLUNOKSUS3H56BPVMK33FY2D4CWNVJHRTM6PA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.707428704 (22h34m56.666525942s) [noise=true , address=104.36.82.45:4930 , piece_id=CFNMEWGQE7CONBMDAD7KDW452NNDFT3KOUG5WD7FAITLIC7XSMSQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.712368352 (22h34m56.671465604s) [noise=true , address=104.36.82.46:4511 , piece_id=FLSJP5FV46MELD4S7HUFS7C3JX4UDBOW5YF7NZ6GNQ3Q4PGKU5SQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.718078638 (22h34m56.677175877s) [noise=true , address=104.36.82.59:4321 , piece_id=Y2RZBJWIQNR2TKE4BLWCTU3VTCE7QFRZC2DE5UR3JBVCAD6XR3GA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.718567528 (22h34m56.677664774s) [noise=true , address=104.36.82.37:4673 , piece_id=T6LQMDTTFUKDPS55RTEBLK5OHGTIM6AVCCDYEH3VIOY3EIPRGZFA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.723754094 (22h34m56.682851328s) [noise=true , address=104.36.82.60:4352 , piece_id=KFEGYIYC7EH22DFQLGWW4E2CIGUGFXQ2F3CMZJ2IZA6TIPBFBIHA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.746031872 (22h34m56.705129116s) [noise=true , address=104.36.82.39:4742 , piece_id=7FW3XVRSTAVALD7NTPMBKOVJ36LG3NWH3OHFS7UOIGYX3K3IKSSQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.776229699 (22h34m56.735326937s) [noise=true , address=104.36.82.44:4870 , piece_id=TEIXCF2FNSAZ4IRRARFJYQEPT3QOQQBMXZUSPJS7DBQZEIARBY2Q, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.787014388 (22h34m56.746111625s) [noise=true , address=104.36.82.23:4448 , piece_id=KDTLTNNPICWD2PX3NFWLY2QHUVMYKXYYV7XP24KLHZOSMXQURKCQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.787668244 (22h34m56.746765492s) [noise=true , address=104.36.82.47:4541 , piece_id=KDXXIGT4P2IN3XHAEJUPM4F6DVMQ3SGSBS63FH63UOQY5C7OWNNA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.789282572 (22h34m56.748379805s) [noise=true , address=104.36.82.8:4002 , piece_id=3RQ6XX3DDQXXMHLK6HZFM7BSPIL3JCIJY7NSVQ4QZN54I2EZ6VJQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.900294993 (22h34m56.859392238s) [noise=true , address=104.36.82.17:4352 , piece_id=F2O6EREVYG2GYC3VTUVHAILBLANWJ76F7PYZJUAFJPVDSYX2JPEA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.902302726 (22h34m56.861399964s) [noise=true , address=104.36.82.62:4425 , piece_id=PZSMOPLPHJDGB7P4PWZLLVKBJI33UFKJQ4PZDK57AU53WTUKWTXA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.942733789 (22h34m56.901831035s) [noise=true , address=45.91.116.8:4073 , piece_id=KU76CWQ53LJLMBO47YSIR32CB6O6C6V43EJVURAKOQELESNUFWJQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.942767083 (22h34m56.901864328s) [seg_pos={0 0}, upload=23543]: Segment reached optimal threshold of 14 pieces.
Aug 9 16:00:34.942884682 (22h34m56.901981916s) [noise=true , address=64.49.13.138:4492 , piece_id=7SSFGLOAZTPSWKIR4D7N7NRYGLBPA672MKZ5YGW5YSHI3Z6LVLFQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZsJq7Nk214SL9k3jzweiRfUkrFPj5cQP58Gs31ESSKF3qU6KU): protocol: expected piece hash; context canceled; EOF
Aug 9 16:00:34.943178758 (22h34m56.902275997s) [noise=true , address=64.49.13.169:4706 , piece_id=JBODHN3QWGY3RQQBCNNIARWL7N4X4THIIUHFVZY44PE2XE3OH2SQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: write tcp 139.59.144.22:60014->64.49.13.169:4706: use of closed network connection; write tcp 139.59.144.22:60014->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60014->64.49.13.169:4706: use of closed network connection
Aug 9 16:00:34.943236811 (22h34m56.902334051s) [noise=true , address=64.49.13.137:4494 , piece_id=O53BUMXLAFSBSYFQY2PYT3LTU3ZFPHV5WW37QHESKQDJVER5WFBA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:39726->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:39726->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39726->64.49.13.137:4494: use of closed network connection
Aug 9 16:00:34.943290050 (22h34m56.902387285s) [noise=true , address=64.49.13.139:4476 , piece_id=RVIBEQSFQXQ2K6WFEANFMCF4DRLTJOQ4KV2C24JQNYXIX3QYOJKQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oXSqFgqNNvDUaEwcHoEVUuaLukC2zaEfosyoeVLbXN81B3vVY): protocol: write tcp 139.59.144.22:45562->64.49.13.139:4476: use of closed network connection; write tcp 139.59.144.22:45562->64.49.13.139:4476: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45562->64.49.13.139:4476: use of closed network connection
Aug 9 16:00:34.943302043 (22h34m56.902399287s) [seg_pos={0 0}, upload=23543]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 16:00:34.943370914 (22h34m56.90246815s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 16:00:34.943375868 (22h34m56.902473117s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 16:00:35.237750315 (22h34m57.196847552s) [upload=23543]: Done uploading segments...
Aug 9 16:00:35.237770500 (22h34m57.196867739s) [upload=23543]: Upload finished. err: <nil>
Duration: 2.894235301s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X.........X....................X........] duration:
1.497353747s
FAIL (2025-08-09 16:43:50 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:36:56.966978970 (23h11m18.926076206s) [upload=24177]: Starting upload Aug 9 16:36:56.967059760 (23h11m18.926157006s) [upload=24177]: Done starting upload Aug 9 16:36:56.967162967 (23h11m18.926260208s) [upload=24177]: Uploading segments... Aug 9 16:36:56.967229678 (23h11m18.926326928s) [upload=24177]: Got next segment. Inline: true Aug 9 16:36:56.967236881 (23h11m18.926334131s) [upload=24177]: Waiting for error group managing segments... Aug 9 16:36:56.967285047 (23h11m18.926382284s) [upload=24177]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:36:56.967300986 (23h11m18.926398233s) [upload=24177]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:36:56.967304723 (23h11m18.92640196s) [upload=24177]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:36:57.289272456 (23h11m19.248369703s) [upload=24177]: Done uploading segments... Aug 9 16:36:57.289299143 (23h11m19.248396375s) [upload=24177]: Upload finished. err: <nil>
Duration: 1.497380943s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.897996333s
FAIL (2025-08-09 16:43:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0c770d746542180eeb44b807b0cf361cb2cebb81feaf44d855b95bc712452cc0 != before 490082c63b99f51367ea69a3c3b3fb75d05a22676845856a3d3a658e9865059c
======LOGS======
Aug 9 16:00:33.666585872 (22h34m55.625683118s) [upload=23543]: Starting upload
Aug 9 16:00:33.666644051 (22h34m55.625741283s) [upload=23543]: Done starting upload
Aug 9 16:00:33.666974455 (22h34m55.6260717s) [upload=23543]: Uploading segments...
Aug 9 16:00:33.667094876 (22h34m55.626192127s) [upload=23543]: Got next segment. Inline: false
Aug 9 16:00:33.667201917 (22h34m55.626299163s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 16:00:33.667209149 (22h34m55.626306398s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 16:00:33.939074109 (22h34m55.898171365s) [seg_pos={0 0}, upload=23543]: Begin upload segment...
Aug 9 16:00:33.939175451 (22h34m55.898272704s) [seg_pos={0 0}, upload=23543]: Done begin upload segment.
Aug 9 16:00:33.939250028 (22h34m55.898347282s) [noise=true , address=104.36.82.60:4352 , piece_id=KFEGYIYC7EH22DFQLGWW4E2CIGUGFXQ2F3CMZJ2IZA6TIPBFBIHA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.940344092 (22h34m55.89944135s) [noise=true , address=104.36.82.23:4448 , piece_id=KDTLTNNPICWD2PX3NFWLY2QHUVMYKXYYV7XP24KLHZOSMXQURKCQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.941112869 (22h34m55.900210128s) [noise=true , address=104.36.82.45:4930 , piece_id=CFNMEWGQE7CONBMDAD7KDW452NNDFT3KOUG5WD7FAITLIC7XSMSQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.941618841 (22h34m55.900716098s) [noise=true , address=104.36.82.46:4511 , piece_id=FLSJP5FV46MELD4S7HUFS7C3JX4UDBOW5YF7NZ6GNQ3Q4PGKU5SQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.942364679 (22h34m55.901461934s) [noise=true , address=104.36.82.8:4002 , piece_id=3RQ6XX3DDQXXMHLK6HZFM7BSPIL3JCIJY7NSVQ4QZN54I2EZ6VJQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.943542485 (22h34m55.90263974s) [noise=true , address=104.36.82.37:4673 , piece_id=T6LQMDTTFUKDPS55RTEBLK5OHGTIM6AVCCDYEH3VIOY3EIPRGZFA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.944146405 (22h34m55.90324366s) [noise=true , address=64.49.13.138:4492 , piece_id=7SSFGLOAZTPSWKIR4D7N7NRYGLBPA672MKZ5YGW5YSHI3Z6LVLFQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.945658251 (22h34m55.904755505s) [noise=true , address=64.49.13.169:4706 , piece_id=JBODHN3QWGY3RQQBCNNIARWL7N4X4THIIUHFVZY44PE2XE3OH2SQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.946280080 (22h34m55.905377335s) [noise=true , address=104.36.82.17:4352 , piece_id=F2O6EREVYG2GYC3VTUVHAILBLANWJ76F7PYZJUAFJPVDSYX2JPEA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.946770611 (22h34m55.905867866s) [noise=true , address=104.36.82.62:4425 , piece_id=PZSMOPLPHJDGB7P4PWZLLVKBJI33UFKJQ4PZDK57AU53WTUKWTXA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.947369772 (22h34m55.906467027s) [noise=true , address=104.36.82.44:4870 , piece_id=TEIXCF2FNSAZ4IRRARFJYQEPT3QOQQBMXZUSPJS7DBQZEIARBY2Q, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.947969505 (22h34m55.90706676s) [noise=true , address=104.36.82.47:4541 , piece_id=KDXXIGT4P2IN3XHAEJUPM4F6DVMQ3SGSBS63FH63UOQY5C7OWNNA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.948745646 (22h34m55.907842901s) [noise=true , address=45.91.116.8:4073 , piece_id=KU76CWQ53LJLMBO47YSIR32CB6O6C6V43EJVURAKOQELESNUFWJQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.949296863 (22h34m55.908394118s) [noise=true , address=64.49.13.139:4476 , piece_id=RVIBEQSFQXQ2K6WFEANFMCF4DRLTJOQ4KV2C24JQNYXIX3QYOJKQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.949852444 (22h34m55.908949698s) [noise=true , address=64.49.13.137:4494 , piece_id=O53BUMXLAFSBSYFQY2PYT3LTU3ZFPHV5WW37QHESKQDJVER5WFBA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.950493872 (22h34m55.909591127s) [noise=true , address=104.36.82.39:4742 , piece_id=7FW3XVRSTAVALD7NTPMBKOVJ36LG3NWH3OHFS7UOIGYX3K3IKSSQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.951002229 (22h34m55.910099484s) [noise=true , address=45.91.116.12:4228 , piece_id=HFFUHH5H4JLFQJELLUNOKSUS3H56BPVMK33FY2D4CWNVJHRTM6PA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.951575101 (22h34m55.910672357s) [noise=true , address=104.36.82.59:4321 , piece_id=Y2RZBJWIQNR2TKE4BLWCTU3VTCE7QFRZC2DE5UR3JBVCAD6XR3GA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:34.544570816 (22h34m56.503668056s) [upload=23543]: Next returned nil segment
Aug 9 16:00:34.544635633 (22h34m56.503732888s) [upload=23543]: Waiting for error group managing segments...
Aug 9 16:00:34.690215867 (22h34m56.649313113s) [noise=true , address=45.91.116.12:4228 , piece_id=HFFUHH5H4JLFQJELLUNOKSUS3H56BPVMK33FY2D4CWNVJHRTM6PA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.707428704 (22h34m56.666525942s) [noise=true , address=104.36.82.45:4930 , piece_id=CFNMEWGQE7CONBMDAD7KDW452NNDFT3KOUG5WD7FAITLIC7XSMSQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.712368352 (22h34m56.671465604s) [noise=true , address=104.36.82.46:4511 , piece_id=FLSJP5FV46MELD4S7HUFS7C3JX4UDBOW5YF7NZ6GNQ3Q4PGKU5SQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.718078638 (22h34m56.677175877s) [noise=true , address=104.36.82.59:4321 , piece_id=Y2RZBJWIQNR2TKE4BLWCTU3VTCE7QFRZC2DE5UR3JBVCAD6XR3GA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.718567528 (22h34m56.677664774s) [noise=true , address=104.36.82.37:4673 , piece_id=T6LQMDTTFUKDPS55RTEBLK5OHGTIM6AVCCDYEH3VIOY3EIPRGZFA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.723754094 (22h34m56.682851328s) [noise=true , address=104.36.82.60:4352 , piece_id=KFEGYIYC7EH22DFQLGWW4E2CIGUGFXQ2F3CMZJ2IZA6TIPBFBIHA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.746031872 (22h34m56.705129116s) [noise=true , address=104.36.82.39:4742 , piece_id=7FW3XVRSTAVALD7NTPMBKOVJ36LG3NWH3OHFS7UOIGYX3K3IKSSQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.776229699 (22h34m56.735326937s) [noise=true , address=104.36.82.44:4870 , piece_id=TEIXCF2FNSAZ4IRRARFJYQEPT3QOQQBMXZUSPJS7DBQZEIARBY2Q, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.787014388 (22h34m56.746111625s) [noise=true , address=104.36.82.23:4448 , piece_id=KDTLTNNPICWD2PX3NFWLY2QHUVMYKXYYV7XP24KLHZOSMXQURKCQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.787668244 (22h34m56.746765492s) [noise=true , address=104.36.82.47:4541 , piece_id=KDXXIGT4P2IN3XHAEJUPM4F6DVMQ3SGSBS63FH63UOQY5C7OWNNA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.789282572 (22h34m56.748379805s) [noise=true , address=104.36.82.8:4002 , piece_id=3RQ6XX3DDQXXMHLK6HZFM7BSPIL3JCIJY7NSVQ4QZN54I2EZ6VJQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.900294993 (22h34m56.859392238s) [noise=true , address=104.36.82.17:4352 , piece_id=F2O6EREVYG2GYC3VTUVHAILBLANWJ76F7PYZJUAFJPVDSYX2JPEA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.902302726 (22h34m56.861399964s) [noise=true , address=104.36.82.62:4425 , piece_id=PZSMOPLPHJDGB7P4PWZLLVKBJI33UFKJQ4PZDK57AU53WTUKWTXA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.942733789 (22h34m56.901831035s) [noise=true , address=45.91.116.8:4073 , piece_id=KU76CWQ53LJLMBO47YSIR32CB6O6C6V43EJVURAKOQELESNUFWJQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.942767083 (22h34m56.901864328s) [seg_pos={0 0}, upload=23543]: Segment reached optimal threshold of 14 pieces.
Aug 9 16:00:34.942884682 (22h34m56.901981916s) [noise=true , address=64.49.13.138:4492 , piece_id=7SSFGLOAZTPSWKIR4D7N7NRYGLBPA672MKZ5YGW5YSHI3Z6LVLFQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZsJq7Nk214SL9k3jzweiRfUkrFPj5cQP58Gs31ESSKF3qU6KU): protocol: expected piece hash; context canceled; EOF
Aug 9 16:00:34.943178758 (22h34m56.902275997s) [noise=true , address=64.49.13.169:4706 , piece_id=JBODHN3QWGY3RQQBCNNIARWL7N4X4THIIUHFVZY44PE2XE3OH2SQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: write tcp 139.59.144.22:60014->64.49.13.169:4706: use of closed network connection; write tcp 139.59.144.22:60014->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60014->64.49.13.169:4706: use of closed network connection
Aug 9 16:00:34.943236811 (22h34m56.902334051s) [noise=true , address=64.49.13.137:4494 , piece_id=O53BUMXLAFSBSYFQY2PYT3LTU3ZFPHV5WW37QHESKQDJVER5WFBA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:39726->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:39726->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39726->64.49.13.137:4494: use of closed network connection
Aug 9 16:00:34.943290050 (22h34m56.902387285s) [noise=true , address=64.49.13.139:4476 , piece_id=RVIBEQSFQXQ2K6WFEANFMCF4DRLTJOQ4KV2C24JQNYXIX3QYOJKQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oXSqFgqNNvDUaEwcHoEVUuaLukC2zaEfosyoeVLbXN81B3vVY): protocol: write tcp 139.59.144.22:45562->64.49.13.139:4476: use of closed network connection; write tcp 139.59.144.22:45562->64.49.13.139:4476: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45562->64.49.13.139:4476: use of closed network connection
Aug 9 16:00:34.943302043 (22h34m56.902399287s) [seg_pos={0 0}, upload=23543]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 16:00:34.943370914 (22h34m56.90246815s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 16:00:34.943375868 (22h34m56.902473117s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 16:00:35.237750315 (22h34m57.196847552s) [upload=23543]: Done uploading segments...
Aug 9 16:00:35.237770500 (22h34m57.196867739s) [upload=23543]: Upload finished. err: <nil>
Duration: 2.898023581s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
3.555394123s
FAIL (2025-08-09 16:43:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0c770d746542180eeb44b807b0cf361cb2cebb81feaf44d855b95bc712452cc0 != before 490082c63b99f51367ea69a3c3b3fb75d05a22676845856a3d3a658e9865059c
======LOGS======
Aug 9 16:00:33.666585872 (22h34m55.625683118s) [upload=23543]: Starting upload
Aug 9 16:00:33.666644051 (22h34m55.625741283s) [upload=23543]: Done starting upload
Aug 9 16:00:33.666974455 (22h34m55.6260717s) [upload=23543]: Uploading segments...
Aug 9 16:00:33.667094876 (22h34m55.626192127s) [upload=23543]: Got next segment. Inline: false
Aug 9 16:00:33.667201917 (22h34m55.626299163s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 16:00:33.667209149 (22h34m55.626306398s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 16:00:33.939074109 (22h34m55.898171365s) [seg_pos={0 0}, upload=23543]: Begin upload segment...
Aug 9 16:00:33.939175451 (22h34m55.898272704s) [seg_pos={0 0}, upload=23543]: Done begin upload segment.
Aug 9 16:00:33.939250028 (22h34m55.898347282s) [noise=true , address=104.36.82.60:4352 , piece_id=KFEGYIYC7EH22DFQLGWW4E2CIGUGFXQ2F3CMZJ2IZA6TIPBFBIHA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.940344092 (22h34m55.89944135s) [noise=true , address=104.36.82.23:4448 , piece_id=KDTLTNNPICWD2PX3NFWLY2QHUVMYKXYYV7XP24KLHZOSMXQURKCQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.941112869 (22h34m55.900210128s) [noise=true , address=104.36.82.45:4930 , piece_id=CFNMEWGQE7CONBMDAD7KDW452NNDFT3KOUG5WD7FAITLIC7XSMSQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.941618841 (22h34m55.900716098s) [noise=true , address=104.36.82.46:4511 , piece_id=FLSJP5FV46MELD4S7HUFS7C3JX4UDBOW5YF7NZ6GNQ3Q4PGKU5SQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.942364679 (22h34m55.901461934s) [noise=true , address=104.36.82.8:4002 , piece_id=3RQ6XX3DDQXXMHLK6HZFM7BSPIL3JCIJY7NSVQ4QZN54I2EZ6VJQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.943542485 (22h34m55.90263974s) [noise=true , address=104.36.82.37:4673 , piece_id=T6LQMDTTFUKDPS55RTEBLK5OHGTIM6AVCCDYEH3VIOY3EIPRGZFA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.944146405 (22h34m55.90324366s) [noise=true , address=64.49.13.138:4492 , piece_id=7SSFGLOAZTPSWKIR4D7N7NRYGLBPA672MKZ5YGW5YSHI3Z6LVLFQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.945658251 (22h34m55.904755505s) [noise=true , address=64.49.13.169:4706 , piece_id=JBODHN3QWGY3RQQBCNNIARWL7N4X4THIIUHFVZY44PE2XE3OH2SQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.946280080 (22h34m55.905377335s) [noise=true , address=104.36.82.17:4352 , piece_id=F2O6EREVYG2GYC3VTUVHAILBLANWJ76F7PYZJUAFJPVDSYX2JPEA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.946770611 (22h34m55.905867866s) [noise=true , address=104.36.82.62:4425 , piece_id=PZSMOPLPHJDGB7P4PWZLLVKBJI33UFKJQ4PZDK57AU53WTUKWTXA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.947369772 (22h34m55.906467027s) [noise=true , address=104.36.82.44:4870 , piece_id=TEIXCF2FNSAZ4IRRARFJYQEPT3QOQQBMXZUSPJS7DBQZEIARBY2Q, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.947969505 (22h34m55.90706676s) [noise=true , address=104.36.82.47:4541 , piece_id=KDXXIGT4P2IN3XHAEJUPM4F6DVMQ3SGSBS63FH63UOQY5C7OWNNA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.948745646 (22h34m55.907842901s) [noise=true , address=45.91.116.8:4073 , piece_id=KU76CWQ53LJLMBO47YSIR32CB6O6C6V43EJVURAKOQELESNUFWJQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.949296863 (22h34m55.908394118s) [noise=true , address=64.49.13.139:4476 , piece_id=RVIBEQSFQXQ2K6WFEANFMCF4DRLTJOQ4KV2C24JQNYXIX3QYOJKQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.949852444 (22h34m55.908949698s) [noise=true , address=64.49.13.137:4494 , piece_id=O53BUMXLAFSBSYFQY2PYT3LTU3ZFPHV5WW37QHESKQDJVER5WFBA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.950493872 (22h34m55.909591127s) [noise=true , address=104.36.82.39:4742 , piece_id=7FW3XVRSTAVALD7NTPMBKOVJ36LG3NWH3OHFS7UOIGYX3K3IKSSQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.951002229 (22h34m55.910099484s) [noise=true , address=45.91.116.12:4228 , piece_id=HFFUHH5H4JLFQJELLUNOKSUS3H56BPVMK33FY2D4CWNVJHRTM6PA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.951575101 (22h34m55.910672357s) [noise=true , address=104.36.82.59:4321 , piece_id=Y2RZBJWIQNR2TKE4BLWCTU3VTCE7QFRZC2DE5UR3JBVCAD6XR3GA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:34.544570816 (22h34m56.503668056s) [upload=23543]: Next returned nil segment
Aug 9 16:00:34.544635633 (22h34m56.503732888s) [upload=23543]: Waiting for error group managing segments...
Aug 9 16:00:34.690215867 (22h34m56.649313113s) [noise=true , address=45.91.116.12:4228 , piece_id=HFFUHH5H4JLFQJELLUNOKSUS3H56BPVMK33FY2D4CWNVJHRTM6PA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.707428704 (22h34m56.666525942s) [noise=true , address=104.36.82.45:4930 , piece_id=CFNMEWGQE7CONBMDAD7KDW452NNDFT3KOUG5WD7FAITLIC7XSMSQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.712368352 (22h34m56.671465604s) [noise=true , address=104.36.82.46:4511 , piece_id=FLSJP5FV46MELD4S7HUFS7C3JX4UDBOW5YF7NZ6GNQ3Q4PGKU5SQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.718078638 (22h34m56.677175877s) [noise=true , address=104.36.82.59:4321 , piece_id=Y2RZBJWIQNR2TKE4BLWCTU3VTCE7QFRZC2DE5UR3JBVCAD6XR3GA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.718567528 (22h34m56.677664774s) [noise=true , address=104.36.82.37:4673 , piece_id=T6LQMDTTFUKDPS55RTEBLK5OHGTIM6AVCCDYEH3VIOY3EIPRGZFA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.723754094 (22h34m56.682851328s) [noise=true , address=104.36.82.60:4352 , piece_id=KFEGYIYC7EH22DFQLGWW4E2CIGUGFXQ2F3CMZJ2IZA6TIPBFBIHA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.746031872 (22h34m56.705129116s) [noise=true , address=104.36.82.39:4742 , piece_id=7FW3XVRSTAVALD7NTPMBKOVJ36LG3NWH3OHFS7UOIGYX3K3IKSSQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.776229699 (22h34m56.735326937s) [noise=true , address=104.36.82.44:4870 , piece_id=TEIXCF2FNSAZ4IRRARFJYQEPT3QOQQBMXZUSPJS7DBQZEIARBY2Q, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.787014388 (22h34m56.746111625s) [noise=true , address=104.36.82.23:4448 , piece_id=KDTLTNNPICWD2PX3NFWLY2QHUVMYKXYYV7XP24KLHZOSMXQURKCQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.787668244 (22h34m56.746765492s) [noise=true , address=104.36.82.47:4541 , piece_id=KDXXIGT4P2IN3XHAEJUPM4F6DVMQ3SGSBS63FH63UOQY5C7OWNNA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.789282572 (22h34m56.748379805s) [noise=true , address=104.36.82.8:4002 , piece_id=3RQ6XX3DDQXXMHLK6HZFM7BSPIL3JCIJY7NSVQ4QZN54I2EZ6VJQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.900294993 (22h34m56.859392238s) [noise=true , address=104.36.82.17:4352 , piece_id=F2O6EREVYG2GYC3VTUVHAILBLANWJ76F7PYZJUAFJPVDSYX2JPEA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.902302726 (22h34m56.861399964s) [noise=true , address=104.36.82.62:4425 , piece_id=PZSMOPLPHJDGB7P4PWZLLVKBJI33UFKJQ4PZDK57AU53WTUKWTXA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.942733789 (22h34m56.901831035s) [noise=true , address=45.91.116.8:4073 , piece_id=KU76CWQ53LJLMBO47YSIR32CB6O6C6V43EJVURAKOQELESNUFWJQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.942767083 (22h34m56.901864328s) [seg_pos={0 0}, upload=23543]: Segment reached optimal threshold of 14 pieces.
Aug 9 16:00:34.942884682 (22h34m56.901981916s) [noise=true , address=64.49.13.138:4492 , piece_id=7SSFGLOAZTPSWKIR4D7N7NRYGLBPA672MKZ5YGW5YSHI3Z6LVLFQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZsJq7Nk214SL9k3jzweiRfUkrFPj5cQP58Gs31ESSKF3qU6KU): protocol: expected piece hash; context canceled; EOF
Aug 9 16:00:34.943178758 (22h34m56.902275997s) [noise=true , address=64.49.13.169:4706 , piece_id=JBODHN3QWGY3RQQBCNNIARWL7N4X4THIIUHFVZY44PE2XE3OH2SQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: write tcp 139.59.144.22:60014->64.49.13.169:4706: use of closed network connection; write tcp 139.59.144.22:60014->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60014->64.49.13.169:4706: use of closed network connection
Aug 9 16:00:34.943236811 (22h34m56.902334051s) [noise=true , address=64.49.13.137:4494 , piece_id=O53BUMXLAFSBSYFQY2PYT3LTU3ZFPHV5WW37QHESKQDJVER5WFBA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:39726->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:39726->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39726->64.49.13.137:4494: use of closed network connection
Aug 9 16:00:34.943290050 (22h34m56.902387285s) [noise=true , address=64.49.13.139:4476 , piece_id=RVIBEQSFQXQ2K6WFEANFMCF4DRLTJOQ4KV2C24JQNYXIX3QYOJKQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oXSqFgqNNvDUaEwcHoEVUuaLukC2zaEfosyoeVLbXN81B3vVY): protocol: write tcp 139.59.144.22:45562->64.49.13.139:4476: use of closed network connection; write tcp 139.59.144.22:45562->64.49.13.139:4476: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45562->64.49.13.139:4476: use of closed network connection
Aug 9 16:00:34.943302043 (22h34m56.902399287s) [seg_pos={0 0}, upload=23543]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 16:00:34.943370914 (22h34m56.90246815s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 16:00:34.943375868 (22h34m56.902473117s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 16:00:35.237750315 (22h34m57.196847552s) [upload=23543]: Done uploading segments...
Aug 9 16:00:35.237770500 (22h34m57.196867739s) [upload=23543]: Upload finished. err: <nil>
Duration: 3.555419571s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
3.253864444s
FAIL (2025-08-09 16:42:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0c770d746542180eeb44b807b0cf361cb2cebb81feaf44d855b95bc712452cc0 != before 490082c63b99f51367ea69a3c3b3fb75d05a22676845856a3d3a658e9865059c
======LOGS======
Aug 9 16:00:33.666585872 (22h34m55.625683118s) [upload=23543]: Starting upload
Aug 9 16:00:33.666644051 (22h34m55.625741283s) [upload=23543]: Done starting upload
Aug 9 16:00:33.666974455 (22h34m55.6260717s) [upload=23543]: Uploading segments...
Aug 9 16:00:33.667094876 (22h34m55.626192127s) [upload=23543]: Got next segment. Inline: false
Aug 9 16:00:33.667201917 (22h34m55.626299163s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 16:00:33.667209149 (22h34m55.626306398s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 16:00:33.939074109 (22h34m55.898171365s) [seg_pos={0 0}, upload=23543]: Begin upload segment...
Aug 9 16:00:33.939175451 (22h34m55.898272704s) [seg_pos={0 0}, upload=23543]: Done begin upload segment.
Aug 9 16:00:33.939250028 (22h34m55.898347282s) [noise=true , address=104.36.82.60:4352 , piece_id=KFEGYIYC7EH22DFQLGWW4E2CIGUGFXQ2F3CMZJ2IZA6TIPBFBIHA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.940344092 (22h34m55.89944135s) [noise=true , address=104.36.82.23:4448 , piece_id=KDTLTNNPICWD2PX3NFWLY2QHUVMYKXYYV7XP24KLHZOSMXQURKCQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.941112869 (22h34m55.900210128s) [noise=true , address=104.36.82.45:4930 , piece_id=CFNMEWGQE7CONBMDAD7KDW452NNDFT3KOUG5WD7FAITLIC7XSMSQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.941618841 (22h34m55.900716098s) [noise=true , address=104.36.82.46:4511 , piece_id=FLSJP5FV46MELD4S7HUFS7C3JX4UDBOW5YF7NZ6GNQ3Q4PGKU5SQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.942364679 (22h34m55.901461934s) [noise=true , address=104.36.82.8:4002 , piece_id=3RQ6XX3DDQXXMHLK6HZFM7BSPIL3JCIJY7NSVQ4QZN54I2EZ6VJQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.943542485 (22h34m55.90263974s) [noise=true , address=104.36.82.37:4673 , piece_id=T6LQMDTTFUKDPS55RTEBLK5OHGTIM6AVCCDYEH3VIOY3EIPRGZFA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.944146405 (22h34m55.90324366s) [noise=true , address=64.49.13.138:4492 , piece_id=7SSFGLOAZTPSWKIR4D7N7NRYGLBPA672MKZ5YGW5YSHI3Z6LVLFQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.945658251 (22h34m55.904755505s) [noise=true , address=64.49.13.169:4706 , piece_id=JBODHN3QWGY3RQQBCNNIARWL7N4X4THIIUHFVZY44PE2XE3OH2SQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.946280080 (22h34m55.905377335s) [noise=true , address=104.36.82.17:4352 , piece_id=F2O6EREVYG2GYC3VTUVHAILBLANWJ76F7PYZJUAFJPVDSYX2JPEA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.946770611 (22h34m55.905867866s) [noise=true , address=104.36.82.62:4425 , piece_id=PZSMOPLPHJDGB7P4PWZLLVKBJI33UFKJQ4PZDK57AU53WTUKWTXA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.947369772 (22h34m55.906467027s) [noise=true , address=104.36.82.44:4870 , piece_id=TEIXCF2FNSAZ4IRRARFJYQEPT3QOQQBMXZUSPJS7DBQZEIARBY2Q, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.947969505 (22h34m55.90706676s) [noise=true , address=104.36.82.47:4541 , piece_id=KDXXIGT4P2IN3XHAEJUPM4F6DVMQ3SGSBS63FH63UOQY5C7OWNNA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.948745646 (22h34m55.907842901s) [noise=true , address=45.91.116.8:4073 , piece_id=KU76CWQ53LJLMBO47YSIR32CB6O6C6V43EJVURAKOQELESNUFWJQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.949296863 (22h34m55.908394118s) [noise=true , address=64.49.13.139:4476 , piece_id=RVIBEQSFQXQ2K6WFEANFMCF4DRLTJOQ4KV2C24JQNYXIX3QYOJKQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.949852444 (22h34m55.908949698s) [noise=true , address=64.49.13.137:4494 , piece_id=O53BUMXLAFSBSYFQY2PYT3LTU3ZFPHV5WW37QHESKQDJVER5WFBA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.950493872 (22h34m55.909591127s) [noise=true , address=104.36.82.39:4742 , piece_id=7FW3XVRSTAVALD7NTPMBKOVJ36LG3NWH3OHFS7UOIGYX3K3IKSSQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.951002229 (22h34m55.910099484s) [noise=true , address=45.91.116.12:4228 , piece_id=HFFUHH5H4JLFQJELLUNOKSUS3H56BPVMK33FY2D4CWNVJHRTM6PA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.951575101 (22h34m55.910672357s) [noise=true , address=104.36.82.59:4321 , piece_id=Y2RZBJWIQNR2TKE4BLWCTU3VTCE7QFRZC2DE5UR3JBVCAD6XR3GA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:34.544570816 (22h34m56.503668056s) [upload=23543]: Next returned nil segment
Aug 9 16:00:34.544635633 (22h34m56.503732888s) [upload=23543]: Waiting for error group managing segments...
Aug 9 16:00:34.690215867 (22h34m56.649313113s) [noise=true , address=45.91.116.12:4228 , piece_id=HFFUHH5H4JLFQJELLUNOKSUS3H56BPVMK33FY2D4CWNVJHRTM6PA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.707428704 (22h34m56.666525942s) [noise=true , address=104.36.82.45:4930 , piece_id=CFNMEWGQE7CONBMDAD7KDW452NNDFT3KOUG5WD7FAITLIC7XSMSQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.712368352 (22h34m56.671465604s) [noise=true , address=104.36.82.46:4511 , piece_id=FLSJP5FV46MELD4S7HUFS7C3JX4UDBOW5YF7NZ6GNQ3Q4PGKU5SQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.718078638 (22h34m56.677175877s) [noise=true , address=104.36.82.59:4321 , piece_id=Y2RZBJWIQNR2TKE4BLWCTU3VTCE7QFRZC2DE5UR3JBVCAD6XR3GA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.718567528 (22h34m56.677664774s) [noise=true , address=104.36.82.37:4673 , piece_id=T6LQMDTTFUKDPS55RTEBLK5OHGTIM6AVCCDYEH3VIOY3EIPRGZFA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.723754094 (22h34m56.682851328s) [noise=true , address=104.36.82.60:4352 , piece_id=KFEGYIYC7EH22DFQLGWW4E2CIGUGFXQ2F3CMZJ2IZA6TIPBFBIHA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.746031872 (22h34m56.705129116s) [noise=true , address=104.36.82.39:4742 , piece_id=7FW3XVRSTAVALD7NTPMBKOVJ36LG3NWH3OHFS7UOIGYX3K3IKSSQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.776229699 (22h34m56.735326937s) [noise=true , address=104.36.82.44:4870 , piece_id=TEIXCF2FNSAZ4IRRARFJYQEPT3QOQQBMXZUSPJS7DBQZEIARBY2Q, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.787014388 (22h34m56.746111625s) [noise=true , address=104.36.82.23:4448 , piece_id=KDTLTNNPICWD2PX3NFWLY2QHUVMYKXYYV7XP24KLHZOSMXQURKCQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.787668244 (22h34m56.746765492s) [noise=true , address=104.36.82.47:4541 , piece_id=KDXXIGT4P2IN3XHAEJUPM4F6DVMQ3SGSBS63FH63UOQY5C7OWNNA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.789282572 (22h34m56.748379805s) [noise=true , address=104.36.82.8:4002 , piece_id=3RQ6XX3DDQXXMHLK6HZFM7BSPIL3JCIJY7NSVQ4QZN54I2EZ6VJQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.900294993 (22h34m56.859392238s) [noise=true , address=104.36.82.17:4352 , piece_id=F2O6EREVYG2GYC3VTUVHAILBLANWJ76F7PYZJUAFJPVDSYX2JPEA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.902302726 (22h34m56.861399964s) [noise=true , address=104.36.82.62:4425 , piece_id=PZSMOPLPHJDGB7P4PWZLLVKBJI33UFKJQ4PZDK57AU53WTUKWTXA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.942733789 (22h34m56.901831035s) [noise=true , address=45.91.116.8:4073 , piece_id=KU76CWQ53LJLMBO47YSIR32CB6O6C6V43EJVURAKOQELESNUFWJQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.942767083 (22h34m56.901864328s) [seg_pos={0 0}, upload=23543]: Segment reached optimal threshold of 14 pieces.
Aug 9 16:00:34.942884682 (22h34m56.901981916s) [noise=true , address=64.49.13.138:4492 , piece_id=7SSFGLOAZTPSWKIR4D7N7NRYGLBPA672MKZ5YGW5YSHI3Z6LVLFQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZsJq7Nk214SL9k3jzweiRfUkrFPj5cQP58Gs31ESSKF3qU6KU): protocol: expected piece hash; context canceled; EOF
Aug 9 16:00:34.943178758 (22h34m56.902275997s) [noise=true , address=64.49.13.169:4706 , piece_id=JBODHN3QWGY3RQQBCNNIARWL7N4X4THIIUHFVZY44PE2XE3OH2SQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: write tcp 139.59.144.22:60014->64.49.13.169:4706: use of closed network connection; write tcp 139.59.144.22:60014->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60014->64.49.13.169:4706: use of closed network connection
Aug 9 16:00:34.943236811 (22h34m56.902334051s) [noise=true , address=64.49.13.137:4494 , piece_id=O53BUMXLAFSBSYFQY2PYT3LTU3ZFPHV5WW37QHESKQDJVER5WFBA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:39726->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:39726->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39726->64.49.13.137:4494: use of closed network connection
Aug 9 16:00:34.943290050 (22h34m56.902387285s) [noise=true , address=64.49.13.139:4476 , piece_id=RVIBEQSFQXQ2K6WFEANFMCF4DRLTJOQ4KV2C24JQNYXIX3QYOJKQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oXSqFgqNNvDUaEwcHoEVUuaLukC2zaEfosyoeVLbXN81B3vVY): protocol: write tcp 139.59.144.22:45562->64.49.13.139:4476: use of closed network connection; write tcp 139.59.144.22:45562->64.49.13.139:4476: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45562->64.49.13.139:4476: use of closed network connection
Aug 9 16:00:34.943302043 (22h34m56.902399287s) [seg_pos={0 0}, upload=23543]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 16:00:34.943370914 (22h34m56.90246815s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 16:00:34.943375868 (22h34m56.902473117s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 16:00:35.237750315 (22h34m57.196847552s) [upload=23543]: Done uploading segments...
Aug 9 16:00:35.237770500 (22h34m57.196867739s) [upload=23543]: Upload finished. err: <nil>
Duration: 3.253890345s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.........X....................X.......] duration:
941.398771ms
FAIL (2025-08-09 16:42:53 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:36:56.966978970 (23h11m18.926076206s) [upload=24177]: Starting upload Aug 9 16:36:56.967059760 (23h11m18.926157006s) [upload=24177]: Done starting upload Aug 9 16:36:56.967162967 (23h11m18.926260208s) [upload=24177]: Uploading segments... Aug 9 16:36:56.967229678 (23h11m18.926326928s) [upload=24177]: Got next segment. Inline: true Aug 9 16:36:56.967236881 (23h11m18.926334131s) [upload=24177]: Waiting for error group managing segments... Aug 9 16:36:56.967285047 (23h11m18.926382284s) [upload=24177]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:36:56.967300986 (23h11m18.926398233s) [upload=24177]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:36:56.967304723 (23h11m18.92640196s) [upload=24177]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:36:57.289272456 (23h11m19.248369703s) [upload=24177]: Done uploading segments... Aug 9 16:36:57.289299143 (23h11m19.248396375s) [upload=24177]: Upload finished. err: <nil>
Duration: 941.428434ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.957615147s
FAIL (2025-08-09 16:42:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0c770d746542180eeb44b807b0cf361cb2cebb81feaf44d855b95bc712452cc0 != before 490082c63b99f51367ea69a3c3b3fb75d05a22676845856a3d3a658e9865059c
======LOGS======
Aug 9 16:00:33.666585872 (22h34m55.625683118s) [upload=23543]: Starting upload
Aug 9 16:00:33.666644051 (22h34m55.625741283s) [upload=23543]: Done starting upload
Aug 9 16:00:33.666974455 (22h34m55.6260717s) [upload=23543]: Uploading segments...
Aug 9 16:00:33.667094876 (22h34m55.626192127s) [upload=23543]: Got next segment. Inline: false
Aug 9 16:00:33.667201917 (22h34m55.626299163s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 16:00:33.667209149 (22h34m55.626306398s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 16:00:33.939074109 (22h34m55.898171365s) [seg_pos={0 0}, upload=23543]: Begin upload segment...
Aug 9 16:00:33.939175451 (22h34m55.898272704s) [seg_pos={0 0}, upload=23543]: Done begin upload segment.
Aug 9 16:00:33.939250028 (22h34m55.898347282s) [noise=true , address=104.36.82.60:4352 , piece_id=KFEGYIYC7EH22DFQLGWW4E2CIGUGFXQ2F3CMZJ2IZA6TIPBFBIHA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.940344092 (22h34m55.89944135s) [noise=true , address=104.36.82.23:4448 , piece_id=KDTLTNNPICWD2PX3NFWLY2QHUVMYKXYYV7XP24KLHZOSMXQURKCQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.941112869 (22h34m55.900210128s) [noise=true , address=104.36.82.45:4930 , piece_id=CFNMEWGQE7CONBMDAD7KDW452NNDFT3KOUG5WD7FAITLIC7XSMSQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.941618841 (22h34m55.900716098s) [noise=true , address=104.36.82.46:4511 , piece_id=FLSJP5FV46MELD4S7HUFS7C3JX4UDBOW5YF7NZ6GNQ3Q4PGKU5SQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.942364679 (22h34m55.901461934s) [noise=true , address=104.36.82.8:4002 , piece_id=3RQ6XX3DDQXXMHLK6HZFM7BSPIL3JCIJY7NSVQ4QZN54I2EZ6VJQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.943542485 (22h34m55.90263974s) [noise=true , address=104.36.82.37:4673 , piece_id=T6LQMDTTFUKDPS55RTEBLK5OHGTIM6AVCCDYEH3VIOY3EIPRGZFA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.944146405 (22h34m55.90324366s) [noise=true , address=64.49.13.138:4492 , piece_id=7SSFGLOAZTPSWKIR4D7N7NRYGLBPA672MKZ5YGW5YSHI3Z6LVLFQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.945658251 (22h34m55.904755505s) [noise=true , address=64.49.13.169:4706 , piece_id=JBODHN3QWGY3RQQBCNNIARWL7N4X4THIIUHFVZY44PE2XE3OH2SQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.946280080 (22h34m55.905377335s) [noise=true , address=104.36.82.17:4352 , piece_id=F2O6EREVYG2GYC3VTUVHAILBLANWJ76F7PYZJUAFJPVDSYX2JPEA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.946770611 (22h34m55.905867866s) [noise=true , address=104.36.82.62:4425 , piece_id=PZSMOPLPHJDGB7P4PWZLLVKBJI33UFKJQ4PZDK57AU53WTUKWTXA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.947369772 (22h34m55.906467027s) [noise=true , address=104.36.82.44:4870 , piece_id=TEIXCF2FNSAZ4IRRARFJYQEPT3QOQQBMXZUSPJS7DBQZEIARBY2Q, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.947969505 (22h34m55.90706676s) [noise=true , address=104.36.82.47:4541 , piece_id=KDXXIGT4P2IN3XHAEJUPM4F6DVMQ3SGSBS63FH63UOQY5C7OWNNA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.948745646 (22h34m55.907842901s) [noise=true , address=45.91.116.8:4073 , piece_id=KU76CWQ53LJLMBO47YSIR32CB6O6C6V43EJVURAKOQELESNUFWJQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.949296863 (22h34m55.908394118s) [noise=true , address=64.49.13.139:4476 , piece_id=RVIBEQSFQXQ2K6WFEANFMCF4DRLTJOQ4KV2C24JQNYXIX3QYOJKQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.949852444 (22h34m55.908949698s) [noise=true , address=64.49.13.137:4494 , piece_id=O53BUMXLAFSBSYFQY2PYT3LTU3ZFPHV5WW37QHESKQDJVER5WFBA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.950493872 (22h34m55.909591127s) [noise=true , address=104.36.82.39:4742 , piece_id=7FW3XVRSTAVALD7NTPMBKOVJ36LG3NWH3OHFS7UOIGYX3K3IKSSQ, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.951002229 (22h34m55.910099484s) [noise=true , address=45.91.116.12:4228 , piece_id=HFFUHH5H4JLFQJELLUNOKSUS3H56BPVMK33FY2D4CWNVJHRTM6PA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:33.951575101 (22h34m55.910672357s) [noise=true , address=104.36.82.59:4321 , piece_id=Y2RZBJWIQNR2TKE4BLWCTU3VTCE7QFRZC2DE5UR3JBVCAD6XR3GA, seg_pos={0 0}, upload=23543]: Uploading piece...
Aug 9 16:00:34.544570816 (22h34m56.503668056s) [upload=23543]: Next returned nil segment
Aug 9 16:00:34.544635633 (22h34m56.503732888s) [upload=23543]: Waiting for error group managing segments...
Aug 9 16:00:34.690215867 (22h34m56.649313113s) [noise=true , address=45.91.116.12:4228 , piece_id=HFFUHH5H4JLFQJELLUNOKSUS3H56BPVMK33FY2D4CWNVJHRTM6PA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.707428704 (22h34m56.666525942s) [noise=true , address=104.36.82.45:4930 , piece_id=CFNMEWGQE7CONBMDAD7KDW452NNDFT3KOUG5WD7FAITLIC7XSMSQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.712368352 (22h34m56.671465604s) [noise=true , address=104.36.82.46:4511 , piece_id=FLSJP5FV46MELD4S7HUFS7C3JX4UDBOW5YF7NZ6GNQ3Q4PGKU5SQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.718078638 (22h34m56.677175877s) [noise=true , address=104.36.82.59:4321 , piece_id=Y2RZBJWIQNR2TKE4BLWCTU3VTCE7QFRZC2DE5UR3JBVCAD6XR3GA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.718567528 (22h34m56.677664774s) [noise=true , address=104.36.82.37:4673 , piece_id=T6LQMDTTFUKDPS55RTEBLK5OHGTIM6AVCCDYEH3VIOY3EIPRGZFA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.723754094 (22h34m56.682851328s) [noise=true , address=104.36.82.60:4352 , piece_id=KFEGYIYC7EH22DFQLGWW4E2CIGUGFXQ2F3CMZJ2IZA6TIPBFBIHA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.746031872 (22h34m56.705129116s) [noise=true , address=104.36.82.39:4742 , piece_id=7FW3XVRSTAVALD7NTPMBKOVJ36LG3NWH3OHFS7UOIGYX3K3IKSSQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.776229699 (22h34m56.735326937s) [noise=true , address=104.36.82.44:4870 , piece_id=TEIXCF2FNSAZ4IRRARFJYQEPT3QOQQBMXZUSPJS7DBQZEIARBY2Q, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.787014388 (22h34m56.746111625s) [noise=true , address=104.36.82.23:4448 , piece_id=KDTLTNNPICWD2PX3NFWLY2QHUVMYKXYYV7XP24KLHZOSMXQURKCQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.787668244 (22h34m56.746765492s) [noise=true , address=104.36.82.47:4541 , piece_id=KDXXIGT4P2IN3XHAEJUPM4F6DVMQ3SGSBS63FH63UOQY5C7OWNNA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.789282572 (22h34m56.748379805s) [noise=true , address=104.36.82.8:4002 , piece_id=3RQ6XX3DDQXXMHLK6HZFM7BSPIL3JCIJY7NSVQ4QZN54I2EZ6VJQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.900294993 (22h34m56.859392238s) [noise=true , address=104.36.82.17:4352 , piece_id=F2O6EREVYG2GYC3VTUVHAILBLANWJ76F7PYZJUAFJPVDSYX2JPEA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.902302726 (22h34m56.861399964s) [noise=true , address=104.36.82.62:4425 , piece_id=PZSMOPLPHJDGB7P4PWZLLVKBJI33UFKJQ4PZDK57AU53WTUKWTXA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.942733789 (22h34m56.901831035s) [noise=true , address=45.91.116.8:4073 , piece_id=KU76CWQ53LJLMBO47YSIR32CB6O6C6V43EJVURAKOQELESNUFWJQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: <nil>
Aug 9 16:00:34.942767083 (22h34m56.901864328s) [seg_pos={0 0}, upload=23543]: Segment reached optimal threshold of 14 pieces.
Aug 9 16:00:34.942884682 (22h34m56.901981916s) [noise=true , address=64.49.13.138:4492 , piece_id=7SSFGLOAZTPSWKIR4D7N7NRYGLBPA672MKZ5YGW5YSHI3Z6LVLFQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZsJq7Nk214SL9k3jzweiRfUkrFPj5cQP58Gs31ESSKF3qU6KU): protocol: expected piece hash; context canceled; EOF
Aug 9 16:00:34.943178758 (22h34m56.902275997s) [noise=true , address=64.49.13.169:4706 , piece_id=JBODHN3QWGY3RQQBCNNIARWL7N4X4THIIUHFVZY44PE2XE3OH2SQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: write tcp 139.59.144.22:60014->64.49.13.169:4706: use of closed network connection; write tcp 139.59.144.22:60014->64.49.13.169:4706: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60014->64.49.13.169:4706: use of closed network connection
Aug 9 16:00:34.943236811 (22h34m56.902334051s) [noise=true , address=64.49.13.137:4494 , piece_id=O53BUMXLAFSBSYFQY2PYT3LTU3ZFPHV5WW37QHESKQDJVER5WFBA, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TX66fDVv3qu4yBGx9FNZTiArNeUnqxjMYwb3VGqYCQRe8RwoU): protocol: write tcp 139.59.144.22:39726->64.49.13.137:4494: use of closed network connection; write tcp 139.59.144.22:39726->64.49.13.137:4494: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39726->64.49.13.137:4494: use of closed network connection
Aug 9 16:00:34.943290050 (22h34m56.902387285s) [noise=true , address=64.49.13.139:4476 , piece_id=RVIBEQSFQXQ2K6WFEANFMCF4DRLTJOQ4KV2C24JQNYXIX3QYOJKQ, seg_pos={0 0}, upload=23543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oXSqFgqNNvDUaEwcHoEVUuaLukC2zaEfosyoeVLbXN81B3vVY): protocol: write tcp 139.59.144.22:45562->64.49.13.139:4476: use of closed network connection; write tcp 139.59.144.22:45562->64.49.13.139:4476: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45562->64.49.13.139:4476: use of closed network connection
Aug 9 16:00:34.943302043 (22h34m56.902399287s) [seg_pos={0 0}, upload=23543]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 16:00:34.943370914 (22h34m56.90246815s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 16:00:34.943375868 (22h34m56.902473117s) [upload=23543]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 16:00:35.237750315 (22h34m57.196847552s) [upload=23543]: Done uploading segments...
Aug 9 16:00:35.237770500 (22h34m57.196867739s) [upload=23543]: Upload finished. err: <nil>
Duration: 2.95764415s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X.........X....................X......] duration:
1.033633317s
FAIL (2025-08-09 16:42:03 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 16:36:56.966978970 (23h11m18.926076206s) [upload=24177]: Starting upload Aug 9 16:36:56.967059760 (23h11m18.926157006s) [upload=24177]: Done starting upload Aug 9 16:36:56.967162967 (23h11m18.926260208s) [upload=24177]: Uploading segments... Aug 9 16:36:56.967229678 (23h11m18.926326928s) [upload=24177]: Got next segment. Inline: true Aug 9 16:36:56.967236881 (23h11m18.926334131s) [upload=24177]: Waiting for error group managing segments... Aug 9 16:36:56.967285047 (23h11m18.926382284s) [upload=24177]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 16:36:56.967300986 (23h11m18.926398233s) [upload=24177]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 16:36:56.967304723 (23h11m18.92640196s) [upload=24177]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 16:36:57.289272456 (23h11m19.248369703s) [upload=24177]: Done uploading segments... Aug 9 16:36:57.289299143 (23h11m19.248396375s) [upload=24177]: Upload finished. err: <nil>
Duration: 1.033661502s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|