Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [................X......X........X..X........................] duration:
2.536976345s
FAIL (2025-08-14 12:56:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.537065619s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X.............X...] duration:
837.772374ms
FAIL (2025-08-14 12:55:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d00272ca343311a0fdcc083c58629cb5770427982a93c1ae4b12a1f40cfc2633 != before 3409db02365fa4f61d5d1a092f1264b7baf68019937646ebeb43fc1067cd63ef ======LOGS====== Aug 14 12:53:50.225042876 (139h28m12.184140112s) [upload=145261]: Starting upload Aug 14 12:53:50.225095637 (139h28m12.184192874s) [upload=145261]: Done starting upload Aug 14 12:53:50.225202466 (139h28m12.184299714s) [upload=145261]: Uploading segments... Aug 14 12:53:50.225280873 (139h28m12.184378127s) [upload=145261]: Got next segment. Inline: true Aug 14 12:53:50.225287805 (139h28m12.18438505s) [upload=145261]: Waiting for error group managing segments... Aug 14 12:53:50.225353471 (139h28m12.184450717s) [upload=145261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:53:50.225358991 (139h28m12.184456236s) [upload=145261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 12:53:50.225362782 (139h28m12.184460017s) [upload=145261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 12:53:50.562169501 (139h28m12.521266748s) [upload=145261]: Done uploading segments... Aug 14 12:53:50.562195048 (139h28m12.521292296s) [upload=145261]: Upload finished. err: <nil>
Duration: 837.81095ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................X......X........X..X.......................] duration:
2.46845793s
FAIL (2025-08-14 12:55:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.468496282s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................X......X........X..X......................] duration:
2.559189693s
FAIL (2025-08-14 12:54:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.559226274s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X.............X..] duration:
848.854152ms
FAIL (2025-08-14 12:54:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d00272ca343311a0fdcc083c58629cb5770427982a93c1ae4b12a1f40cfc2633 != before 3409db02365fa4f61d5d1a092f1264b7baf68019937646ebeb43fc1067cd63ef ======LOGS====== Aug 14 12:53:50.225042876 (139h28m12.184140112s) [upload=145261]: Starting upload Aug 14 12:53:50.225095637 (139h28m12.184192874s) [upload=145261]: Done starting upload Aug 14 12:53:50.225202466 (139h28m12.184299714s) [upload=145261]: Uploading segments... Aug 14 12:53:50.225280873 (139h28m12.184378127s) [upload=145261]: Got next segment. Inline: true Aug 14 12:53:50.225287805 (139h28m12.18438505s) [upload=145261]: Waiting for error group managing segments... Aug 14 12:53:50.225353471 (139h28m12.184450717s) [upload=145261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:53:50.225358991 (139h28m12.184456236s) [upload=145261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 12:53:50.225362782 (139h28m12.184460017s) [upload=145261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 12:53:50.562169501 (139h28m12.521266748s) [upload=145261]: Done uploading segments... Aug 14 12:53:50.562195048 (139h28m12.521292296s) [upload=145261]: Upload finished. err: <nil>
Duration: 848.88238ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................................X.............X.] duration:
873.858401ms
FAIL (2025-08-14 12:54:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d00272ca343311a0fdcc083c58629cb5770427982a93c1ae4b12a1f40cfc2633 != before 3409db02365fa4f61d5d1a092f1264b7baf68019937646ebeb43fc1067cd63ef ======LOGS====== Aug 14 12:53:50.225042876 (139h28m12.184140112s) [upload=145261]: Starting upload Aug 14 12:53:50.225095637 (139h28m12.184192874s) [upload=145261]: Done starting upload Aug 14 12:53:50.225202466 (139h28m12.184299714s) [upload=145261]: Uploading segments... Aug 14 12:53:50.225280873 (139h28m12.184378127s) [upload=145261]: Got next segment. Inline: true Aug 14 12:53:50.225287805 (139h28m12.18438505s) [upload=145261]: Waiting for error group managing segments... Aug 14 12:53:50.225353471 (139h28m12.184450717s) [upload=145261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:53:50.225358991 (139h28m12.184456236s) [upload=145261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 12:53:50.225362782 (139h28m12.184460017s) [upload=145261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 12:53:50.562169501 (139h28m12.521266748s) [upload=145261]: Done uploading segments... Aug 14 12:53:50.562195048 (139h28m12.521292296s) [upload=145261]: Upload finished. err: <nil>
Duration: 873.895846ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...................X......X........X..X.....................] duration:
2.649395832s
FAIL (2025-08-14 12:53:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.649428772s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X.............X] duration:
939.772872ms
FAIL (2025-08-14 12:53:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d00272ca343311a0fdcc083c58629cb5770427982a93c1ae4b12a1f40cfc2633 != before 3409db02365fa4f61d5d1a092f1264b7baf68019937646ebeb43fc1067cd63ef ======LOGS====== Aug 14 12:53:50.225042876 (139h28m12.184140112s) [upload=145261]: Starting upload Aug 14 12:53:50.225095637 (139h28m12.184192874s) [upload=145261]: Done starting upload Aug 14 12:53:50.225202466 (139h28m12.184299714s) [upload=145261]: Uploading segments... Aug 14 12:53:50.225280873 (139h28m12.184378127s) [upload=145261]: Got next segment. Inline: true Aug 14 12:53:50.225287805 (139h28m12.18438505s) [upload=145261]: Waiting for error group managing segments... Aug 14 12:53:50.225353471 (139h28m12.184450717s) [upload=145261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:53:50.225358991 (139h28m12.184456236s) [upload=145261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 12:53:50.225362782 (139h28m12.184460017s) [upload=145261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 12:53:50.562169501 (139h28m12.521266748s) [upload=145261]: Done uploading segments... Aug 14 12:53:50.562195048 (139h28m12.521292296s) [upload=145261]: Upload finished. err: <nil>
Duration: 939.806777ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
923.741064ms
FAIL (2025-08-14 12:53:10 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 12:42:08.048532682 (139h16m30.007629939s) [upload=145065]: Starting upload Aug 14 12:42:08.048636646 (139h16m30.007733895s) [upload=145065]: Done starting upload Aug 14 12:42:08.048737930 (139h16m30.007835166s) [upload=145065]: Uploading segments... Aug 14 12:42:08.048813564 (139h16m30.00791082s) [upload=145065]: Got next segment. Inline: true Aug 14 12:42:08.048821091 (139h16m30.007918355s) [upload=145065]: Waiting for error group managing segments... Aug 14 12:42:08.048900113 (139h16m30.00799739s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:42:08.048922763 (139h16m30.008020013s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 12:42:08.048927275 (139h16m30.008024526s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 12:42:08.227749538 (139h16m30.186846784s) [upload=145065]: Done uploading segments... Aug 14 12:42:08.227769905 (139h16m30.186867141s) [upload=145065]: Upload finished. err: <nil>
Duration: 923.895656ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....................X......X........X..X....................] duration:
2.647547987s
FAIL (2025-08-14 12:53:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.647599395s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
888.765767ms
FAIL (2025-08-14 12:51:58 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 12:42:08.048532682 (139h16m30.007629939s) [upload=145065]: Starting upload Aug 14 12:42:08.048636646 (139h16m30.007733895s) [upload=145065]: Done starting upload Aug 14 12:42:08.048737930 (139h16m30.007835166s) [upload=145065]: Uploading segments... Aug 14 12:42:08.048813564 (139h16m30.00791082s) [upload=145065]: Got next segment. Inline: true Aug 14 12:42:08.048821091 (139h16m30.007918355s) [upload=145065]: Waiting for error group managing segments... Aug 14 12:42:08.048900113 (139h16m30.00799739s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:42:08.048922763 (139h16m30.008020013s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 12:42:08.048927275 (139h16m30.008024526s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 12:42:08.227749538 (139h16m30.186846784s) [upload=145065]: Done uploading segments... Aug 14 12:42:08.227769905 (139h16m30.186867141s) [upload=145065]: Upload finished. err: <nil>
Duration: 888.795757ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....................X......X........X..X...................] duration:
2.531215793s
FAIL (2025-08-14 12:51:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.531263341s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
871.804561ms
FAIL (2025-08-14 12:51:37 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 12:42:08.048532682 (139h16m30.007629939s) [upload=145065]: Starting upload Aug 14 12:42:08.048636646 (139h16m30.007733895s) [upload=145065]: Done starting upload Aug 14 12:42:08.048737930 (139h16m30.007835166s) [upload=145065]: Uploading segments... Aug 14 12:42:08.048813564 (139h16m30.00791082s) [upload=145065]: Got next segment. Inline: true Aug 14 12:42:08.048821091 (139h16m30.007918355s) [upload=145065]: Waiting for error group managing segments... Aug 14 12:42:08.048900113 (139h16m30.00799739s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:42:08.048922763 (139h16m30.008020013s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 12:42:08.048927275 (139h16m30.008024526s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 12:42:08.227749538 (139h16m30.186846784s) [upload=145065]: Done uploading segments... Aug 14 12:42:08.227769905 (139h16m30.186867141s) [upload=145065]: Upload finished. err: <nil>
Duration: 871.833421ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......................X......X........X..X..................] duration:
2.417340828s
FAIL (2025-08-14 12:51:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.41737323s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
946.636572ms
FAIL (2025-08-14 12:51:14 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 12:42:08.048532682 (139h16m30.007629939s) [upload=145065]: Starting upload Aug 14 12:42:08.048636646 (139h16m30.007733895s) [upload=145065]: Done starting upload Aug 14 12:42:08.048737930 (139h16m30.007835166s) [upload=145065]: Uploading segments... Aug 14 12:42:08.048813564 (139h16m30.00791082s) [upload=145065]: Got next segment. Inline: true Aug 14 12:42:08.048821091 (139h16m30.007918355s) [upload=145065]: Waiting for error group managing segments... Aug 14 12:42:08.048900113 (139h16m30.00799739s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:42:08.048922763 (139h16m30.008020013s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 12:42:08.048927275 (139h16m30.008024526s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 12:42:08.227749538 (139h16m30.186846784s) [upload=145065]: Done uploading segments... Aug 14 12:42:08.227769905 (139h16m30.186867141s) [upload=145065]: Upload finished. err: <nil>
Duration: 946.671714ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......................X......X........X..X.................] duration:
2.377108802s
FAIL (2025-08-14 12:50:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.377145758s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
884.110508ms
FAIL (2025-08-14 12:50:27 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 12:42:08.048532682 (139h16m30.007629939s) [upload=145065]: Starting upload Aug 14 12:42:08.048636646 (139h16m30.007733895s) [upload=145065]: Done starting upload Aug 14 12:42:08.048737930 (139h16m30.007835166s) [upload=145065]: Uploading segments... Aug 14 12:42:08.048813564 (139h16m30.00791082s) [upload=145065]: Got next segment. Inline: true Aug 14 12:42:08.048821091 (139h16m30.007918355s) [upload=145065]: Waiting for error group managing segments... Aug 14 12:42:08.048900113 (139h16m30.00799739s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:42:08.048922763 (139h16m30.008020013s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 12:42:08.048927275 (139h16m30.008024526s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 12:42:08.227749538 (139h16m30.186846784s) [upload=145065]: Done uploading segments... Aug 14 12:42:08.227769905 (139h16m30.186867141s) [upload=145065]: Upload finished. err: <nil>
Duration: 884.217456ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........................X......X........X..X................] duration:
2.476523316s
FAIL (2025-08-14 12:49:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.476553111s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
846.283968ms
FAIL (2025-08-14 12:49:17 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 12:42:08.048532682 (139h16m30.007629939s) [upload=145065]: Starting upload Aug 14 12:42:08.048636646 (139h16m30.007733895s) [upload=145065]: Done starting upload Aug 14 12:42:08.048737930 (139h16m30.007835166s) [upload=145065]: Uploading segments... Aug 14 12:42:08.048813564 (139h16m30.00791082s) [upload=145065]: Got next segment. Inline: true Aug 14 12:42:08.048821091 (139h16m30.007918355s) [upload=145065]: Waiting for error group managing segments... Aug 14 12:42:08.048900113 (139h16m30.00799739s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:42:08.048922763 (139h16m30.008020013s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 12:42:08.048927275 (139h16m30.008024526s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 12:42:08.227749538 (139h16m30.186846784s) [upload=145065]: Done uploading segments... Aug 14 12:42:08.227769905 (139h16m30.186867141s) [upload=145065]: Upload finished. err: <nil>
Duration: 846.319974ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........................X......X........X..X...............] duration:
2.402223136s
FAIL (2025-08-14 12:48:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.402286799s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
931.299351ms
FAIL (2025-08-14 12:48:16 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 12:42:08.048532682 (139h16m30.007629939s) [upload=145065]: Starting upload Aug 14 12:42:08.048636646 (139h16m30.007733895s) [upload=145065]: Done starting upload Aug 14 12:42:08.048737930 (139h16m30.007835166s) [upload=145065]: Uploading segments... Aug 14 12:42:08.048813564 (139h16m30.00791082s) [upload=145065]: Got next segment. Inline: true Aug 14 12:42:08.048821091 (139h16m30.007918355s) [upload=145065]: Waiting for error group managing segments... Aug 14 12:42:08.048900113 (139h16m30.00799739s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:42:08.048922763 (139h16m30.008020013s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 12:42:08.048927275 (139h16m30.008024526s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 12:42:08.227749538 (139h16m30.186846784s) [upload=145065]: Done uploading segments... Aug 14 12:42:08.227769905 (139h16m30.186867141s) [upload=145065]: Upload finished. err: <nil>
Duration: 931.330292ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........................X......X........X..X..............] duration:
2.660212669s
FAIL (2025-08-14 12:47:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.660245928s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
848.766202ms
FAIL (2025-08-14 12:47:46 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 12:42:08.048532682 (139h16m30.007629939s) [upload=145065]: Starting upload Aug 14 12:42:08.048636646 (139h16m30.007733895s) [upload=145065]: Done starting upload Aug 14 12:42:08.048737930 (139h16m30.007835166s) [upload=145065]: Uploading segments... Aug 14 12:42:08.048813564 (139h16m30.00791082s) [upload=145065]: Got next segment. Inline: true Aug 14 12:42:08.048821091 (139h16m30.007918355s) [upload=145065]: Waiting for error group managing segments... Aug 14 12:42:08.048900113 (139h16m30.00799739s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:42:08.048922763 (139h16m30.008020013s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 12:42:08.048927275 (139h16m30.008024526s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 12:42:08.227749538 (139h16m30.186846784s) [upload=145065]: Done uploading segments... Aug 14 12:42:08.227769905 (139h16m30.186867141s) [upload=145065]: Upload finished. err: <nil>
Duration: 848.801824ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........................X......X........X..X.............] duration:
2.528262283s
FAIL (2025-08-14 12:47:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.52830479s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
841.645522ms
FAIL (2025-08-14 12:46:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 12:42:08.048532682 (139h16m30.007629939s) [upload=145065]: Starting upload Aug 14 12:42:08.048636646 (139h16m30.007733895s) [upload=145065]: Done starting upload Aug 14 12:42:08.048737930 (139h16m30.007835166s) [upload=145065]: Uploading segments... Aug 14 12:42:08.048813564 (139h16m30.00791082s) [upload=145065]: Got next segment. Inline: true Aug 14 12:42:08.048821091 (139h16m30.007918355s) [upload=145065]: Waiting for error group managing segments... Aug 14 12:42:08.048900113 (139h16m30.00799739s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:42:08.048922763 (139h16m30.008020013s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 12:42:08.048927275 (139h16m30.008024526s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 12:42:08.227749538 (139h16m30.186846784s) [upload=145065]: Done uploading segments... Aug 14 12:42:08.227769905 (139h16m30.186867141s) [upload=145065]: Upload finished. err: <nil>
Duration: 841.718361ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [............................X......X........X..X............] duration:
2.440046568s
FAIL (2025-08-14 12:46:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.440081278s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.............................X......X........X..X...........] duration:
2.4186673s
FAIL (2025-08-14 12:45:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.418705388s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
910.583084ms
FAIL (2025-08-14 12:45:43 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 12:42:08.048532682 (139h16m30.007629939s) [upload=145065]: Starting upload Aug 14 12:42:08.048636646 (139h16m30.007733895s) [upload=145065]: Done starting upload Aug 14 12:42:08.048737930 (139h16m30.007835166s) [upload=145065]: Uploading segments... Aug 14 12:42:08.048813564 (139h16m30.00791082s) [upload=145065]: Got next segment. Inline: true Aug 14 12:42:08.048821091 (139h16m30.007918355s) [upload=145065]: Waiting for error group managing segments... Aug 14 12:42:08.048900113 (139h16m30.00799739s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:42:08.048922763 (139h16m30.008020013s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 12:42:08.048927275 (139h16m30.008024526s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 12:42:08.227749538 (139h16m30.186846784s) [upload=145065]: Done uploading segments... Aug 14 12:42:08.227769905 (139h16m30.186867141s) [upload=145065]: Upload finished. err: <nil>
Duration: 910.628556ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..............................X......X........X..X..........] duration:
2.388319822s
FAIL (2025-08-14 12:44:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.388360602s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
853.8506ms
FAIL (2025-08-14 12:44:31 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 12:42:08.048532682 (139h16m30.007629939s) [upload=145065]: Starting upload Aug 14 12:42:08.048636646 (139h16m30.007733895s) [upload=145065]: Done starting upload Aug 14 12:42:08.048737930 (139h16m30.007835166s) [upload=145065]: Uploading segments... Aug 14 12:42:08.048813564 (139h16m30.00791082s) [upload=145065]: Got next segment. Inline: true Aug 14 12:42:08.048821091 (139h16m30.007918355s) [upload=145065]: Waiting for error group managing segments... Aug 14 12:42:08.048900113 (139h16m30.00799739s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:42:08.048922763 (139h16m30.008020013s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 12:42:08.048927275 (139h16m30.008024526s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 12:42:08.227749538 (139h16m30.186846784s) [upload=145065]: Done uploading segments... Aug 14 12:42:08.227769905 (139h16m30.186867141s) [upload=145065]: Upload finished. err: <nil>
Duration: 853.898684ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............................X......X........X..X.........] duration:
2.436958685s
FAIL (2025-08-14 12:43:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.437000839s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
873.070009ms
FAIL (2025-08-14 12:43:42 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 12:42:08.048532682 (139h16m30.007629939s) [upload=145065]: Starting upload Aug 14 12:42:08.048636646 (139h16m30.007733895s) [upload=145065]: Done starting upload Aug 14 12:42:08.048737930 (139h16m30.007835166s) [upload=145065]: Uploading segments... Aug 14 12:42:08.048813564 (139h16m30.00791082s) [upload=145065]: Got next segment. Inline: true Aug 14 12:42:08.048821091 (139h16m30.007918355s) [upload=145065]: Waiting for error group managing segments... Aug 14 12:42:08.048900113 (139h16m30.00799739s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:42:08.048922763 (139h16m30.008020013s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 12:42:08.048927275 (139h16m30.008024526s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 12:42:08.227749538 (139h16m30.186846784s) [upload=145065]: Done uploading segments... Aug 14 12:42:08.227769905 (139h16m30.186867141s) [upload=145065]: Upload finished. err: <nil>
Duration: 873.10155ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
861.144015ms
FAIL (2025-08-14 12:43:17 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 12:42:08.048532682 (139h16m30.007629939s) [upload=145065]: Starting upload Aug 14 12:42:08.048636646 (139h16m30.007733895s) [upload=145065]: Done starting upload Aug 14 12:42:08.048737930 (139h16m30.007835166s) [upload=145065]: Uploading segments... Aug 14 12:42:08.048813564 (139h16m30.00791082s) [upload=145065]: Got next segment. Inline: true Aug 14 12:42:08.048821091 (139h16m30.007918355s) [upload=145065]: Waiting for error group managing segments... Aug 14 12:42:08.048900113 (139h16m30.00799739s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:42:08.048922763 (139h16m30.008020013s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 12:42:08.048927275 (139h16m30.008024526s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 12:42:08.227749538 (139h16m30.186846784s) [upload=145065]: Done uploading segments... Aug 14 12:42:08.227769905 (139h16m30.186867141s) [upload=145065]: Upload finished. err: <nil>
Duration: 861.231313ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [................................X......X........X..X........] duration:
2.54140476s
FAIL (2025-08-14 12:43:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.541443107s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
673.534672ms
FAIL (2025-08-14 12:42:08 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 12:42:08.048532682 (139h16m30.007629939s) [upload=145065]: Starting upload Aug 14 12:42:08.048636646 (139h16m30.007733895s) [upload=145065]: Done starting upload Aug 14 12:42:08.048737930 (139h16m30.007835166s) [upload=145065]: Uploading segments... Aug 14 12:42:08.048813564 (139h16m30.00791082s) [upload=145065]: Got next segment. Inline: true Aug 14 12:42:08.048821091 (139h16m30.007918355s) [upload=145065]: Waiting for error group managing segments... Aug 14 12:42:08.048900113 (139h16m30.00799739s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:42:08.048922763 (139h16m30.008020013s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 12:42:08.048927275 (139h16m30.008024526s) [upload=145065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 12:42:08.227749538 (139h16m30.186846784s) [upload=145065]: Done uploading segments... Aug 14 12:42:08.227769905 (139h16m30.186867141s) [upload=145065]: Upload finished. err: <nil>
Duration: 673.560899ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................................X......X........X..X.......] duration:
2.458142005s
FAIL (2025-08-14 12:42:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.458207521s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................................X......X........X..X......] duration:
2.492826109s
FAIL (2025-08-14 12:41:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.492864277s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...................................X......X........X..X.....] duration:
2.468258147s
FAIL (2025-08-14 12:40:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.468291403s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....................................X......X........X..X....] duration:
2.46588115s
FAIL (2025-08-14 12:39:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.465914506s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....................................X......X........X..X...] duration:
2.548514228s
FAIL (2025-08-14 12:38:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.54860161s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......................................X......X........X..X..] duration:
2.497644964s
FAIL (2025-08-14 12:38:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.497692883s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X......................................X......X........X..X.] duration:
2.508760193s
FAIL (2025-08-14 12:37:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.50902448s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X......................................X......X........X..X] duration:
398.775188ms
FAIL (2025-08-14 12:36:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:36:36.008856816 (139h10m57.967954061s) [upload=144965]: Starting upload Aug 14 12:36:36.008944400 (139h10m57.968041638s) [upload=144965]: Done starting upload Aug 14 12:36:36.009103002 (139h10m57.968200237s) [upload=144965]: Uploading segments... Aug 14 12:36:36.009510566 (139h10m57.968607811s) [upload=144965]: Got next segment. Inline: false Aug 14 12:36:36.009551336 (139h10m57.968648584s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:36:36.009557470 (139h10m57.968654719s) [upload=144965]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:36:36.132771065 (139h10m58.091868317s) [upload=144965]: Next segment err: metaclient: Too Many Requests Aug 14 12:36:36.132837124 (139h10m58.091934369s) [upload=144965]: Done uploading segments... Aug 14 12:36:36.132854109 (139h10m58.091951345s) [upload=144965]: Upload finished. err: metaclient: Too Many Requests
Duration: 398.80402ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X......................................X......X........X..] duration:
2.532735037s
FAIL (2025-08-14 12:35:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 12:34:03.634759866 (139h8m25.5938571s) [upload=144920]: Starting upload
Aug 14 12:34:03.634841385 (139h8m25.593938617s) [upload=144920]: Done starting upload
Aug 14 12:34:03.634987435 (139h8m25.594084682s) [upload=144920]: Uploading segments...
Aug 14 12:34:03.635532957 (139h8m25.594630234s) [upload=144920]: Got next segment. Inline: false
Aug 14 12:34:03.635666468 (139h8m25.594763718s) [upload=144920]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:34:03.635674112 (139h8m25.59477136s) [upload=144920]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:34:03.834040698 (139h8m25.793137938s) [seg_pos={0 0}, upload=144920]: Begin upload segment...
Aug 14 12:34:03.834111787 (139h8m25.793209037s) [seg_pos={0 0}, upload=144920]: Done begin upload segment.
Aug 14 12:34:03.834143296 (139h8m25.793240548s) [noise=true , address=79.127.219.48:4075 , piece_id=R24P43BLCT2D62EPTHXXBS7LRH4BLMYLWDPA4RLW7Q5NS346QYJA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.834188247 (139h8m25.79328551s) [noise=true , address=104.36.82.59:4316 , piece_id=RCZ3NGBZA23RLIDVRO6ZZOOC4BNQ3IMVSIY6NDNWMOQIETKELLJQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.834592543 (139h8m25.793689798s) [noise=true , address=66.23.193.175:4560 , piece_id=T6E5UUWGPKOMHOVF4FF5CG56DPSDOLCGS4JVQJ5N2PAO762KEMGQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.834833065 (139h8m25.793930324s) [noise=true , address=79.127.201.215:4354 , piece_id=QKLSMBX4C6SUZXQSDKU7RITXJYMSJT7EE7IO5BQ5ZBJGHHDMBMNA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.834948659 (139h8m25.79404591s) [noise=true , address=77.90.31.13:4658 , piece_id=5TBPHZYHH7MVRTO5FUAZD6DKA5MLSTBDSDZ2J4GCGSFDMRPXGN6Q, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.835308072 (139h8m25.794405325s) [noise=true , address=77.90.31.12:4598 , piece_id=NZJV56AGHCBXO7NIQ33ABCV27P3XXAZT6ZT2VMRUOXDJC7KQI5ZQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.835438275 (139h8m25.794535534s) [noise=true , address=77.90.31.10:4527 , piece_id=7WPMXCIUJV3VXBQ5NAJ66VNP5VDR3CVHFF664JOIPUZPSMHYUBWQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.835690707 (139h8m25.794787954s) [noise=true , address=104.36.82.17:4332 , piece_id=T4CJL52ECKQ5RYKENI3TVJDBM3SOGQ2UQ5CKEPVZKJQXEOZOWAGA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.836133136 (139h8m25.795230398s) [noise=true , address=104.36.82.44:4890 , piece_id=2BMDVM4CG74SBW4V3UBUG2KVP4PVCNHXQM6JZMPIRKF672WFWDXA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.836222055 (139h8m25.79531931s) [noise=true , address=104.36.82.5:4841 , piece_id=ZL6JBLRD3OYPCRIJRQ4FJRE43JDRNBGEVTKSQZAUXS7CXXYAH4HQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.836612629 (139h8m25.795709877s) [noise=true , address=104.36.82.39:4744 , piece_id=56COJRC6WW6CND2JGHAQB22FBROCAAP3EUVF2LZBN5FICUTXPWZA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.836660358 (139h8m25.795757617s) [noise=true , address=104.36.82.23:4460 , piece_id=BFMNYTEACCNJHSNIJ2SDKNZV6Z3HMJTKBMMQGHWF2TQWRDPRNNJQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.836935280 (139h8m25.796032529s) [noise=true , address=77.90.31.18:4827 , piece_id=N6WD2N4GJNF54WZLILEGPUJPTNJS5LAUTCUVIOTYYW5C4H2MYV6Q, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.837346629 (139h8m25.79644389s) [noise=true , address=77.90.31.19:4869 , piece_id=IYVSO24H6U56Q6QHR5XNUUL3WPLFL7WJGXS2SSKTX3VO46WRGPQQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.837358245 (139h8m25.796455493s) [noise=true , address=77.90.31.16:4758 , piece_id=KSK7VLIQKDQDFYQ7R6SVFA2FEHOW7NKCG342JA2ZEG74K4W45AMQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.837974889 (139h8m25.797072149s) [noise=true , address=104.36.82.60:4362 , piece_id=ZEIB4X45RAKEUDPFC42OD4FMUNEWBI73VHX546PHLM4N3X3VNDQA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.841776519 (139h8m25.80087378s) [noise=true , address=104.36.82.38:4718 , piece_id=FLQDQKXXMFXOFGMR27URKCLB3KMN2DDBK5JN2DQ5HTSZBIU3RYHA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.842423841 (139h8m25.801521081s) [noise=true , address=104.36.82.8:4998 , piece_id=HABGJDQ3DY4ZRUQIQWDHODMOVTI4K7QKMG7YZBJXBITAV4A3GCKQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.965237334 (139h8m25.924334588s) [noise=true , address=104.36.82.5:4841 , piece_id=ZL6JBLRD3OYPCRIJRQ4FJRE43JDRNBGEVTKSQZAUXS7CXXYAH4HQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: ecclient: upload failed (node:12ndNj9Dy8qQSbHXwVWw31sz19ki1qy6Zgetjvj1A5Q3odkzmDm, address:104.36.82.5:4841): protocol: rpc: dial tcp 104.36.82.5:4841: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 12:34:04.409377419 (139h8m26.368474656s) [upload=144920]: Next returned nil segment
Aug 14 12:34:04.409398954 (139h8m26.368496226s) [upload=144920]: Waiting for error group managing segments...
Aug 14 12:34:04.550165923 (139h8m26.50926318s) [noise=true , address=77.90.31.10:4527 , piece_id=7WPMXCIUJV3VXBQ5NAJ66VNP5VDR3CVHFF664JOIPUZPSMHYUBWQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.555317597 (139h8m26.514414829s) [noise=true , address=77.90.31.19:4869 , piece_id=IYVSO24H6U56Q6QHR5XNUUL3WPLFL7WJGXS2SSKTX3VO46WRGPQQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.562729772 (139h8m26.521827006s) [noise=true , address=79.127.219.48:4075 , piece_id=R24P43BLCT2D62EPTHXXBS7LRH4BLMYLWDPA4RLW7Q5NS346QYJA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.586776709 (139h8m26.545873957s) [noise=true , address=77.90.31.13:4658 , piece_id=5TBPHZYHH7MVRTO5FUAZD6DKA5MLSTBDSDZ2J4GCGSFDMRPXGN6Q, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.587522760 (139h8m26.546620007s) [noise=true , address=77.90.31.16:4758 , piece_id=KSK7VLIQKDQDFYQ7R6SVFA2FEHOW7NKCG342JA2ZEG74K4W45AMQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.617686102 (139h8m26.576783337s) [noise=true , address=104.36.82.17:4332 , piece_id=T4CJL52ECKQ5RYKENI3TVJDBM3SOGQ2UQ5CKEPVZKJQXEOZOWAGA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.624928413 (139h8m26.584025779s) [noise=true , address=104.36.82.39:4744 , piece_id=56COJRC6WW6CND2JGHAQB22FBROCAAP3EUVF2LZBN5FICUTXPWZA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.658387661 (139h8m26.617484911s) [noise=true , address=104.36.82.23:4460 , piece_id=BFMNYTEACCNJHSNIJ2SDKNZV6Z3HMJTKBMMQGHWF2TQWRDPRNNJQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.665692380 (139h8m26.624789614s) [noise=true , address=104.36.82.60:4362 , piece_id=ZEIB4X45RAKEUDPFC42OD4FMUNEWBI73VHX546PHLM4N3X3VNDQA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.666474806 (139h8m26.625572048s) [noise=true , address=104.36.82.38:4718 , piece_id=FLQDQKXXMFXOFGMR27URKCLB3KMN2DDBK5JN2DQ5HTSZBIU3RYHA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.682624193 (139h8m26.641721452s) [noise=true , address=104.36.82.59:4316 , piece_id=RCZ3NGBZA23RLIDVRO6ZZOOC4BNQ3IMVSIY6NDNWMOQIETKELLJQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.683141492 (139h8m26.64223874s) [noise=true , address=104.36.82.44:4890 , piece_id=2BMDVM4CG74SBW4V3UBUG2KVP4PVCNHXQM6JZMPIRKF672WFWDXA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.695595809 (139h8m26.654693047s) [noise=true , address=77.90.31.12:4598 , piece_id=NZJV56AGHCBXO7NIQ33ABCV27P3XXAZT6ZT2VMRUOXDJC7KQI5ZQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.704209330 (139h8m26.663306571s) [noise=true , address=104.36.82.8:4998 , piece_id=HABGJDQ3DY4ZRUQIQWDHODMOVTI4K7QKMG7YZBJXBITAV4A3GCKQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.704263899 (139h8m26.663361146s) [seg_pos={0 0}, upload=144920]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:34:04.704484248 (139h8m26.663581497s) [noise=true , address=79.127.201.215:4354 , piece_id=QKLSMBX4C6SUZXQSDKU7RITXJYMSJT7EE7IO5BQ5ZBJGHHDMBMNA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF
Aug 14 12:34:04.704517067 (139h8m26.663614323s) [noise=true , address=77.90.31.18:4827 , piece_id=N6WD2N4GJNF54WZLILEGPUJPTNJS5LAUTCUVIOTYYW5C4H2MYV6Q, seg_pos={0 0}, upload=144920]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF
Aug 14 12:34:04.704701785 (139h8m26.663799022s) [noise=true , address=66.23.193.175:4560 , piece_id=T6E5UUWGPKOMHOVF4FF5CG56DPSDOLCGS4JVQJ5N2PAO762KEMGQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:50872->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:50872->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50872->66.23.193.175:4560: use of closed network connection
Aug 14 12:34:04.704730759 (139h8m26.663828006s) [seg_pos={0 0}, upload=144920]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:34:04.704840313 (139h8m26.663937562s) [upload=144920]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:34:04.704846525 (139h8m26.663943773s) [upload=144920]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:34:04.857307074 (139h8m26.816404321s) [upload=144920]: Done uploading segments...
Aug 14 12:34:04.857335579 (139h8m26.816432831s) [upload=144920]: Upload finished. err: <nil>
Duration: 2.532770179s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X......................................X......X........X.] duration:
2.485274216s
FAIL (2025-08-14 12:35:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 12:34:03.634759866 (139h8m25.5938571s) [upload=144920]: Starting upload
Aug 14 12:34:03.634841385 (139h8m25.593938617s) [upload=144920]: Done starting upload
Aug 14 12:34:03.634987435 (139h8m25.594084682s) [upload=144920]: Uploading segments...
Aug 14 12:34:03.635532957 (139h8m25.594630234s) [upload=144920]: Got next segment. Inline: false
Aug 14 12:34:03.635666468 (139h8m25.594763718s) [upload=144920]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:34:03.635674112 (139h8m25.59477136s) [upload=144920]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:34:03.834040698 (139h8m25.793137938s) [seg_pos={0 0}, upload=144920]: Begin upload segment...
Aug 14 12:34:03.834111787 (139h8m25.793209037s) [seg_pos={0 0}, upload=144920]: Done begin upload segment.
Aug 14 12:34:03.834143296 (139h8m25.793240548s) [noise=true , address=79.127.219.48:4075 , piece_id=R24P43BLCT2D62EPTHXXBS7LRH4BLMYLWDPA4RLW7Q5NS346QYJA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.834188247 (139h8m25.79328551s) [noise=true , address=104.36.82.59:4316 , piece_id=RCZ3NGBZA23RLIDVRO6ZZOOC4BNQ3IMVSIY6NDNWMOQIETKELLJQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.834592543 (139h8m25.793689798s) [noise=true , address=66.23.193.175:4560 , piece_id=T6E5UUWGPKOMHOVF4FF5CG56DPSDOLCGS4JVQJ5N2PAO762KEMGQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.834833065 (139h8m25.793930324s) [noise=true , address=79.127.201.215:4354 , piece_id=QKLSMBX4C6SUZXQSDKU7RITXJYMSJT7EE7IO5BQ5ZBJGHHDMBMNA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.834948659 (139h8m25.79404591s) [noise=true , address=77.90.31.13:4658 , piece_id=5TBPHZYHH7MVRTO5FUAZD6DKA5MLSTBDSDZ2J4GCGSFDMRPXGN6Q, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.835308072 (139h8m25.794405325s) [noise=true , address=77.90.31.12:4598 , piece_id=NZJV56AGHCBXO7NIQ33ABCV27P3XXAZT6ZT2VMRUOXDJC7KQI5ZQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.835438275 (139h8m25.794535534s) [noise=true , address=77.90.31.10:4527 , piece_id=7WPMXCIUJV3VXBQ5NAJ66VNP5VDR3CVHFF664JOIPUZPSMHYUBWQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.835690707 (139h8m25.794787954s) [noise=true , address=104.36.82.17:4332 , piece_id=T4CJL52ECKQ5RYKENI3TVJDBM3SOGQ2UQ5CKEPVZKJQXEOZOWAGA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.836133136 (139h8m25.795230398s) [noise=true , address=104.36.82.44:4890 , piece_id=2BMDVM4CG74SBW4V3UBUG2KVP4PVCNHXQM6JZMPIRKF672WFWDXA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.836222055 (139h8m25.79531931s) [noise=true , address=104.36.82.5:4841 , piece_id=ZL6JBLRD3OYPCRIJRQ4FJRE43JDRNBGEVTKSQZAUXS7CXXYAH4HQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.836612629 (139h8m25.795709877s) [noise=true , address=104.36.82.39:4744 , piece_id=56COJRC6WW6CND2JGHAQB22FBROCAAP3EUVF2LZBN5FICUTXPWZA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.836660358 (139h8m25.795757617s) [noise=true , address=104.36.82.23:4460 , piece_id=BFMNYTEACCNJHSNIJ2SDKNZV6Z3HMJTKBMMQGHWF2TQWRDPRNNJQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.836935280 (139h8m25.796032529s) [noise=true , address=77.90.31.18:4827 , piece_id=N6WD2N4GJNF54WZLILEGPUJPTNJS5LAUTCUVIOTYYW5C4H2MYV6Q, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.837346629 (139h8m25.79644389s) [noise=true , address=77.90.31.19:4869 , piece_id=IYVSO24H6U56Q6QHR5XNUUL3WPLFL7WJGXS2SSKTX3VO46WRGPQQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.837358245 (139h8m25.796455493s) [noise=true , address=77.90.31.16:4758 , piece_id=KSK7VLIQKDQDFYQ7R6SVFA2FEHOW7NKCG342JA2ZEG74K4W45AMQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.837974889 (139h8m25.797072149s) [noise=true , address=104.36.82.60:4362 , piece_id=ZEIB4X45RAKEUDPFC42OD4FMUNEWBI73VHX546PHLM4N3X3VNDQA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.841776519 (139h8m25.80087378s) [noise=true , address=104.36.82.38:4718 , piece_id=FLQDQKXXMFXOFGMR27URKCLB3KMN2DDBK5JN2DQ5HTSZBIU3RYHA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.842423841 (139h8m25.801521081s) [noise=true , address=104.36.82.8:4998 , piece_id=HABGJDQ3DY4ZRUQIQWDHODMOVTI4K7QKMG7YZBJXBITAV4A3GCKQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.965237334 (139h8m25.924334588s) [noise=true , address=104.36.82.5:4841 , piece_id=ZL6JBLRD3OYPCRIJRQ4FJRE43JDRNBGEVTKSQZAUXS7CXXYAH4HQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: ecclient: upload failed (node:12ndNj9Dy8qQSbHXwVWw31sz19ki1qy6Zgetjvj1A5Q3odkzmDm, address:104.36.82.5:4841): protocol: rpc: dial tcp 104.36.82.5:4841: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 12:34:04.409377419 (139h8m26.368474656s) [upload=144920]: Next returned nil segment
Aug 14 12:34:04.409398954 (139h8m26.368496226s) [upload=144920]: Waiting for error group managing segments...
Aug 14 12:34:04.550165923 (139h8m26.50926318s) [noise=true , address=77.90.31.10:4527 , piece_id=7WPMXCIUJV3VXBQ5NAJ66VNP5VDR3CVHFF664JOIPUZPSMHYUBWQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.555317597 (139h8m26.514414829s) [noise=true , address=77.90.31.19:4869 , piece_id=IYVSO24H6U56Q6QHR5XNUUL3WPLFL7WJGXS2SSKTX3VO46WRGPQQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.562729772 (139h8m26.521827006s) [noise=true , address=79.127.219.48:4075 , piece_id=R24P43BLCT2D62EPTHXXBS7LRH4BLMYLWDPA4RLW7Q5NS346QYJA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.586776709 (139h8m26.545873957s) [noise=true , address=77.90.31.13:4658 , piece_id=5TBPHZYHH7MVRTO5FUAZD6DKA5MLSTBDSDZ2J4GCGSFDMRPXGN6Q, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.587522760 (139h8m26.546620007s) [noise=true , address=77.90.31.16:4758 , piece_id=KSK7VLIQKDQDFYQ7R6SVFA2FEHOW7NKCG342JA2ZEG74K4W45AMQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.617686102 (139h8m26.576783337s) [noise=true , address=104.36.82.17:4332 , piece_id=T4CJL52ECKQ5RYKENI3TVJDBM3SOGQ2UQ5CKEPVZKJQXEOZOWAGA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.624928413 (139h8m26.584025779s) [noise=true , address=104.36.82.39:4744 , piece_id=56COJRC6WW6CND2JGHAQB22FBROCAAP3EUVF2LZBN5FICUTXPWZA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.658387661 (139h8m26.617484911s) [noise=true , address=104.36.82.23:4460 , piece_id=BFMNYTEACCNJHSNIJ2SDKNZV6Z3HMJTKBMMQGHWF2TQWRDPRNNJQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.665692380 (139h8m26.624789614s) [noise=true , address=104.36.82.60:4362 , piece_id=ZEIB4X45RAKEUDPFC42OD4FMUNEWBI73VHX546PHLM4N3X3VNDQA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.666474806 (139h8m26.625572048s) [noise=true , address=104.36.82.38:4718 , piece_id=FLQDQKXXMFXOFGMR27URKCLB3KMN2DDBK5JN2DQ5HTSZBIU3RYHA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.682624193 (139h8m26.641721452s) [noise=true , address=104.36.82.59:4316 , piece_id=RCZ3NGBZA23RLIDVRO6ZZOOC4BNQ3IMVSIY6NDNWMOQIETKELLJQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.683141492 (139h8m26.64223874s) [noise=true , address=104.36.82.44:4890 , piece_id=2BMDVM4CG74SBW4V3UBUG2KVP4PVCNHXQM6JZMPIRKF672WFWDXA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.695595809 (139h8m26.654693047s) [noise=true , address=77.90.31.12:4598 , piece_id=NZJV56AGHCBXO7NIQ33ABCV27P3XXAZT6ZT2VMRUOXDJC7KQI5ZQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.704209330 (139h8m26.663306571s) [noise=true , address=104.36.82.8:4998 , piece_id=HABGJDQ3DY4ZRUQIQWDHODMOVTI4K7QKMG7YZBJXBITAV4A3GCKQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.704263899 (139h8m26.663361146s) [seg_pos={0 0}, upload=144920]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:34:04.704484248 (139h8m26.663581497s) [noise=true , address=79.127.201.215:4354 , piece_id=QKLSMBX4C6SUZXQSDKU7RITXJYMSJT7EE7IO5BQ5ZBJGHHDMBMNA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF
Aug 14 12:34:04.704517067 (139h8m26.663614323s) [noise=true , address=77.90.31.18:4827 , piece_id=N6WD2N4GJNF54WZLILEGPUJPTNJS5LAUTCUVIOTYYW5C4H2MYV6Q, seg_pos={0 0}, upload=144920]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF
Aug 14 12:34:04.704701785 (139h8m26.663799022s) [noise=true , address=66.23.193.175:4560 , piece_id=T6E5UUWGPKOMHOVF4FF5CG56DPSDOLCGS4JVQJ5N2PAO762KEMGQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:50872->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:50872->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50872->66.23.193.175:4560: use of closed network connection
Aug 14 12:34:04.704730759 (139h8m26.663828006s) [seg_pos={0 0}, upload=144920]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:34:04.704840313 (139h8m26.663937562s) [upload=144920]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:34:04.704846525 (139h8m26.663943773s) [upload=144920]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:34:04.857307074 (139h8m26.816404321s) [upload=144920]: Done uploading segments...
Aug 14 12:34:04.857335579 (139h8m26.816432831s) [upload=144920]: Upload finished. err: <nil>
Duration: 2.485319558s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X......................................X......X........X] duration:
1.719892087s
FAIL (2025-08-14 12:34:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 12:34:03.634759866 (139h8m25.5938571s) [upload=144920]: Starting upload
Aug 14 12:34:03.634841385 (139h8m25.593938617s) [upload=144920]: Done starting upload
Aug 14 12:34:03.634987435 (139h8m25.594084682s) [upload=144920]: Uploading segments...
Aug 14 12:34:03.635532957 (139h8m25.594630234s) [upload=144920]: Got next segment. Inline: false
Aug 14 12:34:03.635666468 (139h8m25.594763718s) [upload=144920]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:34:03.635674112 (139h8m25.59477136s) [upload=144920]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:34:03.834040698 (139h8m25.793137938s) [seg_pos={0 0}, upload=144920]: Begin upload segment...
Aug 14 12:34:03.834111787 (139h8m25.793209037s) [seg_pos={0 0}, upload=144920]: Done begin upload segment.
Aug 14 12:34:03.834143296 (139h8m25.793240548s) [noise=true , address=79.127.219.48:4075 , piece_id=R24P43BLCT2D62EPTHXXBS7LRH4BLMYLWDPA4RLW7Q5NS346QYJA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.834188247 (139h8m25.79328551s) [noise=true , address=104.36.82.59:4316 , piece_id=RCZ3NGBZA23RLIDVRO6ZZOOC4BNQ3IMVSIY6NDNWMOQIETKELLJQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.834592543 (139h8m25.793689798s) [noise=true , address=66.23.193.175:4560 , piece_id=T6E5UUWGPKOMHOVF4FF5CG56DPSDOLCGS4JVQJ5N2PAO762KEMGQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.834833065 (139h8m25.793930324s) [noise=true , address=79.127.201.215:4354 , piece_id=QKLSMBX4C6SUZXQSDKU7RITXJYMSJT7EE7IO5BQ5ZBJGHHDMBMNA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.834948659 (139h8m25.79404591s) [noise=true , address=77.90.31.13:4658 , piece_id=5TBPHZYHH7MVRTO5FUAZD6DKA5MLSTBDSDZ2J4GCGSFDMRPXGN6Q, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.835308072 (139h8m25.794405325s) [noise=true , address=77.90.31.12:4598 , piece_id=NZJV56AGHCBXO7NIQ33ABCV27P3XXAZT6ZT2VMRUOXDJC7KQI5ZQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.835438275 (139h8m25.794535534s) [noise=true , address=77.90.31.10:4527 , piece_id=7WPMXCIUJV3VXBQ5NAJ66VNP5VDR3CVHFF664JOIPUZPSMHYUBWQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.835690707 (139h8m25.794787954s) [noise=true , address=104.36.82.17:4332 , piece_id=T4CJL52ECKQ5RYKENI3TVJDBM3SOGQ2UQ5CKEPVZKJQXEOZOWAGA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.836133136 (139h8m25.795230398s) [noise=true , address=104.36.82.44:4890 , piece_id=2BMDVM4CG74SBW4V3UBUG2KVP4PVCNHXQM6JZMPIRKF672WFWDXA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.836222055 (139h8m25.79531931s) [noise=true , address=104.36.82.5:4841 , piece_id=ZL6JBLRD3OYPCRIJRQ4FJRE43JDRNBGEVTKSQZAUXS7CXXYAH4HQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.836612629 (139h8m25.795709877s) [noise=true , address=104.36.82.39:4744 , piece_id=56COJRC6WW6CND2JGHAQB22FBROCAAP3EUVF2LZBN5FICUTXPWZA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.836660358 (139h8m25.795757617s) [noise=true , address=104.36.82.23:4460 , piece_id=BFMNYTEACCNJHSNIJ2SDKNZV6Z3HMJTKBMMQGHWF2TQWRDPRNNJQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.836935280 (139h8m25.796032529s) [noise=true , address=77.90.31.18:4827 , piece_id=N6WD2N4GJNF54WZLILEGPUJPTNJS5LAUTCUVIOTYYW5C4H2MYV6Q, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.837346629 (139h8m25.79644389s) [noise=true , address=77.90.31.19:4869 , piece_id=IYVSO24H6U56Q6QHR5XNUUL3WPLFL7WJGXS2SSKTX3VO46WRGPQQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.837358245 (139h8m25.796455493s) [noise=true , address=77.90.31.16:4758 , piece_id=KSK7VLIQKDQDFYQ7R6SVFA2FEHOW7NKCG342JA2ZEG74K4W45AMQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.837974889 (139h8m25.797072149s) [noise=true , address=104.36.82.60:4362 , piece_id=ZEIB4X45RAKEUDPFC42OD4FMUNEWBI73VHX546PHLM4N3X3VNDQA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.841776519 (139h8m25.80087378s) [noise=true , address=104.36.82.38:4718 , piece_id=FLQDQKXXMFXOFGMR27URKCLB3KMN2DDBK5JN2DQ5HTSZBIU3RYHA, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.842423841 (139h8m25.801521081s) [noise=true , address=104.36.82.8:4998 , piece_id=HABGJDQ3DY4ZRUQIQWDHODMOVTI4K7QKMG7YZBJXBITAV4A3GCKQ, seg_pos={0 0}, upload=144920]: Uploading piece...
Aug 14 12:34:03.965237334 (139h8m25.924334588s) [noise=true , address=104.36.82.5:4841 , piece_id=ZL6JBLRD3OYPCRIJRQ4FJRE43JDRNBGEVTKSQZAUXS7CXXYAH4HQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: ecclient: upload failed (node:12ndNj9Dy8qQSbHXwVWw31sz19ki1qy6Zgetjvj1A5Q3odkzmDm, address:104.36.82.5:4841): protocol: rpc: dial tcp 104.36.82.5:4841: connect: connection refused; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 12:34:04.409377419 (139h8m26.368474656s) [upload=144920]: Next returned nil segment
Aug 14 12:34:04.409398954 (139h8m26.368496226s) [upload=144920]: Waiting for error group managing segments...
Aug 14 12:34:04.550165923 (139h8m26.50926318s) [noise=true , address=77.90.31.10:4527 , piece_id=7WPMXCIUJV3VXBQ5NAJ66VNP5VDR3CVHFF664JOIPUZPSMHYUBWQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.555317597 (139h8m26.514414829s) [noise=true , address=77.90.31.19:4869 , piece_id=IYVSO24H6U56Q6QHR5XNUUL3WPLFL7WJGXS2SSKTX3VO46WRGPQQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.562729772 (139h8m26.521827006s) [noise=true , address=79.127.219.48:4075 , piece_id=R24P43BLCT2D62EPTHXXBS7LRH4BLMYLWDPA4RLW7Q5NS346QYJA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.586776709 (139h8m26.545873957s) [noise=true , address=77.90.31.13:4658 , piece_id=5TBPHZYHH7MVRTO5FUAZD6DKA5MLSTBDSDZ2J4GCGSFDMRPXGN6Q, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.587522760 (139h8m26.546620007s) [noise=true , address=77.90.31.16:4758 , piece_id=KSK7VLIQKDQDFYQ7R6SVFA2FEHOW7NKCG342JA2ZEG74K4W45AMQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.617686102 (139h8m26.576783337s) [noise=true , address=104.36.82.17:4332 , piece_id=T4CJL52ECKQ5RYKENI3TVJDBM3SOGQ2UQ5CKEPVZKJQXEOZOWAGA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.624928413 (139h8m26.584025779s) [noise=true , address=104.36.82.39:4744 , piece_id=56COJRC6WW6CND2JGHAQB22FBROCAAP3EUVF2LZBN5FICUTXPWZA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.658387661 (139h8m26.617484911s) [noise=true , address=104.36.82.23:4460 , piece_id=BFMNYTEACCNJHSNIJ2SDKNZV6Z3HMJTKBMMQGHWF2TQWRDPRNNJQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.665692380 (139h8m26.624789614s) [noise=true , address=104.36.82.60:4362 , piece_id=ZEIB4X45RAKEUDPFC42OD4FMUNEWBI73VHX546PHLM4N3X3VNDQA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.666474806 (139h8m26.625572048s) [noise=true , address=104.36.82.38:4718 , piece_id=FLQDQKXXMFXOFGMR27URKCLB3KMN2DDBK5JN2DQ5HTSZBIU3RYHA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.682624193 (139h8m26.641721452s) [noise=true , address=104.36.82.59:4316 , piece_id=RCZ3NGBZA23RLIDVRO6ZZOOC4BNQ3IMVSIY6NDNWMOQIETKELLJQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.683141492 (139h8m26.64223874s) [noise=true , address=104.36.82.44:4890 , piece_id=2BMDVM4CG74SBW4V3UBUG2KVP4PVCNHXQM6JZMPIRKF672WFWDXA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.695595809 (139h8m26.654693047s) [noise=true , address=77.90.31.12:4598 , piece_id=NZJV56AGHCBXO7NIQ33ABCV27P3XXAZT6ZT2VMRUOXDJC7KQI5ZQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.704209330 (139h8m26.663306571s) [noise=true , address=104.36.82.8:4998 , piece_id=HABGJDQ3DY4ZRUQIQWDHODMOVTI4K7QKMG7YZBJXBITAV4A3GCKQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: <nil>
Aug 14 12:34:04.704263899 (139h8m26.663361146s) [seg_pos={0 0}, upload=144920]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:34:04.704484248 (139h8m26.663581497s) [noise=true , address=79.127.201.215:4354 , piece_id=QKLSMBX4C6SUZXQSDKU7RITXJYMSJT7EE7IO5BQ5ZBJGHHDMBMNA, seg_pos={0 0}, upload=144920]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF
Aug 14 12:34:04.704517067 (139h8m26.663614323s) [noise=true , address=77.90.31.18:4827 , piece_id=N6WD2N4GJNF54WZLILEGPUJPTNJS5LAUTCUVIOTYYW5C4H2MYV6Q, seg_pos={0 0}, upload=144920]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF
Aug 14 12:34:04.704701785 (139h8m26.663799022s) [noise=true , address=66.23.193.175:4560 , piece_id=T6E5UUWGPKOMHOVF4FF5CG56DPSDOLCGS4JVQJ5N2PAO762KEMGQ, seg_pos={0 0}, upload=144920]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:50872->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:50872->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50872->66.23.193.175:4560: use of closed network connection
Aug 14 12:34:04.704730759 (139h8m26.663828006s) [seg_pos={0 0}, upload=144920]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:34:04.704840313 (139h8m26.663937562s) [upload=144920]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:34:04.704846525 (139h8m26.663943773s) [upload=144920]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:34:04.857307074 (139h8m26.816404321s) [upload=144920]: Done uploading segments...
Aug 14 12:34:04.857335579 (139h8m26.816432831s) [upload=144920]: Upload finished. err: <nil>
Duration: 1.719931971s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X......................................X......X........] duration:
2.626873969s
FAIL (2025-08-14 12:33:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:28:30.299340416 (139h2m52.258437649s) [upload=144826]: Starting upload Aug 14 12:28:30.299431240 (139h2m52.258528475s) [upload=144826]: Done starting upload Aug 14 12:28:30.299574318 (139h2m52.258671669s) [upload=144826]: Uploading segments... Aug 14 12:28:30.299814512 (139h2m52.258911761s) [upload=144826]: Got next segment. Inline: false Aug 14 12:28:30.299862320 (139h2m52.258959568s) [upload=144826]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:28:30.299868023 (139h2m52.258965271s) [upload=144826]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:28:30.433481009 (139h2m52.392578263s) [upload=144826]: Next segment err: metaclient: Too Many Requests Aug 14 12:28:30.433532424 (139h2m52.392629675s) [upload=144826]: Done uploading segments... Aug 14 12:28:30.433556734 (139h2m52.392653981s) [upload=144826]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.626915985s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X......................................X......X.......] duration:
2.522447359s
FAIL (2025-08-14 12:33:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:28:30.299340416 (139h2m52.258437649s) [upload=144826]: Starting upload Aug 14 12:28:30.299431240 (139h2m52.258528475s) [upload=144826]: Done starting upload Aug 14 12:28:30.299574318 (139h2m52.258671669s) [upload=144826]: Uploading segments... Aug 14 12:28:30.299814512 (139h2m52.258911761s) [upload=144826]: Got next segment. Inline: false Aug 14 12:28:30.299862320 (139h2m52.258959568s) [upload=144826]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:28:30.299868023 (139h2m52.258965271s) [upload=144826]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:28:30.433481009 (139h2m52.392578263s) [upload=144826]: Next segment err: metaclient: Too Many Requests Aug 14 12:28:30.433532424 (139h2m52.392629675s) [upload=144826]: Done uploading segments... Aug 14 12:28:30.433556734 (139h2m52.392653981s) [upload=144826]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.522481368s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X......................................X......X......] duration:
2.514193472s
FAIL (2025-08-14 12:32:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:28:30.299340416 (139h2m52.258437649s) [upload=144826]: Starting upload Aug 14 12:28:30.299431240 (139h2m52.258528475s) [upload=144826]: Done starting upload Aug 14 12:28:30.299574318 (139h2m52.258671669s) [upload=144826]: Uploading segments... Aug 14 12:28:30.299814512 (139h2m52.258911761s) [upload=144826]: Got next segment. Inline: false Aug 14 12:28:30.299862320 (139h2m52.258959568s) [upload=144826]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:28:30.299868023 (139h2m52.258965271s) [upload=144826]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:28:30.433481009 (139h2m52.392578263s) [upload=144826]: Next segment err: metaclient: Too Many Requests Aug 14 12:28:30.433532424 (139h2m52.392629675s) [upload=144826]: Done uploading segments... Aug 14 12:28:30.433556734 (139h2m52.392653981s) [upload=144826]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.514294752s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X......................................X......X.....] duration:
2.583658146s
FAIL (2025-08-14 12:32:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 12:28:30.299340416 (139h2m52.258437649s) [upload=144826]: Starting upload Aug 14 12:28:30.299431240 (139h2m52.258528475s) [upload=144826]: Done starting upload Aug 14 12:28:30.299574318 (139h2m52.258671669s) [upload=144826]: Uploading segments... Aug 14 12:28:30.299814512 (139h2m52.258911761s) [upload=144826]: Got next segment. Inline: false Aug 14 12:28:30.299862320 (139h2m52.258959568s) [upload=144826]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 12:28:30.299868023 (139h2m52.258965271s) [upload=144826]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 14 12:28:30.433481009 (139h2m52.392578263s) [upload=144826]: Next segment err: metaclient: Too Many Requests Aug 14 12:28:30.433532424 (139h2m52.392629675s) [upload=144826]: Done uploading segments... Aug 14 12:28:30.433556734 (139h2m52.392653981s) [upload=144826]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.583689255s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|