Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [..X...X...............X..........XX.X.................X...X.] duration:
830.151467ms
FAIL (2025-08-19 09:18:23 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:17:29.121737112 (255h51m51.08083436s) [upload=266369]: Starting upload Aug 19 09:17:29.121800517 (255h51m51.080897767s) [upload=266369]: Done starting upload Aug 19 09:17:29.121905236 (255h51m51.081002468s) [upload=266369]: Uploading segments... Aug 19 09:17:29.121994789 (255h51m51.081092044s) [upload=266369]: Got next segment. Inline: true Aug 19 09:17:29.122000626 (255h51m51.081097875s) [upload=266369]: Waiting for error group managing segments... Aug 19 09:17:29.122064326 (255h51m51.081161557s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:17:29.122070508 (255h51m51.081167757s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:17:29.122074202 (255h51m51.08117145s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:17:29.267958237 (255h51m51.227055485s) [upload=266369]: Done uploading segments... Aug 19 09:17:29.267982411 (255h51m51.22707965s) [upload=266369]: Upload finished. err: <nil>
Duration: 830.184579ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X............................X...............X..] duration:
2.489795648s
FAIL (2025-08-19 09:17:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:16:26.737124164 (255h50m48.696221412s) [upload=266350]: Starting upload Aug 19 09:16:26.737215463 (255h50m48.69631271s) [upload=266350]: Done starting upload Aug 19 09:16:26.737362407 (255h50m48.696459646s) [upload=266350]: Uploading segments... Aug 19 09:16:26.737680357 (255h50m48.69677762s) [upload=266350]: Got next segment. Inline: false Aug 19 09:16:26.737728247 (255h50m48.696825498s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:16:26.737735907 (255h50m48.696833159s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:16:26.825864611 (255h50m48.78496187s) [upload=266350]: Next segment err: metaclient: Too Many Requests Aug 19 09:16:26.825951395 (255h50m48.785048643s) [upload=266350]: Done uploading segments... Aug 19 09:16:26.825998116 (255h50m48.785095363s) [upload=266350]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.489842653s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [...X...X...............X..........XX.X.................X...X] duration:
611.922244ms
FAIL (2025-08-19 09:17:29 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:17:29.121737112 (255h51m51.08083436s) [upload=266369]: Starting upload Aug 19 09:17:29.121800517 (255h51m51.080897767s) [upload=266369]: Done starting upload Aug 19 09:17:29.121905236 (255h51m51.081002468s) [upload=266369]: Uploading segments... Aug 19 09:17:29.121994789 (255h51m51.081092044s) [upload=266369]: Got next segment. Inline: true Aug 19 09:17:29.122000626 (255h51m51.081097875s) [upload=266369]: Waiting for error group managing segments... Aug 19 09:17:29.122064326 (255h51m51.081161557s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:17:29.122070508 (255h51m51.081167757s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:17:29.122074202 (255h51m51.08117145s) [upload=266369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:17:29.267958237 (255h51m51.227055485s) [upload=266369]: Done uploading segments... Aug 19 09:17:29.267982411 (255h51m51.22707965s) [upload=266369]: Upload finished. err: <nil>
Duration: 611.961211ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [....X...X...............X..........XX.X.................X...] duration:
899.445652ms
FAIL (2025-08-19 09:16:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 09:14:23.441728576 (255h48m45.400825824s) [upload=266317]: Starting upload
Aug 19 09:14:23.441785148 (255h48m45.400882384s) [upload=266317]: Done starting upload
Aug 19 09:14:23.441876178 (255h48m45.400973413s) [upload=266317]: Uploading segments...
Aug 19 09:14:23.441953808 (255h48m45.401051067s) [upload=266317]: Got next segment. Inline: true
Aug 19 09:14:23.441961164 (255h48m45.40105841s) [upload=266317]: Waiting for error group managing segments...
Aug 19 09:14:23.442004053 (255h48m45.401101298s) [upload=266317]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 09:14:23.442008539 (255h48m45.401105784s) [upload=266317]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 09:14:23.442011285 (255h48m45.40110853s) [upload=266317]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 09:14:23.616504829 (255h48m45.575602084s) [upload=266317]: Done uploading segments...
Aug 19 09:14:23.616561851 (255h48m45.575659099s) [upload=266317]: Upload finished. err: <nil>
Duration: 899.481178ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X............X............................X...............X.] duration:
2.985038931s
FAIL (2025-08-19 09:16:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:16:26.737124164 (255h50m48.696221412s) [upload=266350]: Starting upload Aug 19 09:16:26.737215463 (255h50m48.69631271s) [upload=266350]: Done starting upload Aug 19 09:16:26.737362407 (255h50m48.696459646s) [upload=266350]: Uploading segments... Aug 19 09:16:26.737680357 (255h50m48.69677762s) [upload=266350]: Got next segment. Inline: false Aug 19 09:16:26.737728247 (255h50m48.696825498s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:16:26.737735907 (255h50m48.696833159s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:16:26.825864611 (255h50m48.78496187s) [upload=266350]: Next segment err: metaclient: Too Many Requests Aug 19 09:16:26.825951395 (255h50m48.785048643s) [upload=266350]: Done uploading segments... Aug 19 09:16:26.825998116 (255h50m48.785095363s) [upload=266350]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.9851459s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X............X............................X...............X] duration:
361.37872ms
FAIL (2025-08-19 09:16:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:16:26.737124164 (255h50m48.696221412s) [upload=266350]: Starting upload Aug 19 09:16:26.737215463 (255h50m48.69631271s) [upload=266350]: Done starting upload Aug 19 09:16:26.737362407 (255h50m48.696459646s) [upload=266350]: Uploading segments... Aug 19 09:16:26.737680357 (255h50m48.69677762s) [upload=266350]: Got next segment. Inline: false Aug 19 09:16:26.737728247 (255h50m48.696825498s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:16:26.737735907 (255h50m48.696833159s) [upload=266350]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:16:26.825864611 (255h50m48.78496187s) [upload=266350]: Next segment err: metaclient: Too Many Requests Aug 19 09:16:26.825951395 (255h50m48.785048643s) [upload=266350]: Done uploading segments... Aug 19 09:16:26.825998116 (255h50m48.785095363s) [upload=266350]: Upload finished. err: metaclient: Too Many Requests
Duration: 361.41236ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.....X...X...............X..........XX.X.................X..] duration:
822.618027ms
FAIL (2025-08-19 09:16:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 09:14:23.441728576 (255h48m45.400825824s) [upload=266317]: Starting upload
Aug 19 09:14:23.441785148 (255h48m45.400882384s) [upload=266317]: Done starting upload
Aug 19 09:14:23.441876178 (255h48m45.400973413s) [upload=266317]: Uploading segments...
Aug 19 09:14:23.441953808 (255h48m45.401051067s) [upload=266317]: Got next segment. Inline: true
Aug 19 09:14:23.441961164 (255h48m45.40105841s) [upload=266317]: Waiting for error group managing segments...
Aug 19 09:14:23.442004053 (255h48m45.401101298s) [upload=266317]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 09:14:23.442008539 (255h48m45.401105784s) [upload=266317]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 09:14:23.442011285 (255h48m45.40110853s) [upload=266317]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 09:14:23.616504829 (255h48m45.575602084s) [upload=266317]: Done uploading segments...
Aug 19 09:14:23.616561851 (255h48m45.575659099s) [upload=266317]: Upload finished. err: <nil>
Duration: 822.652762ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X............X............................X...............] duration:
2.443116305s
FAIL (2025-08-19 09:15:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:02:36.394252422 (255h36m58.353349679s) [upload=266109]: Starting upload Aug 19 09:02:36.394344280 (255h36m58.353441537s) [upload=266109]: Done starting upload Aug 19 09:02:36.394523445 (255h36m58.353620713s) [upload=266109]: Uploading segments... Aug 19 09:02:36.394805378 (255h36m58.353902628s) [upload=266109]: Got next segment. Inline: false Aug 19 09:02:36.394915711 (255h36m58.354012969s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:02:36.394922533 (255h36m58.354019789s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:02:36.614449395 (255h36m58.57354665s) [upload=266109]: Next segment err: metaclient: Too Many Requests Aug 19 09:02:36.614484753 (255h36m58.57358201s) [upload=266109]: Done uploading segments... Aug 19 09:02:36.614503483 (255h36m58.573600734s) [upload=266109]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.443153045s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [......X...X...............X..........XX.X.................X.] duration:
813.903172ms
FAIL (2025-08-19 09:15:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 09:14:23.441728576 (255h48m45.400825824s) [upload=266317]: Starting upload
Aug 19 09:14:23.441785148 (255h48m45.400882384s) [upload=266317]: Done starting upload
Aug 19 09:14:23.441876178 (255h48m45.400973413s) [upload=266317]: Uploading segments...
Aug 19 09:14:23.441953808 (255h48m45.401051067s) [upload=266317]: Got next segment. Inline: true
Aug 19 09:14:23.441961164 (255h48m45.40105841s) [upload=266317]: Waiting for error group managing segments...
Aug 19 09:14:23.442004053 (255h48m45.401101298s) [upload=266317]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 09:14:23.442008539 (255h48m45.401105784s) [upload=266317]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 09:14:23.442011285 (255h48m45.40110853s) [upload=266317]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 09:14:23.616504829 (255h48m45.575602084s) [upload=266317]: Done uploading segments...
Aug 19 09:14:23.616561851 (255h48m45.575659099s) [upload=266317]: Upload finished. err: <nil>
Duration: 813.930242ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X............X............................X..............] duration:
2.416248904s
FAIL (2025-08-19 09:15:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:02:36.394252422 (255h36m58.353349679s) [upload=266109]: Starting upload Aug 19 09:02:36.394344280 (255h36m58.353441537s) [upload=266109]: Done starting upload Aug 19 09:02:36.394523445 (255h36m58.353620713s) [upload=266109]: Uploading segments... Aug 19 09:02:36.394805378 (255h36m58.353902628s) [upload=266109]: Got next segment. Inline: false Aug 19 09:02:36.394915711 (255h36m58.354012969s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:02:36.394922533 (255h36m58.354019789s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:02:36.614449395 (255h36m58.57354665s) [upload=266109]: Next segment err: metaclient: Too Many Requests Aug 19 09:02:36.614484753 (255h36m58.57358201s) [upload=266109]: Done uploading segments... Aug 19 09:02:36.614503483 (255h36m58.573600734s) [upload=266109]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.41628323s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.......X...X...............X..........XX.X.................X] duration:
802.750323ms
FAIL (2025-08-19 09:14:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 19 09:14:23.441728576 (255h48m45.400825824s) [upload=266317]: Starting upload
Aug 19 09:14:23.441785148 (255h48m45.400882384s) [upload=266317]: Done starting upload
Aug 19 09:14:23.441876178 (255h48m45.400973413s) [upload=266317]: Uploading segments...
Aug 19 09:14:23.441953808 (255h48m45.401051067s) [upload=266317]: Got next segment. Inline: true
Aug 19 09:14:23.441961164 (255h48m45.40105841s) [upload=266317]: Waiting for error group managing segments...
Aug 19 09:14:23.442004053 (255h48m45.401101298s) [upload=266317]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 09:14:23.442008539 (255h48m45.401105784s) [upload=266317]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 09:14:23.442011285 (255h48m45.40110853s) [upload=266317]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 09:14:23.616504829 (255h48m45.575602084s) [upload=266317]: Done uploading segments...
Aug 19 09:14:23.616561851 (255h48m45.575659099s) [upload=266317]: Upload finished. err: <nil>
Duration: 802.837333ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X............X............................X.............] duration:
2.380887302s
FAIL (2025-08-19 09:14:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:02:36.394252422 (255h36m58.353349679s) [upload=266109]: Starting upload Aug 19 09:02:36.394344280 (255h36m58.353441537s) [upload=266109]: Done starting upload Aug 19 09:02:36.394523445 (255h36m58.353620713s) [upload=266109]: Uploading segments... Aug 19 09:02:36.394805378 (255h36m58.353902628s) [upload=266109]: Got next segment. Inline: false Aug 19 09:02:36.394915711 (255h36m58.354012969s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:02:36.394922533 (255h36m58.354019789s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:02:36.614449395 (255h36m58.57354665s) [upload=266109]: Next segment err: metaclient: Too Many Requests Aug 19 09:02:36.614484753 (255h36m58.57358201s) [upload=266109]: Done uploading segments... Aug 19 09:02:36.614503483 (255h36m58.573600734s) [upload=266109]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.380929256s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........X...X...............X..........XX.X.................] duration:
2.012092137s
FAIL (2025-08-19 09:13:24 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:01:05.205958715 (255h35m27.165055967s) [upload=266084]: Starting upload Aug 19 09:01:05.206033225 (255h35m27.165130463s) [upload=266084]: Done starting upload Aug 19 09:01:05.206121111 (255h35m27.165218354s) [upload=266084]: Uploading segments... Aug 19 09:01:05.206181918 (255h35m27.165279173s) [upload=266084]: Got next segment. Inline: true Aug 19 09:01:05.206188327 (255h35m27.165285583s) [upload=266084]: Waiting for error group managing segments... Aug 19 09:01:05.206241862 (255h35m27.165339097s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:05.206250212 (255h35m27.165347466s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:01:05.206254764 (255h35m27.165352019s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:01:06.648466516 (255h35m28.607563768s) [upload=266084]: Done uploading segments... Aug 19 09:01:06.648492741 (255h35m28.60758998s) [upload=266084]: Upload finished. err: <nil>
Duration: 2.01212208s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X............X............................X............] duration:
2.623192384s
FAIL (2025-08-19 09:13:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:02:36.394252422 (255h36m58.353349679s) [upload=266109]: Starting upload Aug 19 09:02:36.394344280 (255h36m58.353441537s) [upload=266109]: Done starting upload Aug 19 09:02:36.394523445 (255h36m58.353620713s) [upload=266109]: Uploading segments... Aug 19 09:02:36.394805378 (255h36m58.353902628s) [upload=266109]: Got next segment. Inline: false Aug 19 09:02:36.394915711 (255h36m58.354012969s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:02:36.394922533 (255h36m58.354019789s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:02:36.614449395 (255h36m58.57354665s) [upload=266109]: Next segment err: metaclient: Too Many Requests Aug 19 09:02:36.614484753 (255h36m58.57358201s) [upload=266109]: Done uploading segments... Aug 19 09:02:36.614503483 (255h36m58.573600734s) [upload=266109]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.623237507s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.........X...X...............X..........XX.X................] duration:
850.077508ms
FAIL (2025-08-19 09:12:33 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:01:05.205958715 (255h35m27.165055967s) [upload=266084]: Starting upload Aug 19 09:01:05.206033225 (255h35m27.165130463s) [upload=266084]: Done starting upload Aug 19 09:01:05.206121111 (255h35m27.165218354s) [upload=266084]: Uploading segments... Aug 19 09:01:05.206181918 (255h35m27.165279173s) [upload=266084]: Got next segment. Inline: true Aug 19 09:01:05.206188327 (255h35m27.165285583s) [upload=266084]: Waiting for error group managing segments... Aug 19 09:01:05.206241862 (255h35m27.165339097s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:05.206250212 (255h35m27.165347466s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:01:05.206254764 (255h35m27.165352019s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:01:06.648466516 (255h35m28.607563768s) [upload=266084]: Done uploading segments... Aug 19 09:01:06.648492741 (255h35m28.60758998s) [upload=266084]: Upload finished. err: <nil>
Duration: 850.113922ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X............X............................X...........] duration:
2.358509532s
FAIL (2025-08-19 09:12:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:02:36.394252422 (255h36m58.353349679s) [upload=266109]: Starting upload Aug 19 09:02:36.394344280 (255h36m58.353441537s) [upload=266109]: Done starting upload Aug 19 09:02:36.394523445 (255h36m58.353620713s) [upload=266109]: Uploading segments... Aug 19 09:02:36.394805378 (255h36m58.353902628s) [upload=266109]: Got next segment. Inline: false Aug 19 09:02:36.394915711 (255h36m58.354012969s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:02:36.394922533 (255h36m58.354019789s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:02:36.614449395 (255h36m58.57354665s) [upload=266109]: Next segment err: metaclient: Too Many Requests Aug 19 09:02:36.614484753 (255h36m58.57358201s) [upload=266109]: Done uploading segments... Aug 19 09:02:36.614503483 (255h36m58.573600734s) [upload=266109]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.358542625s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X............X............................X..........] duration:
2.379681837s
FAIL (2025-08-19 09:11:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:02:36.394252422 (255h36m58.353349679s) [upload=266109]: Starting upload Aug 19 09:02:36.394344280 (255h36m58.353441537s) [upload=266109]: Done starting upload Aug 19 09:02:36.394523445 (255h36m58.353620713s) [upload=266109]: Uploading segments... Aug 19 09:02:36.394805378 (255h36m58.353902628s) [upload=266109]: Got next segment. Inline: false Aug 19 09:02:36.394915711 (255h36m58.354012969s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:02:36.394922533 (255h36m58.354019789s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:02:36.614449395 (255h36m58.57354665s) [upload=266109]: Next segment err: metaclient: Too Many Requests Aug 19 09:02:36.614484753 (255h36m58.57358201s) [upload=266109]: Done uploading segments... Aug 19 09:02:36.614503483 (255h36m58.573600734s) [upload=266109]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.379720409s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..........X...X...............X..........XX.X...............] duration:
1.720459988s
FAIL (2025-08-19 09:11:33 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:01:05.205958715 (255h35m27.165055967s) [upload=266084]: Starting upload Aug 19 09:01:05.206033225 (255h35m27.165130463s) [upload=266084]: Done starting upload Aug 19 09:01:05.206121111 (255h35m27.165218354s) [upload=266084]: Uploading segments... Aug 19 09:01:05.206181918 (255h35m27.165279173s) [upload=266084]: Got next segment. Inline: true Aug 19 09:01:05.206188327 (255h35m27.165285583s) [upload=266084]: Waiting for error group managing segments... Aug 19 09:01:05.206241862 (255h35m27.165339097s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:05.206250212 (255h35m27.165347466s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:01:05.206254764 (255h35m27.165352019s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:01:06.648466516 (255h35m28.607563768s) [upload=266084]: Done uploading segments... Aug 19 09:01:06.648492741 (255h35m28.60758998s) [upload=266084]: Upload finished. err: <nil>
Duration: 1.720498875s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...........X...X...............X..........XX.X..............] duration:
830.1948ms
FAIL (2025-08-19 09:10:59 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:01:05.205958715 (255h35m27.165055967s) [upload=266084]: Starting upload Aug 19 09:01:05.206033225 (255h35m27.165130463s) [upload=266084]: Done starting upload Aug 19 09:01:05.206121111 (255h35m27.165218354s) [upload=266084]: Uploading segments... Aug 19 09:01:05.206181918 (255h35m27.165279173s) [upload=266084]: Got next segment. Inline: true Aug 19 09:01:05.206188327 (255h35m27.165285583s) [upload=266084]: Waiting for error group managing segments... Aug 19 09:01:05.206241862 (255h35m27.165339097s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:05.206250212 (255h35m27.165347466s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:01:05.206254764 (255h35m27.165352019s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:01:06.648466516 (255h35m28.607563768s) [upload=266084]: Done uploading segments... Aug 19 09:01:06.648492741 (255h35m28.60758998s) [upload=266084]: Upload finished. err: <nil>
Duration: 830.258241ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X............X............................X.........] duration:
2.415854234s
FAIL (2025-08-19 09:10:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:02:36.394252422 (255h36m58.353349679s) [upload=266109]: Starting upload Aug 19 09:02:36.394344280 (255h36m58.353441537s) [upload=266109]: Done starting upload Aug 19 09:02:36.394523445 (255h36m58.353620713s) [upload=266109]: Uploading segments... Aug 19 09:02:36.394805378 (255h36m58.353902628s) [upload=266109]: Got next segment. Inline: false Aug 19 09:02:36.394915711 (255h36m58.354012969s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:02:36.394922533 (255h36m58.354019789s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:02:36.614449395 (255h36m58.57354665s) [upload=266109]: Next segment err: metaclient: Too Many Requests Aug 19 09:02:36.614484753 (255h36m58.57358201s) [upload=266109]: Done uploading segments... Aug 19 09:02:36.614503483 (255h36m58.573600734s) [upload=266109]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.415891507s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [............X...X...............X..........XX.X.............] duration:
831.752441ms
FAIL (2025-08-19 09:09:54 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:01:05.205958715 (255h35m27.165055967s) [upload=266084]: Starting upload Aug 19 09:01:05.206033225 (255h35m27.165130463s) [upload=266084]: Done starting upload Aug 19 09:01:05.206121111 (255h35m27.165218354s) [upload=266084]: Uploading segments... Aug 19 09:01:05.206181918 (255h35m27.165279173s) [upload=266084]: Got next segment. Inline: true Aug 19 09:01:05.206188327 (255h35m27.165285583s) [upload=266084]: Waiting for error group managing segments... Aug 19 09:01:05.206241862 (255h35m27.165339097s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:05.206250212 (255h35m27.165347466s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:01:05.206254764 (255h35m27.165352019s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:01:06.648466516 (255h35m28.607563768s) [upload=266084]: Done uploading segments... Aug 19 09:01:06.648492741 (255h35m28.60758998s) [upload=266084]: Upload finished. err: <nil>
Duration: 831.787142ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X............X............................X........] duration:
2.320666495s
FAIL (2025-08-19 09:09:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:02:36.394252422 (255h36m58.353349679s) [upload=266109]: Starting upload Aug 19 09:02:36.394344280 (255h36m58.353441537s) [upload=266109]: Done starting upload Aug 19 09:02:36.394523445 (255h36m58.353620713s) [upload=266109]: Uploading segments... Aug 19 09:02:36.394805378 (255h36m58.353902628s) [upload=266109]: Got next segment. Inline: false Aug 19 09:02:36.394915711 (255h36m58.354012969s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:02:36.394922533 (255h36m58.354019789s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:02:36.614449395 (255h36m58.57354665s) [upload=266109]: Next segment err: metaclient: Too Many Requests Aug 19 09:02:36.614484753 (255h36m58.57358201s) [upload=266109]: Done uploading segments... Aug 19 09:02:36.614503483 (255h36m58.573600734s) [upload=266109]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.32069748s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.............X...X...............X..........XX.X............] duration:
1.920841609s
FAIL (2025-08-19 09:08:54 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:01:05.205958715 (255h35m27.165055967s) [upload=266084]: Starting upload Aug 19 09:01:05.206033225 (255h35m27.165130463s) [upload=266084]: Done starting upload Aug 19 09:01:05.206121111 (255h35m27.165218354s) [upload=266084]: Uploading segments... Aug 19 09:01:05.206181918 (255h35m27.165279173s) [upload=266084]: Got next segment. Inline: true Aug 19 09:01:05.206188327 (255h35m27.165285583s) [upload=266084]: Waiting for error group managing segments... Aug 19 09:01:05.206241862 (255h35m27.165339097s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:05.206250212 (255h35m27.165347466s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:01:05.206254764 (255h35m27.165352019s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:01:06.648466516 (255h35m28.607563768s) [upload=266084]: Done uploading segments... Aug 19 09:01:06.648492741 (255h35m28.60758998s) [upload=266084]: Upload finished. err: <nil>
Duration: 1.920890745s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X............X............................X.......] duration:
2.310468196s
FAIL (2025-08-19 09:08:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:02:36.394252422 (255h36m58.353349679s) [upload=266109]: Starting upload Aug 19 09:02:36.394344280 (255h36m58.353441537s) [upload=266109]: Done starting upload Aug 19 09:02:36.394523445 (255h36m58.353620713s) [upload=266109]: Uploading segments... Aug 19 09:02:36.394805378 (255h36m58.353902628s) [upload=266109]: Got next segment. Inline: false Aug 19 09:02:36.394915711 (255h36m58.354012969s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:02:36.394922533 (255h36m58.354019789s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:02:36.614449395 (255h36m58.57354665s) [upload=266109]: Next segment err: metaclient: Too Many Requests Aug 19 09:02:36.614484753 (255h36m58.57358201s) [upload=266109]: Done uploading segments... Aug 19 09:02:36.614503483 (255h36m58.573600734s) [upload=266109]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.310502779s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..............X...X...............X..........XX.X...........] duration:
793.268515ms
FAIL (2025-08-19 09:07:59 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:01:05.205958715 (255h35m27.165055967s) [upload=266084]: Starting upload Aug 19 09:01:05.206033225 (255h35m27.165130463s) [upload=266084]: Done starting upload Aug 19 09:01:05.206121111 (255h35m27.165218354s) [upload=266084]: Uploading segments... Aug 19 09:01:05.206181918 (255h35m27.165279173s) [upload=266084]: Got next segment. Inline: true Aug 19 09:01:05.206188327 (255h35m27.165285583s) [upload=266084]: Waiting for error group managing segments... Aug 19 09:01:05.206241862 (255h35m27.165339097s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:05.206250212 (255h35m27.165347466s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:01:05.206254764 (255h35m27.165352019s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:01:06.648466516 (255h35m28.607563768s) [upload=266084]: Done uploading segments... Aug 19 09:01:06.648492741 (255h35m28.60758998s) [upload=266084]: Upload finished. err: <nil>
Duration: 793.304531ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X............X............................X......] duration:
2.29606163s
FAIL (2025-08-19 09:07:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:02:36.394252422 (255h36m58.353349679s) [upload=266109]: Starting upload Aug 19 09:02:36.394344280 (255h36m58.353441537s) [upload=266109]: Done starting upload Aug 19 09:02:36.394523445 (255h36m58.353620713s) [upload=266109]: Uploading segments... Aug 19 09:02:36.394805378 (255h36m58.353902628s) [upload=266109]: Got next segment. Inline: false Aug 19 09:02:36.394915711 (255h36m58.354012969s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:02:36.394922533 (255h36m58.354019789s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:02:36.614449395 (255h36m58.57354665s) [upload=266109]: Next segment err: metaclient: Too Many Requests Aug 19 09:02:36.614484753 (255h36m58.57358201s) [upload=266109]: Done uploading segments... Aug 19 09:02:36.614503483 (255h36m58.573600734s) [upload=266109]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.296113542s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...............X...X...............X..........XX.X..........] duration:
1.627913007s
FAIL (2025-08-19 09:07:18 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:01:05.205958715 (255h35m27.165055967s) [upload=266084]: Starting upload Aug 19 09:01:05.206033225 (255h35m27.165130463s) [upload=266084]: Done starting upload Aug 19 09:01:05.206121111 (255h35m27.165218354s) [upload=266084]: Uploading segments... Aug 19 09:01:05.206181918 (255h35m27.165279173s) [upload=266084]: Got next segment. Inline: true Aug 19 09:01:05.206188327 (255h35m27.165285583s) [upload=266084]: Waiting for error group managing segments... Aug 19 09:01:05.206241862 (255h35m27.165339097s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:05.206250212 (255h35m27.165347466s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:01:05.206254764 (255h35m27.165352019s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:01:06.648466516 (255h35m28.607563768s) [upload=266084]: Done uploading segments... Aug 19 09:01:06.648492741 (255h35m28.60758998s) [upload=266084]: Upload finished. err: <nil>
Duration: 1.627947774s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [................X...X...............X..........XX.X.........] duration:
945.097266ms
FAIL (2025-08-19 09:06:50 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:01:05.205958715 (255h35m27.165055967s) [upload=266084]: Starting upload Aug 19 09:01:05.206033225 (255h35m27.165130463s) [upload=266084]: Done starting upload Aug 19 09:01:05.206121111 (255h35m27.165218354s) [upload=266084]: Uploading segments... Aug 19 09:01:05.206181918 (255h35m27.165279173s) [upload=266084]: Got next segment. Inline: true Aug 19 09:01:05.206188327 (255h35m27.165285583s) [upload=266084]: Waiting for error group managing segments... Aug 19 09:01:05.206241862 (255h35m27.165339097s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:05.206250212 (255h35m27.165347466s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:01:05.206254764 (255h35m27.165352019s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:01:06.648466516 (255h35m28.607563768s) [upload=266084]: Done uploading segments... Aug 19 09:01:06.648492741 (255h35m28.60758998s) [upload=266084]: Upload finished. err: <nil>
Duration: 945.232144ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X............X............................X.....] duration:
2.491579622s
FAIL (2025-08-19 09:06:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:02:36.394252422 (255h36m58.353349679s) [upload=266109]: Starting upload Aug 19 09:02:36.394344280 (255h36m58.353441537s) [upload=266109]: Done starting upload Aug 19 09:02:36.394523445 (255h36m58.353620713s) [upload=266109]: Uploading segments... Aug 19 09:02:36.394805378 (255h36m58.353902628s) [upload=266109]: Got next segment. Inline: false Aug 19 09:02:36.394915711 (255h36m58.354012969s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:02:36.394922533 (255h36m58.354019789s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:02:36.614449395 (255h36m58.57354665s) [upload=266109]: Next segment err: metaclient: Too Many Requests Aug 19 09:02:36.614484753 (255h36m58.57358201s) [upload=266109]: Done uploading segments... Aug 19 09:02:36.614503483 (255h36m58.573600734s) [upload=266109]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.491674593s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.................X...X...............X..........XX.X........] duration:
825.80596ms
FAIL (2025-08-19 09:05:57 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:01:05.205958715 (255h35m27.165055967s) [upload=266084]: Starting upload Aug 19 09:01:05.206033225 (255h35m27.165130463s) [upload=266084]: Done starting upload Aug 19 09:01:05.206121111 (255h35m27.165218354s) [upload=266084]: Uploading segments... Aug 19 09:01:05.206181918 (255h35m27.165279173s) [upload=266084]: Got next segment. Inline: true Aug 19 09:01:05.206188327 (255h35m27.165285583s) [upload=266084]: Waiting for error group managing segments... Aug 19 09:01:05.206241862 (255h35m27.165339097s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:05.206250212 (255h35m27.165347466s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:01:05.206254764 (255h35m27.165352019s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:01:06.648466516 (255h35m28.607563768s) [upload=266084]: Done uploading segments... Aug 19 09:01:06.648492741 (255h35m28.60758998s) [upload=266084]: Upload finished. err: <nil>
Duration: 825.836709ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X............X............................X....] duration:
2.375327864s
FAIL (2025-08-19 09:05:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:02:36.394252422 (255h36m58.353349679s) [upload=266109]: Starting upload Aug 19 09:02:36.394344280 (255h36m58.353441537s) [upload=266109]: Done starting upload Aug 19 09:02:36.394523445 (255h36m58.353620713s) [upload=266109]: Uploading segments... Aug 19 09:02:36.394805378 (255h36m58.353902628s) [upload=266109]: Got next segment. Inline: false Aug 19 09:02:36.394915711 (255h36m58.354012969s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:02:36.394922533 (255h36m58.354019789s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:02:36.614449395 (255h36m58.57354665s) [upload=266109]: Next segment err: metaclient: Too Many Requests Aug 19 09:02:36.614484753 (255h36m58.57358201s) [upload=266109]: Done uploading segments... Aug 19 09:02:36.614503483 (255h36m58.573600734s) [upload=266109]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.375371046s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..................X...X...............X..........XX.X.......] duration:
961.698114ms
FAIL (2025-08-19 09:05:25 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:01:05.205958715 (255h35m27.165055967s) [upload=266084]: Starting upload Aug 19 09:01:05.206033225 (255h35m27.165130463s) [upload=266084]: Done starting upload Aug 19 09:01:05.206121111 (255h35m27.165218354s) [upload=266084]: Uploading segments... Aug 19 09:01:05.206181918 (255h35m27.165279173s) [upload=266084]: Got next segment. Inline: true Aug 19 09:01:05.206188327 (255h35m27.165285583s) [upload=266084]: Waiting for error group managing segments... Aug 19 09:01:05.206241862 (255h35m27.165339097s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:05.206250212 (255h35m27.165347466s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:01:05.206254764 (255h35m27.165352019s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:01:06.648466516 (255h35m28.607563768s) [upload=266084]: Done uploading segments... Aug 19 09:01:06.648492741 (255h35m28.60758998s) [upload=266084]: Upload finished. err: <nil>
Duration: 961.729106ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X............X............................X...] duration:
2.426321262s
FAIL (2025-08-19 09:04:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:02:36.394252422 (255h36m58.353349679s) [upload=266109]: Starting upload Aug 19 09:02:36.394344280 (255h36m58.353441537s) [upload=266109]: Done starting upload Aug 19 09:02:36.394523445 (255h36m58.353620713s) [upload=266109]: Uploading segments... Aug 19 09:02:36.394805378 (255h36m58.353902628s) [upload=266109]: Got next segment. Inline: false Aug 19 09:02:36.394915711 (255h36m58.354012969s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:02:36.394922533 (255h36m58.354019789s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:02:36.614449395 (255h36m58.57354665s) [upload=266109]: Next segment err: metaclient: Too Many Requests Aug 19 09:02:36.614484753 (255h36m58.57358201s) [upload=266109]: Done uploading segments... Aug 19 09:02:36.614503483 (255h36m58.573600734s) [upload=266109]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.426356977s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...................X...X...............X..........XX.X......] duration:
991.234977ms
FAIL (2025-08-19 09:04:36 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:01:05.205958715 (255h35m27.165055967s) [upload=266084]: Starting upload Aug 19 09:01:05.206033225 (255h35m27.165130463s) [upload=266084]: Done starting upload Aug 19 09:01:05.206121111 (255h35m27.165218354s) [upload=266084]: Uploading segments... Aug 19 09:01:05.206181918 (255h35m27.165279173s) [upload=266084]: Got next segment. Inline: true Aug 19 09:01:05.206188327 (255h35m27.165285583s) [upload=266084]: Waiting for error group managing segments... Aug 19 09:01:05.206241862 (255h35m27.165339097s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:05.206250212 (255h35m27.165347466s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:01:05.206254764 (255h35m27.165352019s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:01:06.648466516 (255h35m28.607563768s) [upload=266084]: Done uploading segments... Aug 19 09:01:06.648492741 (255h35m28.60758998s) [upload=266084]: Upload finished. err: <nil>
Duration: 991.272039ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [....................X...X...............X..........XX.X.....] duration:
842.09244ms
FAIL (2025-08-19 09:04:00 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:01:05.205958715 (255h35m27.165055967s) [upload=266084]: Starting upload Aug 19 09:01:05.206033225 (255h35m27.165130463s) [upload=266084]: Done starting upload Aug 19 09:01:05.206121111 (255h35m27.165218354s) [upload=266084]: Uploading segments... Aug 19 09:01:05.206181918 (255h35m27.165279173s) [upload=266084]: Got next segment. Inline: true Aug 19 09:01:05.206188327 (255h35m27.165285583s) [upload=266084]: Waiting for error group managing segments... Aug 19 09:01:05.206241862 (255h35m27.165339097s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:05.206250212 (255h35m27.165347466s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:01:05.206254764 (255h35m27.165352019s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:01:06.648466516 (255h35m28.607563768s) [upload=266084]: Done uploading segments... Aug 19 09:01:06.648492741 (255h35m28.60758998s) [upload=266084]: Upload finished. err: <nil>
Duration: 842.128478ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X............X............................X..] duration:
2.337476835s
FAIL (2025-08-19 09:03:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:02:36.394252422 (255h36m58.353349679s) [upload=266109]: Starting upload Aug 19 09:02:36.394344280 (255h36m58.353441537s) [upload=266109]: Done starting upload Aug 19 09:02:36.394523445 (255h36m58.353620713s) [upload=266109]: Uploading segments... Aug 19 09:02:36.394805378 (255h36m58.353902628s) [upload=266109]: Got next segment. Inline: false Aug 19 09:02:36.394915711 (255h36m58.354012969s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:02:36.394922533 (255h36m58.354019789s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:02:36.614449395 (255h36m58.57354665s) [upload=266109]: Next segment err: metaclient: Too Many Requests Aug 19 09:02:36.614484753 (255h36m58.57358201s) [upload=266109]: Done uploading segments... Aug 19 09:02:36.614503483 (255h36m58.573600734s) [upload=266109]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.337533993s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....................X...X...............X..........XX.X....] duration:
869.589303ms
FAIL (2025-08-19 09:03:40 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:01:05.205958715 (255h35m27.165055967s) [upload=266084]: Starting upload Aug 19 09:01:05.206033225 (255h35m27.165130463s) [upload=266084]: Done starting upload Aug 19 09:01:05.206121111 (255h35m27.165218354s) [upload=266084]: Uploading segments... Aug 19 09:01:05.206181918 (255h35m27.165279173s) [upload=266084]: Got next segment. Inline: true Aug 19 09:01:05.206188327 (255h35m27.165285583s) [upload=266084]: Waiting for error group managing segments... Aug 19 09:01:05.206241862 (255h35m27.165339097s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:05.206250212 (255h35m27.165347466s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:01:05.206254764 (255h35m27.165352019s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:01:06.648466516 (255h35m28.607563768s) [upload=266084]: Done uploading segments... Aug 19 09:01:06.648492741 (255h35m28.60758998s) [upload=266084]: Upload finished. err: <nil>
Duration: 869.621674ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X............X............................X.] duration:
2.401082771s
FAIL (2025-08-19 09:03:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:02:36.394252422 (255h36m58.353349679s) [upload=266109]: Starting upload Aug 19 09:02:36.394344280 (255h36m58.353441537s) [upload=266109]: Done starting upload Aug 19 09:02:36.394523445 (255h36m58.353620713s) [upload=266109]: Uploading segments... Aug 19 09:02:36.394805378 (255h36m58.353902628s) [upload=266109]: Got next segment. Inline: false Aug 19 09:02:36.394915711 (255h36m58.354012969s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:02:36.394922533 (255h36m58.354019789s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:02:36.614449395 (255h36m58.57354665s) [upload=266109]: Next segment err: metaclient: Too Many Requests Aug 19 09:02:36.614484753 (255h36m58.57358201s) [upload=266109]: Done uploading segments... Aug 19 09:02:36.614503483 (255h36m58.573600734s) [upload=266109]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.401116414s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [......................X...X...............X..........XX.X...] duration:
821.274722ms
FAIL (2025-08-19 09:02:48 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:01:05.205958715 (255h35m27.165055967s) [upload=266084]: Starting upload Aug 19 09:01:05.206033225 (255h35m27.165130463s) [upload=266084]: Done starting upload Aug 19 09:01:05.206121111 (255h35m27.165218354s) [upload=266084]: Uploading segments... Aug 19 09:01:05.206181918 (255h35m27.165279173s) [upload=266084]: Got next segment. Inline: true Aug 19 09:01:05.206188327 (255h35m27.165285583s) [upload=266084]: Waiting for error group managing segments... Aug 19 09:01:05.206241862 (255h35m27.165339097s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:05.206250212 (255h35m27.165347466s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:01:05.206254764 (255h35m27.165352019s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:01:06.648466516 (255h35m28.607563768s) [upload=266084]: Done uploading segments... Aug 19 09:01:06.648492741 (255h35m28.60758998s) [upload=266084]: Upload finished. err: <nil>
Duration: 821.310043ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X............X............................X] duration:
654.40806ms
FAIL (2025-08-19 09:02:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:02:36.394252422 (255h36m58.353349679s) [upload=266109]: Starting upload Aug 19 09:02:36.394344280 (255h36m58.353441537s) [upload=266109]: Done starting upload Aug 19 09:02:36.394523445 (255h36m58.353620713s) [upload=266109]: Uploading segments... Aug 19 09:02:36.394805378 (255h36m58.353902628s) [upload=266109]: Got next segment. Inline: false Aug 19 09:02:36.394915711 (255h36m58.354012969s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:02:36.394922533 (255h36m58.354019789s) [upload=266109]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:02:36.614449395 (255h36m58.57354665s) [upload=266109]: Next segment err: metaclient: Too Many Requests Aug 19 09:02:36.614484753 (255h36m58.57358201s) [upload=266109]: Done uploading segments... Aug 19 09:02:36.614503483 (255h36m58.573600734s) [upload=266109]: Upload finished. err: metaclient: Too Many Requests
Duration: 654.435608ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......................X...X...............X..........XX.X..] duration:
1.732732228s
FAIL (2025-08-19 09:01:57 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:01:05.205958715 (255h35m27.165055967s) [upload=266084]: Starting upload Aug 19 09:01:05.206033225 (255h35m27.165130463s) [upload=266084]: Done starting upload Aug 19 09:01:05.206121111 (255h35m27.165218354s) [upload=266084]: Uploading segments... Aug 19 09:01:05.206181918 (255h35m27.165279173s) [upload=266084]: Got next segment. Inline: true Aug 19 09:01:05.206188327 (255h35m27.165285583s) [upload=266084]: Waiting for error group managing segments... Aug 19 09:01:05.206241862 (255h35m27.165339097s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:05.206250212 (255h35m27.165347466s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:01:05.206254764 (255h35m27.165352019s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:01:06.648466516 (255h35m28.607563768s) [upload=266084]: Done uploading segments... Aug 19 09:01:06.648492741 (255h35m28.60758998s) [upload=266084]: Upload finished. err: <nil>
Duration: 1.732841985s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X............X............................] duration:
3.121593746s
FAIL (2025-08-19 09:01:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 08:41:27.346256472 (255h15m49.305353727s) [upload=265737]: Starting upload
Aug 19 08:41:27.346339100 (255h15m49.305436351s) [upload=265737]: Done starting upload
Aug 19 08:41:27.346458386 (255h15m49.305555625s) [upload=265737]: Uploading segments...
Aug 19 08:41:27.346939011 (255h15m49.306036257s) [upload=265737]: Got next segment. Inline: false
Aug 19 08:41:27.346993157 (255h15m49.306090401s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 08:41:27.346998430 (255h15m49.306095661s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 08:41:27.539991574 (255h15m49.49908883s) [seg_pos={0 0}, upload=265737]: Begin upload segment...
Aug 19 08:41:27.540057671 (255h15m49.499154923s) [seg_pos={0 0}, upload=265737]: Done begin upload segment.
Aug 19 08:41:27.540113635 (255h15m49.499210893s) [noise=true , address=77.90.31.14:4677 , piece_id=IPUFOEWHJ6PKISQ7Z3AEGWMXWEXZZK6L5OTQOUTYCUTUKJDD5IDA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.540876878 (255h15m49.499974132s) [noise=true , address=104.36.82.18:4378 , piece_id=UANL4E7NVNNUNKH2TGPCBCQCDZCUL5W6RAZEF2Q6QEDPL4RZDS7Q, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.540961331 (255h15m49.500058589s) [noise=true , address=45.91.116.9:4282 , piece_id=M74Y5RS3W6WW4VL6XVXM6NS7RBOE3CESGU3XF3X3M3OYIHOCYWJA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.541360776 (255h15m49.500458034s) [noise=true , address=79.127.205.234:4593 , piece_id=WZ6A7FUGC7O7VDZ4W42S653OYSUNKXE4XX6H5AEW7JBRFHZZJCSA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.541440247 (255h15m49.500537504s) [noise=true , address=77.90.31.10:4538 , piece_id=56BNCJDLOPD6OOGE2M5MEKPE2PXXXP3KH6VRHJQE4VC33VDULQUQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.542104935 (255h15m49.501202182s) [noise=true , address=77.90.31.17:4779 , piece_id=OAB27ZXCI6P7QU7ZCFP3T4R7SVFFEHXYRSE2FWJS7BORH2TVIOIA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.542347684 (255h15m49.501444945s) [noise=true , address=77.90.31.21:4897 , piece_id=JWYXX5WASZXDBJSE6RM7BHAJTBYBHBXBYSMJKCGHXRTZ2P2JS2TQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.543147248 (255h15m49.502244503s) [noise=true , address=104.36.82.5:4844 , piece_id=XAJ2AWEZBPDN2IKYUEJ7CKRLQSM7CUFSL4DRD57WWRA7H56WIRBA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.543565022 (255h15m49.502662277s) [noise=true , address=77.90.31.16:4756 , piece_id=WTVHPH2DDWD6UBRAE34EVXXETV4GURPBLDGNPC6TERTNO7M3L66Q, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.544298424 (255h15m49.50339568s) [noise=true , address=77.90.31.12:4618 , piece_id=WR6I5CASXCE2EGPVIH4XZ2PQFHK23CPKGXLY6TPC6QJHBV7CW6WQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.544840699 (255h15m49.503938005s) [noise=true , address=79.127.219.47:4063 , piece_id=TKI3LNO4UKFEI7SIRQJMOKAMQXARGQP4UHREHSBMTAUOWVJHFLHA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.545625282 (255h15m49.504722537s) [noise=true , address=104.36.82.49:4998 , piece_id=4BFDCKWI4E3TX5PB6CFNIVBCROLXUFP2LSWYVW547MY52RWDQZQQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.546143218 (255h15m49.505240464s) [noise=true , address=45.91.116.11:4144 , piece_id=C34UHCS25TXACKNURIURFHV47XYBO7I5MLFYDS6DKT7FLMNGOERQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.549024549 (255h15m49.508121805s) [noise=true , address=104.36.82.23:4461 , piece_id=NURSR5X7QWITNBHOYY3G3UHEHHPQZJ4STDMK2BT273SLXS5CZMWQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.549859067 (255h15m49.508956331s) [noise=true , address=104.36.82.60:4363 , piece_id=G3ROG6GDAXODLAITFPYZFZ4ENID2WQT6KS6KR667JHSE75PXNAIA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.550398165 (255h15m49.50949542s) [noise=true , address=66.23.193.175:4555 , piece_id=EOT4ZMGJ6ZKCANZMH5AYQGPCLVRWMYXT7WUD4TKFFVGRK2FHKFQA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.551882299 (255h15m49.510979556s) [noise=true , address=104.36.82.44:4899 , piece_id=RZPOLPMETQ6VG6XQBKZB4HUEOIXDLVH6NK6D4N4KWSMMYET3WKJQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.552424053 (255h15m49.51152131s) [noise=true , address=45.91.116.5:4305 , piece_id=4QCAF7NFEA57ALBEVC4LPQKI7MCZKCOMFRQNTROVEGI6G4PQHLHA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:28.102865369 (255h15m50.061962625s) [upload=265737]: Next returned nil segment
Aug 19 08:41:28.102891945 (255h15m50.061989202s) [upload=265737]: Waiting for error group managing segments...
Aug 19 08:41:28.265009741 (255h15m50.224106974s) [noise=true , address=45.91.116.11:4144 , piece_id=C34UHCS25TXACKNURIURFHV47XYBO7I5MLFYDS6DKT7FLMNGOERQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.265690187 (255h15m50.224787423s) [noise=true , address=77.90.31.21:4897 , piece_id=JWYXX5WASZXDBJSE6RM7BHAJTBYBHBXBYSMJKCGHXRTZ2P2JS2TQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.274487420 (255h15m50.233584659s) [noise=true , address=79.127.219.47:4063 , piece_id=TKI3LNO4UKFEI7SIRQJMOKAMQXARGQP4UHREHSBMTAUOWVJHFLHA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.284608512 (255h15m50.243705749s) [noise=true , address=77.90.31.10:4538 , piece_id=56BNCJDLOPD6OOGE2M5MEKPE2PXXXP3KH6VRHJQE4VC33VDULQUQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.288622153 (255h15m50.247719405s) [noise=true , address=104.36.82.5:4844 , piece_id=XAJ2AWEZBPDN2IKYUEJ7CKRLQSM7CUFSL4DRD57WWRA7H56WIRBA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.292444612 (255h15m50.251541844s) [noise=true , address=104.36.82.60:4363 , piece_id=G3ROG6GDAXODLAITFPYZFZ4ENID2WQT6KS6KR667JHSE75PXNAIA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.293084440 (255h15m50.252181686s) [noise=true , address=77.90.31.17:4779 , piece_id=OAB27ZXCI6P7QU7ZCFP3T4R7SVFFEHXYRSE2FWJS7BORH2TVIOIA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.298202589 (255h15m50.25729984s) [noise=true , address=45.91.116.9:4282 , piece_id=M74Y5RS3W6WW4VL6XVXM6NS7RBOE3CESGU3XF3X3M3OYIHOCYWJA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.303719954 (255h15m50.2628172s) [noise=true , address=77.90.31.12:4618 , piece_id=WR6I5CASXCE2EGPVIH4XZ2PQFHK23CPKGXLY6TPC6QJHBV7CW6WQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.305841026 (255h15m50.264938277s) [noise=true , address=104.36.82.49:4998 , piece_id=4BFDCKWI4E3TX5PB6CFNIVBCROLXUFP2LSWYVW547MY52RWDQZQQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.313362648 (255h15m50.272459885s) [noise=true , address=104.36.82.23:4461 , piece_id=NURSR5X7QWITNBHOYY3G3UHEHHPQZJ4STDMK2BT273SLXS5CZMWQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.332987887 (255h15m50.292085139s) [noise=true , address=77.90.31.14:4677 , piece_id=IPUFOEWHJ6PKISQ7Z3AEGWMXWEXZZK6L5OTQOUTYCUTUKJDD5IDA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.334549262 (255h15m50.293646499s) [noise=true , address=104.36.82.44:4899 , piece_id=RZPOLPMETQ6VG6XQBKZB4HUEOIXDLVH6NK6D4N4KWSMMYET3WKJQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.355087609 (255h15m50.314184868s) [noise=true , address=77.90.31.16:4756 , piece_id=WTVHPH2DDWD6UBRAE34EVXXETV4GURPBLDGNPC6TERTNO7M3L66Q, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.355129335 (255h15m50.314226582s) [seg_pos={0 0}, upload=265737]: Segment reached optimal threshold of 14 pieces.
Aug 19 08:41:28.355425379 (255h15m50.314522631s) [noise=true , address=104.36.82.18:4378 , piece_id=UANL4E7NVNNUNKH2TGPCBCQCDZCUL5W6RAZEF2Q6QEDPL4RZDS7Q, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13NZR1Ah43qF6pvFdUpwSrJiCx1HZf3Rb1zwRaPs6tv6inUaQi): protocol: expected piece hash; context canceled; EOF
Aug 19 08:41:28.355492405 (255h15m50.314589651s) [noise=true , address=66.23.193.175:4555 , piece_id=EOT4ZMGJ6ZKCANZMH5AYQGPCLVRWMYXT7WUD4TKFFVGRK2FHKFQA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:33148->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:33148->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->66.23.193.175:4555: use of closed network connection
Aug 19 08:41:28.355617325 (255h15m50.314714571s) [noise=true , address=79.127.205.234:4593 , piece_id=WZ6A7FUGC7O7VDZ4W42S653OYSUNKXE4XX6H5AEW7JBRFHZZJCSA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeX2Yw26im6siYq7rdihU8Aem9xUHuy6SEbss5uzLFTJEHikk): protocol: write tcp 139.59.144.22:58684->79.127.205.234:4593: use of closed network connection; write tcp 139.59.144.22:58684->79.127.205.234:4593: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58684->79.127.205.234:4593: use of closed network connection
Aug 19 08:41:28.355637483 (255h15m50.31473472s) [noise=true , address=45.91.116.5:4305 , piece_id=4QCAF7NFEA57ALBEVC4LPQKI7MCZKCOMFRQNTROVEGI6G4PQHLHA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1): protocol: write tcp 139.59.144.22:36064->45.91.116.5:4305: use of closed network connection; write tcp 139.59.144.22:36064->45.91.116.5:4305: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36064->45.91.116.5:4305: use of closed network connection
Aug 19 08:41:28.355654827 (255h15m50.314752063s) [seg_pos={0 0}, upload=265737]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 08:41:28.355790237 (255h15m50.314887498s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 08:41:28.355797459 (255h15m50.314894707s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 08:41:28.510239333 (255h15m50.469336617s) [upload=265737]: Done uploading segments...
Aug 19 08:41:28.510265166 (255h15m50.469362438s) [upload=265737]: Upload finished. err: <nil>
Duration: 3.121626448s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........................X...X...............X..........XX.X.] duration:
1.674969144s
FAIL (2025-08-19 09:01:42 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:01:05.205958715 (255h35m27.165055967s) [upload=266084]: Starting upload Aug 19 09:01:05.206033225 (255h35m27.165130463s) [upload=266084]: Done starting upload Aug 19 09:01:05.206121111 (255h35m27.165218354s) [upload=266084]: Uploading segments... Aug 19 09:01:05.206181918 (255h35m27.165279173s) [upload=266084]: Got next segment. Inline: true Aug 19 09:01:05.206188327 (255h35m27.165285583s) [upload=266084]: Waiting for error group managing segments... Aug 19 09:01:05.206241862 (255h35m27.165339097s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:05.206250212 (255h35m27.165347466s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:01:05.206254764 (255h35m27.165352019s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:01:06.648466516 (255h35m28.607563768s) [upload=266084]: Done uploading segments... Aug 19 09:01:06.648492741 (255h35m28.60758998s) [upload=266084]: Upload finished. err: <nil>
Duration: 1.675079331s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X............X...........................] duration:
2.644505005s
FAIL (2025-08-19 09:01:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 08:41:27.346256472 (255h15m49.305353727s) [upload=265737]: Starting upload
Aug 19 08:41:27.346339100 (255h15m49.305436351s) [upload=265737]: Done starting upload
Aug 19 08:41:27.346458386 (255h15m49.305555625s) [upload=265737]: Uploading segments...
Aug 19 08:41:27.346939011 (255h15m49.306036257s) [upload=265737]: Got next segment. Inline: false
Aug 19 08:41:27.346993157 (255h15m49.306090401s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 08:41:27.346998430 (255h15m49.306095661s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 08:41:27.539991574 (255h15m49.49908883s) [seg_pos={0 0}, upload=265737]: Begin upload segment...
Aug 19 08:41:27.540057671 (255h15m49.499154923s) [seg_pos={0 0}, upload=265737]: Done begin upload segment.
Aug 19 08:41:27.540113635 (255h15m49.499210893s) [noise=true , address=77.90.31.14:4677 , piece_id=IPUFOEWHJ6PKISQ7Z3AEGWMXWEXZZK6L5OTQOUTYCUTUKJDD5IDA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.540876878 (255h15m49.499974132s) [noise=true , address=104.36.82.18:4378 , piece_id=UANL4E7NVNNUNKH2TGPCBCQCDZCUL5W6RAZEF2Q6QEDPL4RZDS7Q, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.540961331 (255h15m49.500058589s) [noise=true , address=45.91.116.9:4282 , piece_id=M74Y5RS3W6WW4VL6XVXM6NS7RBOE3CESGU3XF3X3M3OYIHOCYWJA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.541360776 (255h15m49.500458034s) [noise=true , address=79.127.205.234:4593 , piece_id=WZ6A7FUGC7O7VDZ4W42S653OYSUNKXE4XX6H5AEW7JBRFHZZJCSA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.541440247 (255h15m49.500537504s) [noise=true , address=77.90.31.10:4538 , piece_id=56BNCJDLOPD6OOGE2M5MEKPE2PXXXP3KH6VRHJQE4VC33VDULQUQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.542104935 (255h15m49.501202182s) [noise=true , address=77.90.31.17:4779 , piece_id=OAB27ZXCI6P7QU7ZCFP3T4R7SVFFEHXYRSE2FWJS7BORH2TVIOIA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.542347684 (255h15m49.501444945s) [noise=true , address=77.90.31.21:4897 , piece_id=JWYXX5WASZXDBJSE6RM7BHAJTBYBHBXBYSMJKCGHXRTZ2P2JS2TQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.543147248 (255h15m49.502244503s) [noise=true , address=104.36.82.5:4844 , piece_id=XAJ2AWEZBPDN2IKYUEJ7CKRLQSM7CUFSL4DRD57WWRA7H56WIRBA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.543565022 (255h15m49.502662277s) [noise=true , address=77.90.31.16:4756 , piece_id=WTVHPH2DDWD6UBRAE34EVXXETV4GURPBLDGNPC6TERTNO7M3L66Q, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.544298424 (255h15m49.50339568s) [noise=true , address=77.90.31.12:4618 , piece_id=WR6I5CASXCE2EGPVIH4XZ2PQFHK23CPKGXLY6TPC6QJHBV7CW6WQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.544840699 (255h15m49.503938005s) [noise=true , address=79.127.219.47:4063 , piece_id=TKI3LNO4UKFEI7SIRQJMOKAMQXARGQP4UHREHSBMTAUOWVJHFLHA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.545625282 (255h15m49.504722537s) [noise=true , address=104.36.82.49:4998 , piece_id=4BFDCKWI4E3TX5PB6CFNIVBCROLXUFP2LSWYVW547MY52RWDQZQQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.546143218 (255h15m49.505240464s) [noise=true , address=45.91.116.11:4144 , piece_id=C34UHCS25TXACKNURIURFHV47XYBO7I5MLFYDS6DKT7FLMNGOERQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.549024549 (255h15m49.508121805s) [noise=true , address=104.36.82.23:4461 , piece_id=NURSR5X7QWITNBHOYY3G3UHEHHPQZJ4STDMK2BT273SLXS5CZMWQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.549859067 (255h15m49.508956331s) [noise=true , address=104.36.82.60:4363 , piece_id=G3ROG6GDAXODLAITFPYZFZ4ENID2WQT6KS6KR667JHSE75PXNAIA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.550398165 (255h15m49.50949542s) [noise=true , address=66.23.193.175:4555 , piece_id=EOT4ZMGJ6ZKCANZMH5AYQGPCLVRWMYXT7WUD4TKFFVGRK2FHKFQA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.551882299 (255h15m49.510979556s) [noise=true , address=104.36.82.44:4899 , piece_id=RZPOLPMETQ6VG6XQBKZB4HUEOIXDLVH6NK6D4N4KWSMMYET3WKJQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.552424053 (255h15m49.51152131s) [noise=true , address=45.91.116.5:4305 , piece_id=4QCAF7NFEA57ALBEVC4LPQKI7MCZKCOMFRQNTROVEGI6G4PQHLHA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:28.102865369 (255h15m50.061962625s) [upload=265737]: Next returned nil segment
Aug 19 08:41:28.102891945 (255h15m50.061989202s) [upload=265737]: Waiting for error group managing segments...
Aug 19 08:41:28.265009741 (255h15m50.224106974s) [noise=true , address=45.91.116.11:4144 , piece_id=C34UHCS25TXACKNURIURFHV47XYBO7I5MLFYDS6DKT7FLMNGOERQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.265690187 (255h15m50.224787423s) [noise=true , address=77.90.31.21:4897 , piece_id=JWYXX5WASZXDBJSE6RM7BHAJTBYBHBXBYSMJKCGHXRTZ2P2JS2TQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.274487420 (255h15m50.233584659s) [noise=true , address=79.127.219.47:4063 , piece_id=TKI3LNO4UKFEI7SIRQJMOKAMQXARGQP4UHREHSBMTAUOWVJHFLHA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.284608512 (255h15m50.243705749s) [noise=true , address=77.90.31.10:4538 , piece_id=56BNCJDLOPD6OOGE2M5MEKPE2PXXXP3KH6VRHJQE4VC33VDULQUQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.288622153 (255h15m50.247719405s) [noise=true , address=104.36.82.5:4844 , piece_id=XAJ2AWEZBPDN2IKYUEJ7CKRLQSM7CUFSL4DRD57WWRA7H56WIRBA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.292444612 (255h15m50.251541844s) [noise=true , address=104.36.82.60:4363 , piece_id=G3ROG6GDAXODLAITFPYZFZ4ENID2WQT6KS6KR667JHSE75PXNAIA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.293084440 (255h15m50.252181686s) [noise=true , address=77.90.31.17:4779 , piece_id=OAB27ZXCI6P7QU7ZCFP3T4R7SVFFEHXYRSE2FWJS7BORH2TVIOIA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.298202589 (255h15m50.25729984s) [noise=true , address=45.91.116.9:4282 , piece_id=M74Y5RS3W6WW4VL6XVXM6NS7RBOE3CESGU3XF3X3M3OYIHOCYWJA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.303719954 (255h15m50.2628172s) [noise=true , address=77.90.31.12:4618 , piece_id=WR6I5CASXCE2EGPVIH4XZ2PQFHK23CPKGXLY6TPC6QJHBV7CW6WQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.305841026 (255h15m50.264938277s) [noise=true , address=104.36.82.49:4998 , piece_id=4BFDCKWI4E3TX5PB6CFNIVBCROLXUFP2LSWYVW547MY52RWDQZQQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.313362648 (255h15m50.272459885s) [noise=true , address=104.36.82.23:4461 , piece_id=NURSR5X7QWITNBHOYY3G3UHEHHPQZJ4STDMK2BT273SLXS5CZMWQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.332987887 (255h15m50.292085139s) [noise=true , address=77.90.31.14:4677 , piece_id=IPUFOEWHJ6PKISQ7Z3AEGWMXWEXZZK6L5OTQOUTYCUTUKJDD5IDA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.334549262 (255h15m50.293646499s) [noise=true , address=104.36.82.44:4899 , piece_id=RZPOLPMETQ6VG6XQBKZB4HUEOIXDLVH6NK6D4N4KWSMMYET3WKJQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.355087609 (255h15m50.314184868s) [noise=true , address=77.90.31.16:4756 , piece_id=WTVHPH2DDWD6UBRAE34EVXXETV4GURPBLDGNPC6TERTNO7M3L66Q, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.355129335 (255h15m50.314226582s) [seg_pos={0 0}, upload=265737]: Segment reached optimal threshold of 14 pieces.
Aug 19 08:41:28.355425379 (255h15m50.314522631s) [noise=true , address=104.36.82.18:4378 , piece_id=UANL4E7NVNNUNKH2TGPCBCQCDZCUL5W6RAZEF2Q6QEDPL4RZDS7Q, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13NZR1Ah43qF6pvFdUpwSrJiCx1HZf3Rb1zwRaPs6tv6inUaQi): protocol: expected piece hash; context canceled; EOF
Aug 19 08:41:28.355492405 (255h15m50.314589651s) [noise=true , address=66.23.193.175:4555 , piece_id=EOT4ZMGJ6ZKCANZMH5AYQGPCLVRWMYXT7WUD4TKFFVGRK2FHKFQA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:33148->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:33148->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->66.23.193.175:4555: use of closed network connection
Aug 19 08:41:28.355617325 (255h15m50.314714571s) [noise=true , address=79.127.205.234:4593 , piece_id=WZ6A7FUGC7O7VDZ4W42S653OYSUNKXE4XX6H5AEW7JBRFHZZJCSA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeX2Yw26im6siYq7rdihU8Aem9xUHuy6SEbss5uzLFTJEHikk): protocol: write tcp 139.59.144.22:58684->79.127.205.234:4593: use of closed network connection; write tcp 139.59.144.22:58684->79.127.205.234:4593: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58684->79.127.205.234:4593: use of closed network connection
Aug 19 08:41:28.355637483 (255h15m50.31473472s) [noise=true , address=45.91.116.5:4305 , piece_id=4QCAF7NFEA57ALBEVC4LPQKI7MCZKCOMFRQNTROVEGI6G4PQHLHA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1): protocol: write tcp 139.59.144.22:36064->45.91.116.5:4305: use of closed network connection; write tcp 139.59.144.22:36064->45.91.116.5:4305: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36064->45.91.116.5:4305: use of closed network connection
Aug 19 08:41:28.355654827 (255h15m50.314752063s) [seg_pos={0 0}, upload=265737]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 08:41:28.355790237 (255h15m50.314887498s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 08:41:28.355797459 (255h15m50.314894707s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 08:41:28.510239333 (255h15m50.469336617s) [upload=265737]: Done uploading segments...
Aug 19 08:41:28.510265166 (255h15m50.469362438s) [upload=265737]: Upload finished. err: <nil>
Duration: 2.644544122s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.........................X...X...............X..........XX.X] duration:
3.474002066s
FAIL (2025-08-19 09:01:07 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 09:01:05.205958715 (255h35m27.165055967s) [upload=266084]: Starting upload Aug 19 09:01:05.206033225 (255h35m27.165130463s) [upload=266084]: Done starting upload Aug 19 09:01:05.206121111 (255h35m27.165218354s) [upload=266084]: Uploading segments... Aug 19 09:01:05.206181918 (255h35m27.165279173s) [upload=266084]: Got next segment. Inline: true Aug 19 09:01:05.206188327 (255h35m27.165285583s) [upload=266084]: Waiting for error group managing segments... Aug 19 09:01:05.206241862 (255h35m27.165339097s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:05.206250212 (255h35m27.165347466s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 09:01:05.206254764 (255h35m27.165352019s) [upload=266084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 09:01:06.648466516 (255h35m28.607563768s) [upload=266084]: Done uploading segments... Aug 19 09:01:06.648492741 (255h35m28.60758998s) [upload=266084]: Upload finished. err: <nil>
Duration: 3.474093751s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X............X..........................] duration:
2.461667682s
FAIL (2025-08-19 09:01:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 08:41:27.346256472 (255h15m49.305353727s) [upload=265737]: Starting upload
Aug 19 08:41:27.346339100 (255h15m49.305436351s) [upload=265737]: Done starting upload
Aug 19 08:41:27.346458386 (255h15m49.305555625s) [upload=265737]: Uploading segments...
Aug 19 08:41:27.346939011 (255h15m49.306036257s) [upload=265737]: Got next segment. Inline: false
Aug 19 08:41:27.346993157 (255h15m49.306090401s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 08:41:27.346998430 (255h15m49.306095661s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 08:41:27.539991574 (255h15m49.49908883s) [seg_pos={0 0}, upload=265737]: Begin upload segment...
Aug 19 08:41:27.540057671 (255h15m49.499154923s) [seg_pos={0 0}, upload=265737]: Done begin upload segment.
Aug 19 08:41:27.540113635 (255h15m49.499210893s) [noise=true , address=77.90.31.14:4677 , piece_id=IPUFOEWHJ6PKISQ7Z3AEGWMXWEXZZK6L5OTQOUTYCUTUKJDD5IDA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.540876878 (255h15m49.499974132s) [noise=true , address=104.36.82.18:4378 , piece_id=UANL4E7NVNNUNKH2TGPCBCQCDZCUL5W6RAZEF2Q6QEDPL4RZDS7Q, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.540961331 (255h15m49.500058589s) [noise=true , address=45.91.116.9:4282 , piece_id=M74Y5RS3W6WW4VL6XVXM6NS7RBOE3CESGU3XF3X3M3OYIHOCYWJA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.541360776 (255h15m49.500458034s) [noise=true , address=79.127.205.234:4593 , piece_id=WZ6A7FUGC7O7VDZ4W42S653OYSUNKXE4XX6H5AEW7JBRFHZZJCSA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.541440247 (255h15m49.500537504s) [noise=true , address=77.90.31.10:4538 , piece_id=56BNCJDLOPD6OOGE2M5MEKPE2PXXXP3KH6VRHJQE4VC33VDULQUQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.542104935 (255h15m49.501202182s) [noise=true , address=77.90.31.17:4779 , piece_id=OAB27ZXCI6P7QU7ZCFP3T4R7SVFFEHXYRSE2FWJS7BORH2TVIOIA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.542347684 (255h15m49.501444945s) [noise=true , address=77.90.31.21:4897 , piece_id=JWYXX5WASZXDBJSE6RM7BHAJTBYBHBXBYSMJKCGHXRTZ2P2JS2TQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.543147248 (255h15m49.502244503s) [noise=true , address=104.36.82.5:4844 , piece_id=XAJ2AWEZBPDN2IKYUEJ7CKRLQSM7CUFSL4DRD57WWRA7H56WIRBA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.543565022 (255h15m49.502662277s) [noise=true , address=77.90.31.16:4756 , piece_id=WTVHPH2DDWD6UBRAE34EVXXETV4GURPBLDGNPC6TERTNO7M3L66Q, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.544298424 (255h15m49.50339568s) [noise=true , address=77.90.31.12:4618 , piece_id=WR6I5CASXCE2EGPVIH4XZ2PQFHK23CPKGXLY6TPC6QJHBV7CW6WQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.544840699 (255h15m49.503938005s) [noise=true , address=79.127.219.47:4063 , piece_id=TKI3LNO4UKFEI7SIRQJMOKAMQXARGQP4UHREHSBMTAUOWVJHFLHA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.545625282 (255h15m49.504722537s) [noise=true , address=104.36.82.49:4998 , piece_id=4BFDCKWI4E3TX5PB6CFNIVBCROLXUFP2LSWYVW547MY52RWDQZQQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.546143218 (255h15m49.505240464s) [noise=true , address=45.91.116.11:4144 , piece_id=C34UHCS25TXACKNURIURFHV47XYBO7I5MLFYDS6DKT7FLMNGOERQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.549024549 (255h15m49.508121805s) [noise=true , address=104.36.82.23:4461 , piece_id=NURSR5X7QWITNBHOYY3G3UHEHHPQZJ4STDMK2BT273SLXS5CZMWQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.549859067 (255h15m49.508956331s) [noise=true , address=104.36.82.60:4363 , piece_id=G3ROG6GDAXODLAITFPYZFZ4ENID2WQT6KS6KR667JHSE75PXNAIA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.550398165 (255h15m49.50949542s) [noise=true , address=66.23.193.175:4555 , piece_id=EOT4ZMGJ6ZKCANZMH5AYQGPCLVRWMYXT7WUD4TKFFVGRK2FHKFQA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.551882299 (255h15m49.510979556s) [noise=true , address=104.36.82.44:4899 , piece_id=RZPOLPMETQ6VG6XQBKZB4HUEOIXDLVH6NK6D4N4KWSMMYET3WKJQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.552424053 (255h15m49.51152131s) [noise=true , address=45.91.116.5:4305 , piece_id=4QCAF7NFEA57ALBEVC4LPQKI7MCZKCOMFRQNTROVEGI6G4PQHLHA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:28.102865369 (255h15m50.061962625s) [upload=265737]: Next returned nil segment
Aug 19 08:41:28.102891945 (255h15m50.061989202s) [upload=265737]: Waiting for error group managing segments...
Aug 19 08:41:28.265009741 (255h15m50.224106974s) [noise=true , address=45.91.116.11:4144 , piece_id=C34UHCS25TXACKNURIURFHV47XYBO7I5MLFYDS6DKT7FLMNGOERQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.265690187 (255h15m50.224787423s) [noise=true , address=77.90.31.21:4897 , piece_id=JWYXX5WASZXDBJSE6RM7BHAJTBYBHBXBYSMJKCGHXRTZ2P2JS2TQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.274487420 (255h15m50.233584659s) [noise=true , address=79.127.219.47:4063 , piece_id=TKI3LNO4UKFEI7SIRQJMOKAMQXARGQP4UHREHSBMTAUOWVJHFLHA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.284608512 (255h15m50.243705749s) [noise=true , address=77.90.31.10:4538 , piece_id=56BNCJDLOPD6OOGE2M5MEKPE2PXXXP3KH6VRHJQE4VC33VDULQUQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.288622153 (255h15m50.247719405s) [noise=true , address=104.36.82.5:4844 , piece_id=XAJ2AWEZBPDN2IKYUEJ7CKRLQSM7CUFSL4DRD57WWRA7H56WIRBA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.292444612 (255h15m50.251541844s) [noise=true , address=104.36.82.60:4363 , piece_id=G3ROG6GDAXODLAITFPYZFZ4ENID2WQT6KS6KR667JHSE75PXNAIA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.293084440 (255h15m50.252181686s) [noise=true , address=77.90.31.17:4779 , piece_id=OAB27ZXCI6P7QU7ZCFP3T4R7SVFFEHXYRSE2FWJS7BORH2TVIOIA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.298202589 (255h15m50.25729984s) [noise=true , address=45.91.116.9:4282 , piece_id=M74Y5RS3W6WW4VL6XVXM6NS7RBOE3CESGU3XF3X3M3OYIHOCYWJA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.303719954 (255h15m50.2628172s) [noise=true , address=77.90.31.12:4618 , piece_id=WR6I5CASXCE2EGPVIH4XZ2PQFHK23CPKGXLY6TPC6QJHBV7CW6WQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.305841026 (255h15m50.264938277s) [noise=true , address=104.36.82.49:4998 , piece_id=4BFDCKWI4E3TX5PB6CFNIVBCROLXUFP2LSWYVW547MY52RWDQZQQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.313362648 (255h15m50.272459885s) [noise=true , address=104.36.82.23:4461 , piece_id=NURSR5X7QWITNBHOYY3G3UHEHHPQZJ4STDMK2BT273SLXS5CZMWQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.332987887 (255h15m50.292085139s) [noise=true , address=77.90.31.14:4677 , piece_id=IPUFOEWHJ6PKISQ7Z3AEGWMXWEXZZK6L5OTQOUTYCUTUKJDD5IDA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.334549262 (255h15m50.293646499s) [noise=true , address=104.36.82.44:4899 , piece_id=RZPOLPMETQ6VG6XQBKZB4HUEOIXDLVH6NK6D4N4KWSMMYET3WKJQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.355087609 (255h15m50.314184868s) [noise=true , address=77.90.31.16:4756 , piece_id=WTVHPH2DDWD6UBRAE34EVXXETV4GURPBLDGNPC6TERTNO7M3L66Q, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.355129335 (255h15m50.314226582s) [seg_pos={0 0}, upload=265737]: Segment reached optimal threshold of 14 pieces.
Aug 19 08:41:28.355425379 (255h15m50.314522631s) [noise=true , address=104.36.82.18:4378 , piece_id=UANL4E7NVNNUNKH2TGPCBCQCDZCUL5W6RAZEF2Q6QEDPL4RZDS7Q, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13NZR1Ah43qF6pvFdUpwSrJiCx1HZf3Rb1zwRaPs6tv6inUaQi): protocol: expected piece hash; context canceled; EOF
Aug 19 08:41:28.355492405 (255h15m50.314589651s) [noise=true , address=66.23.193.175:4555 , piece_id=EOT4ZMGJ6ZKCANZMH5AYQGPCLVRWMYXT7WUD4TKFFVGRK2FHKFQA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:33148->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:33148->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->66.23.193.175:4555: use of closed network connection
Aug 19 08:41:28.355617325 (255h15m50.314714571s) [noise=true , address=79.127.205.234:4593 , piece_id=WZ6A7FUGC7O7VDZ4W42S653OYSUNKXE4XX6H5AEW7JBRFHZZJCSA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeX2Yw26im6siYq7rdihU8Aem9xUHuy6SEbss5uzLFTJEHikk): protocol: write tcp 139.59.144.22:58684->79.127.205.234:4593: use of closed network connection; write tcp 139.59.144.22:58684->79.127.205.234:4593: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58684->79.127.205.234:4593: use of closed network connection
Aug 19 08:41:28.355637483 (255h15m50.31473472s) [noise=true , address=45.91.116.5:4305 , piece_id=4QCAF7NFEA57ALBEVC4LPQKI7MCZKCOMFRQNTROVEGI6G4PQHLHA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1): protocol: write tcp 139.59.144.22:36064->45.91.116.5:4305: use of closed network connection; write tcp 139.59.144.22:36064->45.91.116.5:4305: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36064->45.91.116.5:4305: use of closed network connection
Aug 19 08:41:28.355654827 (255h15m50.314752063s) [seg_pos={0 0}, upload=265737]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 08:41:28.355790237 (255h15m50.314887498s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 08:41:28.355797459 (255h15m50.314894707s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 08:41:28.510239333 (255h15m50.469336617s) [upload=265737]: Done uploading segments...
Aug 19 08:41:28.510265166 (255h15m50.469362438s) [upload=265737]: Upload finished. err: <nil>
Duration: 2.461705101s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........................X...X...............X..........XX.] duration:
839.543397ms
FAIL (2025-08-19 09:00:39 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 08:59:49.555682901 (255h34m11.514780151s) [upload=266060]: Starting upload Aug 19 08:59:49.555743075 (255h34m11.514840321s) [upload=266060]: Done starting upload Aug 19 08:59:49.555828989 (255h34m11.514926236s) [upload=266060]: Uploading segments... Aug 19 08:59:49.555873477 (255h34m11.514970731s) [upload=266060]: Got next segment. Inline: true Aug 19 08:59:49.555878786 (255h34m11.514976021s) [upload=266060]: Waiting for error group managing segments... Aug 19 08:59:49.555920259 (255h34m11.515017494s) [upload=266060]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:59:49.555925259 (255h34m11.515022494s) [upload=266060]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 08:59:49.555928626 (255h34m11.515025862s) [upload=266060]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 08:59:49.710528550 (255h34m11.669625806s) [upload=266060]: Done uploading segments... Aug 19 08:59:49.710553367 (255h34m11.669650619s) [upload=266060]: Upload finished. err: <nil>
Duration: 839.585598ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X............X.........................] duration:
3.056229183s
FAIL (2025-08-19 09:00:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 08:41:27.346256472 (255h15m49.305353727s) [upload=265737]: Starting upload
Aug 19 08:41:27.346339100 (255h15m49.305436351s) [upload=265737]: Done starting upload
Aug 19 08:41:27.346458386 (255h15m49.305555625s) [upload=265737]: Uploading segments...
Aug 19 08:41:27.346939011 (255h15m49.306036257s) [upload=265737]: Got next segment. Inline: false
Aug 19 08:41:27.346993157 (255h15m49.306090401s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 08:41:27.346998430 (255h15m49.306095661s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 08:41:27.539991574 (255h15m49.49908883s) [seg_pos={0 0}, upload=265737]: Begin upload segment...
Aug 19 08:41:27.540057671 (255h15m49.499154923s) [seg_pos={0 0}, upload=265737]: Done begin upload segment.
Aug 19 08:41:27.540113635 (255h15m49.499210893s) [noise=true , address=77.90.31.14:4677 , piece_id=IPUFOEWHJ6PKISQ7Z3AEGWMXWEXZZK6L5OTQOUTYCUTUKJDD5IDA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.540876878 (255h15m49.499974132s) [noise=true , address=104.36.82.18:4378 , piece_id=UANL4E7NVNNUNKH2TGPCBCQCDZCUL5W6RAZEF2Q6QEDPL4RZDS7Q, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.540961331 (255h15m49.500058589s) [noise=true , address=45.91.116.9:4282 , piece_id=M74Y5RS3W6WW4VL6XVXM6NS7RBOE3CESGU3XF3X3M3OYIHOCYWJA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.541360776 (255h15m49.500458034s) [noise=true , address=79.127.205.234:4593 , piece_id=WZ6A7FUGC7O7VDZ4W42S653OYSUNKXE4XX6H5AEW7JBRFHZZJCSA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.541440247 (255h15m49.500537504s) [noise=true , address=77.90.31.10:4538 , piece_id=56BNCJDLOPD6OOGE2M5MEKPE2PXXXP3KH6VRHJQE4VC33VDULQUQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.542104935 (255h15m49.501202182s) [noise=true , address=77.90.31.17:4779 , piece_id=OAB27ZXCI6P7QU7ZCFP3T4R7SVFFEHXYRSE2FWJS7BORH2TVIOIA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.542347684 (255h15m49.501444945s) [noise=true , address=77.90.31.21:4897 , piece_id=JWYXX5WASZXDBJSE6RM7BHAJTBYBHBXBYSMJKCGHXRTZ2P2JS2TQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.543147248 (255h15m49.502244503s) [noise=true , address=104.36.82.5:4844 , piece_id=XAJ2AWEZBPDN2IKYUEJ7CKRLQSM7CUFSL4DRD57WWRA7H56WIRBA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.543565022 (255h15m49.502662277s) [noise=true , address=77.90.31.16:4756 , piece_id=WTVHPH2DDWD6UBRAE34EVXXETV4GURPBLDGNPC6TERTNO7M3L66Q, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.544298424 (255h15m49.50339568s) [noise=true , address=77.90.31.12:4618 , piece_id=WR6I5CASXCE2EGPVIH4XZ2PQFHK23CPKGXLY6TPC6QJHBV7CW6WQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.544840699 (255h15m49.503938005s) [noise=true , address=79.127.219.47:4063 , piece_id=TKI3LNO4UKFEI7SIRQJMOKAMQXARGQP4UHREHSBMTAUOWVJHFLHA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.545625282 (255h15m49.504722537s) [noise=true , address=104.36.82.49:4998 , piece_id=4BFDCKWI4E3TX5PB6CFNIVBCROLXUFP2LSWYVW547MY52RWDQZQQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.546143218 (255h15m49.505240464s) [noise=true , address=45.91.116.11:4144 , piece_id=C34UHCS25TXACKNURIURFHV47XYBO7I5MLFYDS6DKT7FLMNGOERQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.549024549 (255h15m49.508121805s) [noise=true , address=104.36.82.23:4461 , piece_id=NURSR5X7QWITNBHOYY3G3UHEHHPQZJ4STDMK2BT273SLXS5CZMWQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.549859067 (255h15m49.508956331s) [noise=true , address=104.36.82.60:4363 , piece_id=G3ROG6GDAXODLAITFPYZFZ4ENID2WQT6KS6KR667JHSE75PXNAIA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.550398165 (255h15m49.50949542s) [noise=true , address=66.23.193.175:4555 , piece_id=EOT4ZMGJ6ZKCANZMH5AYQGPCLVRWMYXT7WUD4TKFFVGRK2FHKFQA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.551882299 (255h15m49.510979556s) [noise=true , address=104.36.82.44:4899 , piece_id=RZPOLPMETQ6VG6XQBKZB4HUEOIXDLVH6NK6D4N4KWSMMYET3WKJQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.552424053 (255h15m49.51152131s) [noise=true , address=45.91.116.5:4305 , piece_id=4QCAF7NFEA57ALBEVC4LPQKI7MCZKCOMFRQNTROVEGI6G4PQHLHA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:28.102865369 (255h15m50.061962625s) [upload=265737]: Next returned nil segment
Aug 19 08:41:28.102891945 (255h15m50.061989202s) [upload=265737]: Waiting for error group managing segments...
Aug 19 08:41:28.265009741 (255h15m50.224106974s) [noise=true , address=45.91.116.11:4144 , piece_id=C34UHCS25TXACKNURIURFHV47XYBO7I5MLFYDS6DKT7FLMNGOERQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.265690187 (255h15m50.224787423s) [noise=true , address=77.90.31.21:4897 , piece_id=JWYXX5WASZXDBJSE6RM7BHAJTBYBHBXBYSMJKCGHXRTZ2P2JS2TQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.274487420 (255h15m50.233584659s) [noise=true , address=79.127.219.47:4063 , piece_id=TKI3LNO4UKFEI7SIRQJMOKAMQXARGQP4UHREHSBMTAUOWVJHFLHA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.284608512 (255h15m50.243705749s) [noise=true , address=77.90.31.10:4538 , piece_id=56BNCJDLOPD6OOGE2M5MEKPE2PXXXP3KH6VRHJQE4VC33VDULQUQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.288622153 (255h15m50.247719405s) [noise=true , address=104.36.82.5:4844 , piece_id=XAJ2AWEZBPDN2IKYUEJ7CKRLQSM7CUFSL4DRD57WWRA7H56WIRBA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.292444612 (255h15m50.251541844s) [noise=true , address=104.36.82.60:4363 , piece_id=G3ROG6GDAXODLAITFPYZFZ4ENID2WQT6KS6KR667JHSE75PXNAIA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.293084440 (255h15m50.252181686s) [noise=true , address=77.90.31.17:4779 , piece_id=OAB27ZXCI6P7QU7ZCFP3T4R7SVFFEHXYRSE2FWJS7BORH2TVIOIA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.298202589 (255h15m50.25729984s) [noise=true , address=45.91.116.9:4282 , piece_id=M74Y5RS3W6WW4VL6XVXM6NS7RBOE3CESGU3XF3X3M3OYIHOCYWJA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.303719954 (255h15m50.2628172s) [noise=true , address=77.90.31.12:4618 , piece_id=WR6I5CASXCE2EGPVIH4XZ2PQFHK23CPKGXLY6TPC6QJHBV7CW6WQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.305841026 (255h15m50.264938277s) [noise=true , address=104.36.82.49:4998 , piece_id=4BFDCKWI4E3TX5PB6CFNIVBCROLXUFP2LSWYVW547MY52RWDQZQQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.313362648 (255h15m50.272459885s) [noise=true , address=104.36.82.23:4461 , piece_id=NURSR5X7QWITNBHOYY3G3UHEHHPQZJ4STDMK2BT273SLXS5CZMWQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.332987887 (255h15m50.292085139s) [noise=true , address=77.90.31.14:4677 , piece_id=IPUFOEWHJ6PKISQ7Z3AEGWMXWEXZZK6L5OTQOUTYCUTUKJDD5IDA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.334549262 (255h15m50.293646499s) [noise=true , address=104.36.82.44:4899 , piece_id=RZPOLPMETQ6VG6XQBKZB4HUEOIXDLVH6NK6D4N4KWSMMYET3WKJQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.355087609 (255h15m50.314184868s) [noise=true , address=77.90.31.16:4756 , piece_id=WTVHPH2DDWD6UBRAE34EVXXETV4GURPBLDGNPC6TERTNO7M3L66Q, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.355129335 (255h15m50.314226582s) [seg_pos={0 0}, upload=265737]: Segment reached optimal threshold of 14 pieces.
Aug 19 08:41:28.355425379 (255h15m50.314522631s) [noise=true , address=104.36.82.18:4378 , piece_id=UANL4E7NVNNUNKH2TGPCBCQCDZCUL5W6RAZEF2Q6QEDPL4RZDS7Q, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13NZR1Ah43qF6pvFdUpwSrJiCx1HZf3Rb1zwRaPs6tv6inUaQi): protocol: expected piece hash; context canceled; EOF
Aug 19 08:41:28.355492405 (255h15m50.314589651s) [noise=true , address=66.23.193.175:4555 , piece_id=EOT4ZMGJ6ZKCANZMH5AYQGPCLVRWMYXT7WUD4TKFFVGRK2FHKFQA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:33148->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:33148->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->66.23.193.175:4555: use of closed network connection
Aug 19 08:41:28.355617325 (255h15m50.314714571s) [noise=true , address=79.127.205.234:4593 , piece_id=WZ6A7FUGC7O7VDZ4W42S653OYSUNKXE4XX6H5AEW7JBRFHZZJCSA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeX2Yw26im6siYq7rdihU8Aem9xUHuy6SEbss5uzLFTJEHikk): protocol: write tcp 139.59.144.22:58684->79.127.205.234:4593: use of closed network connection; write tcp 139.59.144.22:58684->79.127.205.234:4593: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58684->79.127.205.234:4593: use of closed network connection
Aug 19 08:41:28.355637483 (255h15m50.31473472s) [noise=true , address=45.91.116.5:4305 , piece_id=4QCAF7NFEA57ALBEVC4LPQKI7MCZKCOMFRQNTROVEGI6G4PQHLHA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1): protocol: write tcp 139.59.144.22:36064->45.91.116.5:4305: use of closed network connection; write tcp 139.59.144.22:36064->45.91.116.5:4305: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36064->45.91.116.5:4305: use of closed network connection
Aug 19 08:41:28.355654827 (255h15m50.314752063s) [seg_pos={0 0}, upload=265737]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 08:41:28.355790237 (255h15m50.314887498s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 08:41:28.355797459 (255h15m50.314894707s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 08:41:28.510239333 (255h15m50.469336617s) [upload=265737]: Done uploading segments...
Aug 19 08:41:28.510265166 (255h15m50.469362438s) [upload=265737]: Upload finished. err: <nil>
Duration: 3.056261997s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........................X...X...............X..........XX] duration:
630.108883ms
FAIL (2025-08-19 08:59:49 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 08:59:49.555682901 (255h34m11.514780151s) [upload=266060]: Starting upload Aug 19 08:59:49.555743075 (255h34m11.514840321s) [upload=266060]: Done starting upload Aug 19 08:59:49.555828989 (255h34m11.514926236s) [upload=266060]: Uploading segments... Aug 19 08:59:49.555873477 (255h34m11.514970731s) [upload=266060]: Got next segment. Inline: true Aug 19 08:59:49.555878786 (255h34m11.514976021s) [upload=266060]: Waiting for error group managing segments... Aug 19 08:59:49.555920259 (255h34m11.515017494s) [upload=266060]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:59:49.555925259 (255h34m11.515022494s) [upload=266060]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 08:59:49.555928626 (255h34m11.515025862s) [upload=266060]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 08:59:49.710528550 (255h34m11.669625806s) [upload=266060]: Done uploading segments... Aug 19 08:59:49.710553367 (255h34m11.669650619s) [upload=266060]: Upload finished. err: <nil>
Duration: 630.139028ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X............X........................] duration:
2.361431857s
FAIL (2025-08-19 08:59:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 08:41:27.346256472 (255h15m49.305353727s) [upload=265737]: Starting upload
Aug 19 08:41:27.346339100 (255h15m49.305436351s) [upload=265737]: Done starting upload
Aug 19 08:41:27.346458386 (255h15m49.305555625s) [upload=265737]: Uploading segments...
Aug 19 08:41:27.346939011 (255h15m49.306036257s) [upload=265737]: Got next segment. Inline: false
Aug 19 08:41:27.346993157 (255h15m49.306090401s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 08:41:27.346998430 (255h15m49.306095661s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 08:41:27.539991574 (255h15m49.49908883s) [seg_pos={0 0}, upload=265737]: Begin upload segment...
Aug 19 08:41:27.540057671 (255h15m49.499154923s) [seg_pos={0 0}, upload=265737]: Done begin upload segment.
Aug 19 08:41:27.540113635 (255h15m49.499210893s) [noise=true , address=77.90.31.14:4677 , piece_id=IPUFOEWHJ6PKISQ7Z3AEGWMXWEXZZK6L5OTQOUTYCUTUKJDD5IDA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.540876878 (255h15m49.499974132s) [noise=true , address=104.36.82.18:4378 , piece_id=UANL4E7NVNNUNKH2TGPCBCQCDZCUL5W6RAZEF2Q6QEDPL4RZDS7Q, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.540961331 (255h15m49.500058589s) [noise=true , address=45.91.116.9:4282 , piece_id=M74Y5RS3W6WW4VL6XVXM6NS7RBOE3CESGU3XF3X3M3OYIHOCYWJA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.541360776 (255h15m49.500458034s) [noise=true , address=79.127.205.234:4593 , piece_id=WZ6A7FUGC7O7VDZ4W42S653OYSUNKXE4XX6H5AEW7JBRFHZZJCSA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.541440247 (255h15m49.500537504s) [noise=true , address=77.90.31.10:4538 , piece_id=56BNCJDLOPD6OOGE2M5MEKPE2PXXXP3KH6VRHJQE4VC33VDULQUQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.542104935 (255h15m49.501202182s) [noise=true , address=77.90.31.17:4779 , piece_id=OAB27ZXCI6P7QU7ZCFP3T4R7SVFFEHXYRSE2FWJS7BORH2TVIOIA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.542347684 (255h15m49.501444945s) [noise=true , address=77.90.31.21:4897 , piece_id=JWYXX5WASZXDBJSE6RM7BHAJTBYBHBXBYSMJKCGHXRTZ2P2JS2TQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.543147248 (255h15m49.502244503s) [noise=true , address=104.36.82.5:4844 , piece_id=XAJ2AWEZBPDN2IKYUEJ7CKRLQSM7CUFSL4DRD57WWRA7H56WIRBA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.543565022 (255h15m49.502662277s) [noise=true , address=77.90.31.16:4756 , piece_id=WTVHPH2DDWD6UBRAE34EVXXETV4GURPBLDGNPC6TERTNO7M3L66Q, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.544298424 (255h15m49.50339568s) [noise=true , address=77.90.31.12:4618 , piece_id=WR6I5CASXCE2EGPVIH4XZ2PQFHK23CPKGXLY6TPC6QJHBV7CW6WQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.544840699 (255h15m49.503938005s) [noise=true , address=79.127.219.47:4063 , piece_id=TKI3LNO4UKFEI7SIRQJMOKAMQXARGQP4UHREHSBMTAUOWVJHFLHA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.545625282 (255h15m49.504722537s) [noise=true , address=104.36.82.49:4998 , piece_id=4BFDCKWI4E3TX5PB6CFNIVBCROLXUFP2LSWYVW547MY52RWDQZQQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.546143218 (255h15m49.505240464s) [noise=true , address=45.91.116.11:4144 , piece_id=C34UHCS25TXACKNURIURFHV47XYBO7I5MLFYDS6DKT7FLMNGOERQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.549024549 (255h15m49.508121805s) [noise=true , address=104.36.82.23:4461 , piece_id=NURSR5X7QWITNBHOYY3G3UHEHHPQZJ4STDMK2BT273SLXS5CZMWQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.549859067 (255h15m49.508956331s) [noise=true , address=104.36.82.60:4363 , piece_id=G3ROG6GDAXODLAITFPYZFZ4ENID2WQT6KS6KR667JHSE75PXNAIA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.550398165 (255h15m49.50949542s) [noise=true , address=66.23.193.175:4555 , piece_id=EOT4ZMGJ6ZKCANZMH5AYQGPCLVRWMYXT7WUD4TKFFVGRK2FHKFQA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.551882299 (255h15m49.510979556s) [noise=true , address=104.36.82.44:4899 , piece_id=RZPOLPMETQ6VG6XQBKZB4HUEOIXDLVH6NK6D4N4KWSMMYET3WKJQ, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:27.552424053 (255h15m49.51152131s) [noise=true , address=45.91.116.5:4305 , piece_id=4QCAF7NFEA57ALBEVC4LPQKI7MCZKCOMFRQNTROVEGI6G4PQHLHA, seg_pos={0 0}, upload=265737]: Uploading piece...
Aug 19 08:41:28.102865369 (255h15m50.061962625s) [upload=265737]: Next returned nil segment
Aug 19 08:41:28.102891945 (255h15m50.061989202s) [upload=265737]: Waiting for error group managing segments...
Aug 19 08:41:28.265009741 (255h15m50.224106974s) [noise=true , address=45.91.116.11:4144 , piece_id=C34UHCS25TXACKNURIURFHV47XYBO7I5MLFYDS6DKT7FLMNGOERQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.265690187 (255h15m50.224787423s) [noise=true , address=77.90.31.21:4897 , piece_id=JWYXX5WASZXDBJSE6RM7BHAJTBYBHBXBYSMJKCGHXRTZ2P2JS2TQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.274487420 (255h15m50.233584659s) [noise=true , address=79.127.219.47:4063 , piece_id=TKI3LNO4UKFEI7SIRQJMOKAMQXARGQP4UHREHSBMTAUOWVJHFLHA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.284608512 (255h15m50.243705749s) [noise=true , address=77.90.31.10:4538 , piece_id=56BNCJDLOPD6OOGE2M5MEKPE2PXXXP3KH6VRHJQE4VC33VDULQUQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.288622153 (255h15m50.247719405s) [noise=true , address=104.36.82.5:4844 , piece_id=XAJ2AWEZBPDN2IKYUEJ7CKRLQSM7CUFSL4DRD57WWRA7H56WIRBA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.292444612 (255h15m50.251541844s) [noise=true , address=104.36.82.60:4363 , piece_id=G3ROG6GDAXODLAITFPYZFZ4ENID2WQT6KS6KR667JHSE75PXNAIA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.293084440 (255h15m50.252181686s) [noise=true , address=77.90.31.17:4779 , piece_id=OAB27ZXCI6P7QU7ZCFP3T4R7SVFFEHXYRSE2FWJS7BORH2TVIOIA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.298202589 (255h15m50.25729984s) [noise=true , address=45.91.116.9:4282 , piece_id=M74Y5RS3W6WW4VL6XVXM6NS7RBOE3CESGU3XF3X3M3OYIHOCYWJA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.303719954 (255h15m50.2628172s) [noise=true , address=77.90.31.12:4618 , piece_id=WR6I5CASXCE2EGPVIH4XZ2PQFHK23CPKGXLY6TPC6QJHBV7CW6WQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.305841026 (255h15m50.264938277s) [noise=true , address=104.36.82.49:4998 , piece_id=4BFDCKWI4E3TX5PB6CFNIVBCROLXUFP2LSWYVW547MY52RWDQZQQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.313362648 (255h15m50.272459885s) [noise=true , address=104.36.82.23:4461 , piece_id=NURSR5X7QWITNBHOYY3G3UHEHHPQZJ4STDMK2BT273SLXS5CZMWQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.332987887 (255h15m50.292085139s) [noise=true , address=77.90.31.14:4677 , piece_id=IPUFOEWHJ6PKISQ7Z3AEGWMXWEXZZK6L5OTQOUTYCUTUKJDD5IDA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.334549262 (255h15m50.293646499s) [noise=true , address=104.36.82.44:4899 , piece_id=RZPOLPMETQ6VG6XQBKZB4HUEOIXDLVH6NK6D4N4KWSMMYET3WKJQ, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.355087609 (255h15m50.314184868s) [noise=true , address=77.90.31.16:4756 , piece_id=WTVHPH2DDWD6UBRAE34EVXXETV4GURPBLDGNPC6TERTNO7M3L66Q, seg_pos={0 0}, upload=265737]: Done uploading piece. err: <nil>
Aug 19 08:41:28.355129335 (255h15m50.314226582s) [seg_pos={0 0}, upload=265737]: Segment reached optimal threshold of 14 pieces.
Aug 19 08:41:28.355425379 (255h15m50.314522631s) [noise=true , address=104.36.82.18:4378 , piece_id=UANL4E7NVNNUNKH2TGPCBCQCDZCUL5W6RAZEF2Q6QEDPL4RZDS7Q, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13NZR1Ah43qF6pvFdUpwSrJiCx1HZf3Rb1zwRaPs6tv6inUaQi): protocol: expected piece hash; context canceled; EOF
Aug 19 08:41:28.355492405 (255h15m50.314589651s) [noise=true , address=66.23.193.175:4555 , piece_id=EOT4ZMGJ6ZKCANZMH5AYQGPCLVRWMYXT7WUD4TKFFVGRK2FHKFQA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:33148->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:33148->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33148->66.23.193.175:4555: use of closed network connection
Aug 19 08:41:28.355617325 (255h15m50.314714571s) [noise=true , address=79.127.205.234:4593 , piece_id=WZ6A7FUGC7O7VDZ4W42S653OYSUNKXE4XX6H5AEW7JBRFHZZJCSA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeX2Yw26im6siYq7rdihU8Aem9xUHuy6SEbss5uzLFTJEHikk): protocol: write tcp 139.59.144.22:58684->79.127.205.234:4593: use of closed network connection; write tcp 139.59.144.22:58684->79.127.205.234:4593: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58684->79.127.205.234:4593: use of closed network connection
Aug 19 08:41:28.355637483 (255h15m50.31473472s) [noise=true , address=45.91.116.5:4305 , piece_id=4QCAF7NFEA57ALBEVC4LPQKI7MCZKCOMFRQNTROVEGI6G4PQHLHA, seg_pos={0 0}, upload=265737]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121EfsJiXbm2HktqinYqjYaHWRyGiu2wA9fq4PQXpyizYttDCi1): protocol: write tcp 139.59.144.22:36064->45.91.116.5:4305: use of closed network connection; write tcp 139.59.144.22:36064->45.91.116.5:4305: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36064->45.91.116.5:4305: use of closed network connection
Aug 19 08:41:28.355654827 (255h15m50.314752063s) [seg_pos={0 0}, upload=265737]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 08:41:28.355790237 (255h15m50.314887498s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 08:41:28.355797459 (255h15m50.314894707s) [upload=265737]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 08:41:28.510239333 (255h15m50.469336617s) [upload=265737]: Done uploading segments...
Aug 19 08:41:28.510265166 (255h15m50.469362438s) [upload=265737]: Upload finished. err: <nil>
Duration: 2.361464199s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|