Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
868.645331ms
FAIL (2025-08-10 10:39:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 868.669884ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.036227492s
FAIL (2025-08-10 10:39:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 1.036254243s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X................X........] duration:
2.290301926s
FAIL (2025-08-10 10:39:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:33:05.333810159 (41h7m27.292907403s) [upload=42852]: Starting upload Aug 10 10:33:05.333865167 (41h7m27.292962415s) [upload=42852]: Done starting upload Aug 10 10:33:05.334091533 (41h7m27.293188779s) [upload=42852]: Uploading segments... Aug 10 10:33:05.336474061 (41h7m27.29557131s) [upload=42852]: Got next segment. Inline: false Aug 10 10:33:05.336557946 (41h7m27.295655191s) [upload=42852]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:33:05.336563571 (41h7m27.295660816s) [upload=42852]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:33:05.426229859 (41h7m27.385327114s) [upload=42852]: Next segment err: metaclient: Too Many Requests Aug 10 10:33:05.426255812 (41h7m27.385353053s) [upload=42852]: Done uploading segments... Aug 10 10:33:05.426273218 (41h7m27.385370453s) [upload=42852]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.290330794s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.001652381s
FAIL (2025-08-10 10:38:44 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 1.001676881s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X................X.......] duration:
2.473894778s
FAIL (2025-08-10 10:38:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:33:05.333810159 (41h7m27.292907403s) [upload=42852]: Starting upload Aug 10 10:33:05.333865167 (41h7m27.292962415s) [upload=42852]: Done starting upload Aug 10 10:33:05.334091533 (41h7m27.293188779s) [upload=42852]: Uploading segments... Aug 10 10:33:05.336474061 (41h7m27.29557131s) [upload=42852]: Got next segment. Inline: false Aug 10 10:33:05.336557946 (41h7m27.295655191s) [upload=42852]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:33:05.336563571 (41h7m27.295660816s) [upload=42852]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:33:05.426229859 (41h7m27.385327114s) [upload=42852]: Next segment err: metaclient: Too Many Requests Aug 10 10:33:05.426255812 (41h7m27.385353053s) [upload=42852]: Done uploading segments... Aug 10 10:33:05.426273218 (41h7m27.385370453s) [upload=42852]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.473951459s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
873.505163ms
FAIL (2025-08-10 10:38:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 873.541184ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X................X......] duration:
2.466285275s
FAIL (2025-08-10 10:37:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:33:05.333810159 (41h7m27.292907403s) [upload=42852]: Starting upload Aug 10 10:33:05.333865167 (41h7m27.292962415s) [upload=42852]: Done starting upload Aug 10 10:33:05.334091533 (41h7m27.293188779s) [upload=42852]: Uploading segments... Aug 10 10:33:05.336474061 (41h7m27.29557131s) [upload=42852]: Got next segment. Inline: false Aug 10 10:33:05.336557946 (41h7m27.295655191s) [upload=42852]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:33:05.336563571 (41h7m27.295660816s) [upload=42852]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:33:05.426229859 (41h7m27.385327114s) [upload=42852]: Next segment err: metaclient: Too Many Requests Aug 10 10:33:05.426255812 (41h7m27.385353053s) [upload=42852]: Done uploading segments... Aug 10 10:33:05.426273218 (41h7m27.385370453s) [upload=42852]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.466312454s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X................X.....] duration:
2.337599511s
FAIL (2025-08-10 10:37:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:33:05.333810159 (41h7m27.292907403s) [upload=42852]: Starting upload Aug 10 10:33:05.333865167 (41h7m27.292962415s) [upload=42852]: Done starting upload Aug 10 10:33:05.334091533 (41h7m27.293188779s) [upload=42852]: Uploading segments... Aug 10 10:33:05.336474061 (41h7m27.29557131s) [upload=42852]: Got next segment. Inline: false Aug 10 10:33:05.336557946 (41h7m27.295655191s) [upload=42852]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:33:05.336563571 (41h7m27.295660816s) [upload=42852]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:33:05.426229859 (41h7m27.385327114s) [upload=42852]: Next segment err: metaclient: Too Many Requests Aug 10 10:33:05.426255812 (41h7m27.385353053s) [upload=42852]: Done uploading segments... Aug 10 10:33:05.426273218 (41h7m27.385370453s) [upload=42852]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.337626826s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
970.031028ms
FAIL (2025-08-10 10:37:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 970.073644ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X................X....] duration:
2.400396058s
FAIL (2025-08-10 10:36:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:33:05.333810159 (41h7m27.292907403s) [upload=42852]: Starting upload Aug 10 10:33:05.333865167 (41h7m27.292962415s) [upload=42852]: Done starting upload Aug 10 10:33:05.334091533 (41h7m27.293188779s) [upload=42852]: Uploading segments... Aug 10 10:33:05.336474061 (41h7m27.29557131s) [upload=42852]: Got next segment. Inline: false Aug 10 10:33:05.336557946 (41h7m27.295655191s) [upload=42852]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:33:05.336563571 (41h7m27.295660816s) [upload=42852]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:33:05.426229859 (41h7m27.385327114s) [upload=42852]: Next segment err: metaclient: Too Many Requests Aug 10 10:33:05.426255812 (41h7m27.385353053s) [upload=42852]: Done uploading segments... Aug 10 10:33:05.426273218 (41h7m27.385370453s) [upload=42852]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.400432257s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
829.839535ms
FAIL (2025-08-10 10:36:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 829.872423ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X................X...] duration:
2.39042289s
FAIL (2025-08-10 10:35:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:33:05.333810159 (41h7m27.292907403s) [upload=42852]: Starting upload Aug 10 10:33:05.333865167 (41h7m27.292962415s) [upload=42852]: Done starting upload Aug 10 10:33:05.334091533 (41h7m27.293188779s) [upload=42852]: Uploading segments... Aug 10 10:33:05.336474061 (41h7m27.29557131s) [upload=42852]: Got next segment. Inline: false Aug 10 10:33:05.336557946 (41h7m27.295655191s) [upload=42852]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:33:05.336563571 (41h7m27.295660816s) [upload=42852]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:33:05.426229859 (41h7m27.385327114s) [upload=42852]: Next segment err: metaclient: Too Many Requests Aug 10 10:33:05.426255812 (41h7m27.385353053s) [upload=42852]: Done uploading segments... Aug 10 10:33:05.426273218 (41h7m27.385370453s) [upload=42852]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.390482044s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
849.403964ms
FAIL (2025-08-10 10:35:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 849.431261ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
866.281137ms
FAIL (2025-08-10 10:34:21 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 866.327979ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.......................................X................X..] duration:
2.374071168s
FAIL (2025-08-10 10:34:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:33:05.333810159 (41h7m27.292907403s) [upload=42852]: Starting upload Aug 10 10:33:05.333865167 (41h7m27.292962415s) [upload=42852]: Done starting upload Aug 10 10:33:05.334091533 (41h7m27.293188779s) [upload=42852]: Uploading segments... Aug 10 10:33:05.336474061 (41h7m27.29557131s) [upload=42852]: Got next segment. Inline: false Aug 10 10:33:05.336557946 (41h7m27.295655191s) [upload=42852]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:33:05.336563571 (41h7m27.295660816s) [upload=42852]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:33:05.426229859 (41h7m27.385327114s) [upload=42852]: Next segment err: metaclient: Too Many Requests Aug 10 10:33:05.426255812 (41h7m27.385353053s) [upload=42852]: Done uploading segments... Aug 10 10:33:05.426273218 (41h7m27.385370453s) [upload=42852]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.374098956s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
1.084289014s
FAIL (2025-08-10 10:33:55 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 1.084308342s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.......................................X................X.] duration:
2.34360081s
FAIL (2025-08-10 10:33:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:33:05.333810159 (41h7m27.292907403s) [upload=42852]: Starting upload Aug 10 10:33:05.333865167 (41h7m27.292962415s) [upload=42852]: Done starting upload Aug 10 10:33:05.334091533 (41h7m27.293188779s) [upload=42852]: Uploading segments... Aug 10 10:33:05.336474061 (41h7m27.29557131s) [upload=42852]: Got next segment. Inline: false Aug 10 10:33:05.336557946 (41h7m27.295655191s) [upload=42852]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:33:05.336563571 (41h7m27.295660816s) [upload=42852]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:33:05.426229859 (41h7m27.385327114s) [upload=42852]: Next segment err: metaclient: Too Many Requests Aug 10 10:33:05.426255812 (41h7m27.385353053s) [upload=42852]: Done uploading segments... Aug 10 10:33:05.426273218 (41h7m27.385370453s) [upload=42852]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.343631481s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
827.610134ms
FAIL (2025-08-10 10:33:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 827.636703ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.......................................X................X] duration:
368.924291ms
FAIL (2025-08-10 10:33:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:33:05.333810159 (41h7m27.292907403s) [upload=42852]: Starting upload Aug 10 10:33:05.333865167 (41h7m27.292962415s) [upload=42852]: Done starting upload Aug 10 10:33:05.334091533 (41h7m27.293188779s) [upload=42852]: Uploading segments... Aug 10 10:33:05.336474061 (41h7m27.29557131s) [upload=42852]: Got next segment. Inline: false Aug 10 10:33:05.336557946 (41h7m27.295655191s) [upload=42852]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:33:05.336563571 (41h7m27.295660816s) [upload=42852]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:33:05.426229859 (41h7m27.385327114s) [upload=42852]: Next segment err: metaclient: Too Many Requests Aug 10 10:33:05.426255812 (41h7m27.385353053s) [upload=42852]: Done uploading segments... Aug 10 10:33:05.426273218 (41h7m27.385370453s) [upload=42852]: Upload finished. err: metaclient: Too Many Requests
Duration: 368.952828ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
1.051174109s
FAIL (2025-08-10 10:32:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 1.051232371s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X.......................................X................] duration:
2.533324475s
FAIL (2025-08-10 10:31:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:20:19.882107622 (40h54m41.841204868s) [upload=42624]: Starting upload Aug 10 10:20:19.882183788 (40h54m41.841281033s) [upload=42624]: Done starting upload Aug 10 10:20:19.882403414 (40h54m41.841500651s) [upload=42624]: Uploading segments... Aug 10 10:20:19.882589946 (40h54m41.841687191s) [upload=42624]: Got next segment. Inline: false Aug 10 10:20:19.882629834 (40h54m41.841727082s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:20:19.882635496 (40h54m41.841732741s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:20:19.997832106 (40h54m41.956929364s) [upload=42624]: Next segment err: metaclient: Too Many Requests Aug 10 10:20:19.997886199 (40h54m41.956983457s) [upload=42624]: Done uploading segments... Aug 10 10:20:19.997941961 (40h54m41.957039205s) [upload=42624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.533363782s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
832.21553ms
FAIL (2025-08-10 10:31:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 832.245369ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X.......................................X...............] duration:
2.265418697s
FAIL (2025-08-10 10:31:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:20:19.882107622 (40h54m41.841204868s) [upload=42624]: Starting upload Aug 10 10:20:19.882183788 (40h54m41.841281033s) [upload=42624]: Done starting upload Aug 10 10:20:19.882403414 (40h54m41.841500651s) [upload=42624]: Uploading segments... Aug 10 10:20:19.882589946 (40h54m41.841687191s) [upload=42624]: Got next segment. Inline: false Aug 10 10:20:19.882629834 (40h54m41.841727082s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:20:19.882635496 (40h54m41.841732741s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:20:19.997832106 (40h54m41.956929364s) [upload=42624]: Next segment err: metaclient: Too Many Requests Aug 10 10:20:19.997886199 (40h54m41.956983457s) [upload=42624]: Done uploading segments... Aug 10 10:20:19.997941961 (40h54m41.957039205s) [upload=42624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.265441028s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.000144957s
FAIL (2025-08-10 10:31:05 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 1.00019026s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X.......................................X..............] duration:
2.367018781s
FAIL (2025-08-10 10:31:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:20:19.882107622 (40h54m41.841204868s) [upload=42624]: Starting upload Aug 10 10:20:19.882183788 (40h54m41.841281033s) [upload=42624]: Done starting upload Aug 10 10:20:19.882403414 (40h54m41.841500651s) [upload=42624]: Uploading segments... Aug 10 10:20:19.882589946 (40h54m41.841687191s) [upload=42624]: Got next segment. Inline: false Aug 10 10:20:19.882629834 (40h54m41.841727082s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:20:19.882635496 (40h54m41.841732741s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:20:19.997832106 (40h54m41.956929364s) [upload=42624]: Next segment err: metaclient: Too Many Requests Aug 10 10:20:19.997886199 (40h54m41.956983457s) [upload=42624]: Done uploading segments... Aug 10 10:20:19.997941961 (40h54m41.957039205s) [upload=42624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.367052868s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X.......................................X.............] duration:
2.379496161s
FAIL (2025-08-10 10:30:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:20:19.882107622 (40h54m41.841204868s) [upload=42624]: Starting upload Aug 10 10:20:19.882183788 (40h54m41.841281033s) [upload=42624]: Done starting upload Aug 10 10:20:19.882403414 (40h54m41.841500651s) [upload=42624]: Uploading segments... Aug 10 10:20:19.882589946 (40h54m41.841687191s) [upload=42624]: Got next segment. Inline: false Aug 10 10:20:19.882629834 (40h54m41.841727082s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:20:19.882635496 (40h54m41.841732741s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:20:19.997832106 (40h54m41.956929364s) [upload=42624]: Next segment err: metaclient: Too Many Requests Aug 10 10:20:19.997886199 (40h54m41.956983457s) [upload=42624]: Done uploading segments... Aug 10 10:20:19.997941961 (40h54m41.957039205s) [upload=42624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.379517833s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.045257556s
FAIL (2025-08-10 10:30:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 1.045287477s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X.......................................X............] duration:
2.371444374s
FAIL (2025-08-10 10:29:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:20:19.882107622 (40h54m41.841204868s) [upload=42624]: Starting upload Aug 10 10:20:19.882183788 (40h54m41.841281033s) [upload=42624]: Done starting upload Aug 10 10:20:19.882403414 (40h54m41.841500651s) [upload=42624]: Uploading segments... Aug 10 10:20:19.882589946 (40h54m41.841687191s) [upload=42624]: Got next segment. Inline: false Aug 10 10:20:19.882629834 (40h54m41.841727082s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:20:19.882635496 (40h54m41.841732741s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:20:19.997832106 (40h54m41.956929364s) [upload=42624]: Next segment err: metaclient: Too Many Requests Aug 10 10:20:19.997886199 (40h54m41.956983457s) [upload=42624]: Done uploading segments... Aug 10 10:20:19.997941961 (40h54m41.957039205s) [upload=42624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.371480247s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
822.744934ms
FAIL (2025-08-10 10:28:59 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 822.78288ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X.......................................X...........] duration:
2.519632357s
FAIL (2025-08-10 10:28:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:20:19.882107622 (40h54m41.841204868s) [upload=42624]: Starting upload Aug 10 10:20:19.882183788 (40h54m41.841281033s) [upload=42624]: Done starting upload Aug 10 10:20:19.882403414 (40h54m41.841500651s) [upload=42624]: Uploading segments... Aug 10 10:20:19.882589946 (40h54m41.841687191s) [upload=42624]: Got next segment. Inline: false Aug 10 10:20:19.882629834 (40h54m41.841727082s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:20:19.882635496 (40h54m41.841732741s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:20:19.997832106 (40h54m41.956929364s) [upload=42624]: Next segment err: metaclient: Too Many Requests Aug 10 10:20:19.997886199 (40h54m41.956983457s) [upload=42624]: Done uploading segments... Aug 10 10:20:19.997941961 (40h54m41.957039205s) [upload=42624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.519664891s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
833.201057ms
FAIL (2025-08-10 10:28:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 833.229148ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X.......................................X..........] duration:
2.373841053s
FAIL (2025-08-10 10:27:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:20:19.882107622 (40h54m41.841204868s) [upload=42624]: Starting upload Aug 10 10:20:19.882183788 (40h54m41.841281033s) [upload=42624]: Done starting upload Aug 10 10:20:19.882403414 (40h54m41.841500651s) [upload=42624]: Uploading segments... Aug 10 10:20:19.882589946 (40h54m41.841687191s) [upload=42624]: Got next segment. Inline: false Aug 10 10:20:19.882629834 (40h54m41.841727082s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:20:19.882635496 (40h54m41.841732741s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:20:19.997832106 (40h54m41.956929364s) [upload=42624]: Next segment err: metaclient: Too Many Requests Aug 10 10:20:19.997886199 (40h54m41.956983457s) [upload=42624]: Done uploading segments... Aug 10 10:20:19.997941961 (40h54m41.957039205s) [upload=42624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.373975645s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.06530026s
FAIL (2025-08-10 10:27:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 1.065324178s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
810.789237ms
FAIL (2025-08-10 10:26:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 810.884446ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X.......................................X.........] duration:
2.362959919s
FAIL (2025-08-10 10:26:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:20:19.882107622 (40h54m41.841204868s) [upload=42624]: Starting upload Aug 10 10:20:19.882183788 (40h54m41.841281033s) [upload=42624]: Done starting upload Aug 10 10:20:19.882403414 (40h54m41.841500651s) [upload=42624]: Uploading segments... Aug 10 10:20:19.882589946 (40h54m41.841687191s) [upload=42624]: Got next segment. Inline: false Aug 10 10:20:19.882629834 (40h54m41.841727082s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:20:19.882635496 (40h54m41.841732741s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:20:19.997832106 (40h54m41.956929364s) [upload=42624]: Next segment err: metaclient: Too Many Requests Aug 10 10:20:19.997886199 (40h54m41.956983457s) [upload=42624]: Done uploading segments... Aug 10 10:20:19.997941961 (40h54m41.957039205s) [upload=42624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.363012368s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X.......................................X........] duration:
2.327427611s
FAIL (2025-08-10 10:25:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:20:19.882107622 (40h54m41.841204868s) [upload=42624]: Starting upload Aug 10 10:20:19.882183788 (40h54m41.841281033s) [upload=42624]: Done starting upload Aug 10 10:20:19.882403414 (40h54m41.841500651s) [upload=42624]: Uploading segments... Aug 10 10:20:19.882589946 (40h54m41.841687191s) [upload=42624]: Got next segment. Inline: false Aug 10 10:20:19.882629834 (40h54m41.841727082s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:20:19.882635496 (40h54m41.841732741s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:20:19.997832106 (40h54m41.956929364s) [upload=42624]: Next segment err: metaclient: Too Many Requests Aug 10 10:20:19.997886199 (40h54m41.956983457s) [upload=42624]: Done uploading segments... Aug 10 10:20:19.997941961 (40h54m41.957039205s) [upload=42624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.327524445s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
847.047123ms
FAIL (2025-08-10 10:25:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 847.078001ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X.......................................X.......] duration:
2.517796134s
FAIL (2025-08-10 10:25:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:20:19.882107622 (40h54m41.841204868s) [upload=42624]: Starting upload Aug 10 10:20:19.882183788 (40h54m41.841281033s) [upload=42624]: Done starting upload Aug 10 10:20:19.882403414 (40h54m41.841500651s) [upload=42624]: Uploading segments... Aug 10 10:20:19.882589946 (40h54m41.841687191s) [upload=42624]: Got next segment. Inline: false Aug 10 10:20:19.882629834 (40h54m41.841727082s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:20:19.882635496 (40h54m41.841732741s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:20:19.997832106 (40h54m41.956929364s) [upload=42624]: Next segment err: metaclient: Too Many Requests Aug 10 10:20:19.997886199 (40h54m41.956983457s) [upload=42624]: Done uploading segments... Aug 10 10:20:19.997941961 (40h54m41.957039205s) [upload=42624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.517834517s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
704.257578ms
FAIL (2025-08-10 10:24:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 10:24:57.291748411 (40h59m19.250845646s) [upload=42706]: Starting upload
Aug 10 10:24:57.291815765 (40h59m19.250913004s) [upload=42706]: Done starting upload
Aug 10 10:24:57.291905855 (40h59m19.251003101s) [upload=42706]: Uploading segments...
Aug 10 10:24:57.291957600 (40h59m19.251054854s) [upload=42706]: Got next segment. Inline: true
Aug 10 10:24:57.291963520 (40h59m19.251060766s) [upload=42706]: Waiting for error group managing segments...
Aug 10 10:24:57.292198738 (40h59m19.251295973s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 10:24:57.292206599 (40h59m19.251303843s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 10:24:57.292217693 (40h59m19.251314928s) [upload=42706]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 10:24:57.434783639 (40h59m19.393880872s) [upload=42706]: Done uploading segments...
Aug 10 10:24:57.434803856 (40h59m19.39390109s) [upload=42706]: Upload finished. err: <nil>
Duration: 704.357233ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X.......................................X......] duration:
2.492387335s
FAIL (2025-08-10 10:24:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:20:19.882107622 (40h54m41.841204868s) [upload=42624]: Starting upload Aug 10 10:20:19.882183788 (40h54m41.841281033s) [upload=42624]: Done starting upload Aug 10 10:20:19.882403414 (40h54m41.841500651s) [upload=42624]: Uploading segments... Aug 10 10:20:19.882589946 (40h54m41.841687191s) [upload=42624]: Got next segment. Inline: false Aug 10 10:20:19.882629834 (40h54m41.841727082s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:20:19.882635496 (40h54m41.841732741s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:20:19.997832106 (40h54m41.956929364s) [upload=42624]: Next segment err: metaclient: Too Many Requests Aug 10 10:20:19.997886199 (40h54m41.956983457s) [upload=42624]: Done uploading segments... Aug 10 10:20:19.997941961 (40h54m41.957039205s) [upload=42624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.492434301s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X.......................................X.....] duration:
2.432155106s
FAIL (2025-08-10 10:23:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:20:19.882107622 (40h54m41.841204868s) [upload=42624]: Starting upload Aug 10 10:20:19.882183788 (40h54m41.841281033s) [upload=42624]: Done starting upload Aug 10 10:20:19.882403414 (40h54m41.841500651s) [upload=42624]: Uploading segments... Aug 10 10:20:19.882589946 (40h54m41.841687191s) [upload=42624]: Got next segment. Inline: false Aug 10 10:20:19.882629834 (40h54m41.841727082s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:20:19.882635496 (40h54m41.841732741s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:20:19.997832106 (40h54m41.956929364s) [upload=42624]: Next segment err: metaclient: Too Many Requests Aug 10 10:20:19.997886199 (40h54m41.956983457s) [upload=42624]: Done uploading segments... Aug 10 10:20:19.997941961 (40h54m41.957039205s) [upload=42624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.432189985s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X.......................................X....] duration:
2.268811244s
FAIL (2025-08-10 10:23:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:20:19.882107622 (40h54m41.841204868s) [upload=42624]: Starting upload Aug 10 10:20:19.882183788 (40h54m41.841281033s) [upload=42624]: Done starting upload Aug 10 10:20:19.882403414 (40h54m41.841500651s) [upload=42624]: Uploading segments... Aug 10 10:20:19.882589946 (40h54m41.841687191s) [upload=42624]: Got next segment. Inline: false Aug 10 10:20:19.882629834 (40h54m41.841727082s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:20:19.882635496 (40h54m41.841732741s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:20:19.997832106 (40h54m41.956929364s) [upload=42624]: Next segment err: metaclient: Too Many Requests Aug 10 10:20:19.997886199 (40h54m41.956983457s) [upload=42624]: Done uploading segments... Aug 10 10:20:19.997941961 (40h54m41.957039205s) [upload=42624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.268840949s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X.......................................X...] duration:
2.30976644s
FAIL (2025-08-10 10:22:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:20:19.882107622 (40h54m41.841204868s) [upload=42624]: Starting upload Aug 10 10:20:19.882183788 (40h54m41.841281033s) [upload=42624]: Done starting upload Aug 10 10:20:19.882403414 (40h54m41.841500651s) [upload=42624]: Uploading segments... Aug 10 10:20:19.882589946 (40h54m41.841687191s) [upload=42624]: Got next segment. Inline: false Aug 10 10:20:19.882629834 (40h54m41.841727082s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:20:19.882635496 (40h54m41.841732741s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:20:19.997832106 (40h54m41.956929364s) [upload=42624]: Next segment err: metaclient: Too Many Requests Aug 10 10:20:19.997886199 (40h54m41.956983457s) [upload=42624]: Done uploading segments... Aug 10 10:20:19.997941961 (40h54m41.957039205s) [upload=42624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.309794311s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X.......................................X..] duration:
2.262964237s
FAIL (2025-08-10 10:21:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:20:19.882107622 (40h54m41.841204868s) [upload=42624]: Starting upload Aug 10 10:20:19.882183788 (40h54m41.841281033s) [upload=42624]: Done starting upload Aug 10 10:20:19.882403414 (40h54m41.841500651s) [upload=42624]: Uploading segments... Aug 10 10:20:19.882589946 (40h54m41.841687191s) [upload=42624]: Got next segment. Inline: false Aug 10 10:20:19.882629834 (40h54m41.841727082s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:20:19.882635496 (40h54m41.841732741s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:20:19.997832106 (40h54m41.956929364s) [upload=42624]: Next segment err: metaclient: Too Many Requests Aug 10 10:20:19.997886199 (40h54m41.956983457s) [upload=42624]: Done uploading segments... Aug 10 10:20:19.997941961 (40h54m41.957039205s) [upload=42624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.262995298s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X.......................................X.] duration:
2.250315912s
FAIL (2025-08-10 10:21:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:20:19.882107622 (40h54m41.841204868s) [upload=42624]: Starting upload Aug 10 10:20:19.882183788 (40h54m41.841281033s) [upload=42624]: Done starting upload Aug 10 10:20:19.882403414 (40h54m41.841500651s) [upload=42624]: Uploading segments... Aug 10 10:20:19.882589946 (40h54m41.841687191s) [upload=42624]: Got next segment. Inline: false Aug 10 10:20:19.882629834 (40h54m41.841727082s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:20:19.882635496 (40h54m41.841732741s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:20:19.997832106 (40h54m41.956929364s) [upload=42624]: Next segment err: metaclient: Too Many Requests Aug 10 10:20:19.997886199 (40h54m41.956983457s) [upload=42624]: Done uploading segments... Aug 10 10:20:19.997941961 (40h54m41.957039205s) [upload=42624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.250355425s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X.......................................X] duration:
392.236956ms
FAIL (2025-08-10 10:20:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 10:20:19.882107622 (40h54m41.841204868s) [upload=42624]: Starting upload Aug 10 10:20:19.882183788 (40h54m41.841281033s) [upload=42624]: Done starting upload Aug 10 10:20:19.882403414 (40h54m41.841500651s) [upload=42624]: Uploading segments... Aug 10 10:20:19.882589946 (40h54m41.841687191s) [upload=42624]: Got next segment. Inline: false Aug 10 10:20:19.882629834 (40h54m41.841727082s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 10:20:19.882635496 (40h54m41.841732741s) [upload=42624]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 10:20:19.997832106 (40h54m41.956929364s) [upload=42624]: Next segment err: metaclient: Too Many Requests Aug 10 10:20:19.997886199 (40h54m41.956983457s) [upload=42624]: Done uploading segments... Aug 10 10:20:19.997941961 (40h54m41.957039205s) [upload=42624]: Upload finished. err: metaclient: Too Many Requests
Duration: 392.264806ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.28463297s
FAIL (2025-08-10 10:19:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.284663867s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.040411009s
FAIL (2025-08-10 10:18:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.040457038s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.37607216s
FAIL (2025-08-10 10:18:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 09:49:03.421047280 (40h23m25.380144518s) [upload=42093]: Starting upload
Aug 10 09:49:03.421108870 (40h23m25.380206108s) [upload=42093]: Done starting upload
Aug 10 09:49:03.421369110 (40h23m25.380466359s) [upload=42093]: Uploading segments...
Aug 10 09:49:03.421453157 (40h23m25.380550417s) [upload=42093]: Got next segment. Inline: false
Aug 10 09:49:03.421501824 (40h23m25.380599057s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 09:49:03.421507882 (40h23m25.380605139s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 09:49:03.707469701 (40h23m25.666566983s) [seg_pos={0 0}, upload=42093]: Begin upload segment...
Aug 10 09:49:03.707656275 (40h23m25.666753532s) [seg_pos={0 0}, upload=42093]: Done begin upload segment.
Aug 10 09:49:03.707680094 (40h23m25.666777379s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.707726082 (40h23m25.666823339s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708312378 (40h23m25.667409633s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708371486 (40h23m25.667468736s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.708730685 (40h23m25.667827943s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.709112797 (40h23m25.668210053s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710115803 (40h23m25.669213059s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710516037 (40h23m25.669613287s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.710855740 (40h23m25.669952994s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711192316 (40h23m25.670289562s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.711499300 (40h23m25.670596547s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712148886 (40h23m25.671246143s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712512634 (40h23m25.671609888s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.712926372 (40h23m25.672023628s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713294954 (40h23m25.67239226s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.713666408 (40h23m25.672763665s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714186226 (40h23m25.673283479s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:03.714247461 (40h23m25.673344698s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Uploading piece...
Aug 10 09:49:04.269863256 (40h23m26.228960513s) [upload=42093]: Next returned nil segment
Aug 10 09:49:04.269889848 (40h23m26.228987108s) [upload=42093]: Waiting for error group managing segments...
Aug 10 09:49:04.453774433 (40h23m26.412871672s) [noise=true , address=104.36.82.44:4871 , piece_id=F7AT3BZWPHJLZES4GGA4NJOFNJ66E3T5FVJTP2TNEZAFPRBQIZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.454110018 (40h23m26.413207269s) [noise=true , address=104.36.82.23:4458 , piece_id=HTJ2BEDPNBOV3UIBSK3AKPRHIJJOSJPNL6A77GJRVY7XDSPY3SCQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.458195491 (40h23m26.417292748s) [noise=true , address=104.36.82.16:4314 , piece_id=DPDX6OPWKJABC6JENCQXSVQZBQZP2LUXEJVZFJC7V3F35NO2N2KA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.460433366 (40h23m26.419530613s) [noise=true , address=45.91.116.7:4018 , piece_id=LDOINY6BPTNY5N4PHHPZOJ6ZBAMYGW3A5GU6KMWSAIU4GTBVQCKA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.468941287 (40h23m26.42803853s) [noise=true , address=104.36.82.12:4169 , piece_id=VJ5UE4GYY7WQ2NVGDN44RHHU5OSPLXMNJGAZUSQHJHUG26JYWCMA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.471064658 (40h23m26.430161895s) [noise=true , address=45.91.116.4:4962 , piece_id=6VX6J7C55PNMVNU7JSRI7F7LYQ2VKSNYTGBAJBQ6AYYJAIQBKMSA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.473177446 (40h23m26.432274684s) [noise=true , address=104.36.82.54:4190 , piece_id=BG4NPCQYBTWPQK4RS7HXDF3QLJGVTY7MYZCE33KWHEMH7VOXFYPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478196144 (40h23m26.43729338s) [noise=true , address=104.36.82.9:4026 , piece_id=BDAJW5XJBW53PA4MY4NX4ATMJ2AZDISUU6GOCAW2AQGU4FIL6JDA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.478423239 (40h23m26.437520484s) [noise=true , address=104.36.82.22:4510 , piece_id=FD4DTK7XZV6LUQO7KJIOPNFDF4NP446MNL6ZLMMOFCERSIUHMSIQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.480537262 (40h23m26.439634498s) [noise=true , address=104.36.82.47:4547 , piece_id=JROLRUKBDSRWEJP7WMZKN53WSTD27LLJ4MHBZSOYOK4OIZYESTEQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.481312460 (40h23m26.440409707s) [noise=true , address=104.36.82.37:4655 , piece_id=3UW62WTMNONEKUUFZYPRPF5XDFRRZKZNVQHQA3LHYVBL3RLEKUGQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.482408502 (40h23m26.441505748s) [noise=true , address=104.36.82.62:4437 , piece_id=Q7BMYDXF42CTVXQ3NFQKOWXJYOEG3OTR5GRJNKO2JULFJPPIIYEA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.483929624 (40h23m26.443026874s) [noise=true , address=104.36.82.36:4627 , piece_id=UVUJ63QMCS6ZOPHAVEVKYAG6DAOXA7BAXG7Y5VHHII5O7FEMEZ7A, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486355828 (40h23m26.445453062s) [noise=true , address=104.36.82.17:4344 , piece_id=OH6KUFCNXY54KPXJSEGB4RDD74EUQFPU7HZMBWQC7JCG6O3D5AAA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: <nil>
Aug 10 09:49:04.486387198 (40h23m26.445484442s) [seg_pos={0 0}, upload=42093]: Segment reached optimal threshold of 14 pieces.
Aug 10 09:49:04.486550575 (40h23m26.445647821s) [noise=true , address=104.36.82.61:4395 , piece_id=RMT47ISC4GPNGK4XV237TBWSQTPRZ5VHNRPSPXUAKPN7SEXDAWFQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BZnnbpp63tb9YBYEym3fuvJB4fR1L2GPTpWPbESbVgAXHpa64): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486625096 (40h23m26.445722341s) [noise=true , address=64.49.13.140:4511 , piece_id=TZYRYIAYPOD5VE6KJQX3HFRWVPY4UMOPKIKCMLYLNOBKCPHBPYRQ, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49460->64.49.13.140:4511: use of closed network connection
Aug 10 09:49:04.486644090 (40h23m26.445741324s) [noise=true , address=104.36.82.58:4285 , piece_id=NDH4NLS2GVJTP2ZSVK6DVATJY6IMJYGMWSHH3S7JY6B6M6UCB3FA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: expected piece hash; context canceled; EOF
Aug 10 09:49:04.486736362 (40h23m26.445833595s) [noise=true , address=64.49.13.139:4478 , piece_id=MEN6VMTOGMR7R7GINPURXP4J6SHI4M64NKW73K5GMFFNZ3BBQKPA, seg_pos={0 0}, upload=42093]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37148->64.49.13.139:4478: use of closed network connection
Aug 10 09:49:04.486753343 (40h23m26.445850574s) [seg_pos={0 0}, upload=42093]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 09:49:04.486832383 (40h23m26.445929631s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 09:49:04.486847318 (40h23m26.445944562s) [upload=42093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 09:49:05.403027370 (40h23m27.362124639s) [upload=42093]: Done uploading segments...
Aug 10 09:49:05.403075682 (40h23m27.362172927s) [upload=42093]: Upload finished. err: <nil>
Duration: 2.376097958s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
819.043491ms
FAIL (2025-08-10 10:18:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 09:38:04.958750893 (40h12m26.917848147s) [upload=41893]: Starting upload Aug 10 09:38:04.958926665 (40h12m26.918023919s) [upload=41893]: Done starting upload Aug 10 09:38:04.959050834 (40h12m26.91814808s) [upload=41893]: Uploading segments... Aug 10 09:38:04.959164057 (40h12m26.918261308s) [upload=41893]: Got next segment. Inline: true Aug 10 09:38:04.959173027 (40h12m26.91827028s) [upload=41893]: Waiting for error group managing segments... Aug 10 09:38:04.959254227 (40h12m26.918351485s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 09:38:04.959261506 (40h12m26.918358761s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 09:38:04.959266275 (40h12m26.918363527s) [upload=41893]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 09:38:05.096216947 (40h12m27.055314192s) [upload=41893]: Done uploading segments... Aug 10 09:38:05.096236243 (40h12m27.055333478s) [upload=41893]: Upload finished. err: metaclient: Too Many Requests
Duration: 819.101981ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|