Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X......................XX......................] duration:
2.235669512s
FAIL (2025-08-09 06:38:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.235698562s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X......................XX.....................] duration:
2.401104883s
FAIL (2025-08-09 06:37:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.401134524s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X......................XX....................] duration:
2.312772508s
FAIL (2025-08-09 06:36:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.312814031s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X......................XX...................] duration:
2.374131796s
FAIL (2025-08-09 06:35:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.374167187s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X......................XX..................] duration:
2.311952056s
FAIL (2025-08-09 06:35:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.311983405s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X......................XX.................] duration:
2.475046923s
FAIL (2025-08-09 06:33:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.475075599s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X......................XX................] duration:
2.361084995s
FAIL (2025-08-09 06:32:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.36111595s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X......................XX...............] duration:
2.588832604s
FAIL (2025-08-09 06:32:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.588950555s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X......................XX..............] duration:
2.328811152s
FAIL (2025-08-09 06:31:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.328856227s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X......................XX.............] duration:
2.367034571s
FAIL (2025-08-09 06:30:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.367053586s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X......................XX............] duration:
2.278913174s
FAIL (2025-08-09 06:29:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.278939297s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X......................XX...........] duration:
2.351221194s
FAIL (2025-08-09 06:29:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.351272018s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X......................XX..........] duration:
2.323844657s
FAIL (2025-08-09 06:28:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.32401369s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X......................XX.........] duration:
2.369142242s
FAIL (2025-08-09 06:28:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.369183407s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X......................XX........] duration:
2.358879266s
FAIL (2025-08-09 06:27:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.358912068s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.141790269s
FAIL (2025-08-09 06:26:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 05:42:04.688066112 (12h16m26.647163361s) [upload=12736]: Starting upload Aug 9 05:42:04.688172228 (12h16m26.647269484s) [upload=12736]: Done starting upload Aug 9 05:42:04.688317761 (12h16m26.647415007s) [upload=12736]: Uploading segments... Aug 9 05:42:04.688428477 (12h16m26.647525734s) [upload=12736]: Got next segment. Inline: true Aug 9 05:42:04.688438845 (12h16m26.647536093s) [upload=12736]: Waiting for error group managing segments... Aug 9 05:42:04.688554471 (12h16m26.647651748s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 05:42:04.688562072 (12h16m26.647659324s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 05:42:04.688567027 (12h16m26.647664276s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 05:42:04.779627204 (12h16m26.738724452s) [upload=12736]: Done uploading segments... Aug 9 05:42:04.779647843 (12h16m26.738745089s) [upload=12736]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.141830289s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................X......................XX.......] duration:
2.951628777s
FAIL (2025-08-09 06:25:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.951656508s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............................X......................XX......] duration:
2.363617763s
FAIL (2025-08-09 06:25:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.363650147s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
831.839664ms
FAIL (2025-08-09 06:25:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 05:42:04.688066112 (12h16m26.647163361s) [upload=12736]: Starting upload Aug 9 05:42:04.688172228 (12h16m26.647269484s) [upload=12736]: Done starting upload Aug 9 05:42:04.688317761 (12h16m26.647415007s) [upload=12736]: Uploading segments... Aug 9 05:42:04.688428477 (12h16m26.647525734s) [upload=12736]: Got next segment. Inline: true Aug 9 05:42:04.688438845 (12h16m26.647536093s) [upload=12736]: Waiting for error group managing segments... Aug 9 05:42:04.688554471 (12h16m26.647651748s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 05:42:04.688562072 (12h16m26.647659324s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 05:42:04.688567027 (12h16m26.647664276s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 05:42:04.779627204 (12h16m26.738724452s) [upload=12736]: Done uploading segments... Aug 9 05:42:04.779647843 (12h16m26.738745089s) [upload=12736]: Upload finished. err: metaclient: Too Many Requests
Duration: 831.858718ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............................X......................XX.....] duration:
2.357045896s
FAIL (2025-08-09 06:25:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.35708026s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
799.379347ms
FAIL (2025-08-09 06:24:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 05:42:04.688066112 (12h16m26.647163361s) [upload=12736]: Starting upload Aug 9 05:42:04.688172228 (12h16m26.647269484s) [upload=12736]: Done starting upload Aug 9 05:42:04.688317761 (12h16m26.647415007s) [upload=12736]: Uploading segments... Aug 9 05:42:04.688428477 (12h16m26.647525734s) [upload=12736]: Got next segment. Inline: true Aug 9 05:42:04.688438845 (12h16m26.647536093s) [upload=12736]: Waiting for error group managing segments... Aug 9 05:42:04.688554471 (12h16m26.647651748s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 05:42:04.688562072 (12h16m26.647659324s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 05:42:04.688567027 (12h16m26.647664276s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 05:42:04.779627204 (12h16m26.738724452s) [upload=12736]: Done uploading segments... Aug 9 05:42:04.779647843 (12h16m26.738745089s) [upload=12736]: Upload finished. err: metaclient: Too Many Requests
Duration: 799.410075ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............................X......................XX....] duration:
2.504448298s
FAIL (2025-08-09 06:24:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.504479313s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
873.862939ms
FAIL (2025-08-09 06:24:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 05:42:04.688066112 (12h16m26.647163361s) [upload=12736]: Starting upload Aug 9 05:42:04.688172228 (12h16m26.647269484s) [upload=12736]: Done starting upload Aug 9 05:42:04.688317761 (12h16m26.647415007s) [upload=12736]: Uploading segments... Aug 9 05:42:04.688428477 (12h16m26.647525734s) [upload=12736]: Got next segment. Inline: true Aug 9 05:42:04.688438845 (12h16m26.647536093s) [upload=12736]: Waiting for error group managing segments... Aug 9 05:42:04.688554471 (12h16m26.647651748s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 05:42:04.688562072 (12h16m26.647659324s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 05:42:04.688567027 (12h16m26.647664276s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 05:42:04.779627204 (12h16m26.738724452s) [upload=12736]: Done uploading segments... Aug 9 05:42:04.779647843 (12h16m26.738745089s) [upload=12736]: Upload finished. err: metaclient: Too Many Requests
Duration: 873.896466ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................................X......................XX...] duration:
2.313003775s
FAIL (2025-08-09 06:23:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.31303579s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
826.997909ms
FAIL (2025-08-09 06:23:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 05:42:04.688066112 (12h16m26.647163361s) [upload=12736]: Starting upload Aug 9 05:42:04.688172228 (12h16m26.647269484s) [upload=12736]: Done starting upload Aug 9 05:42:04.688317761 (12h16m26.647415007s) [upload=12736]: Uploading segments... Aug 9 05:42:04.688428477 (12h16m26.647525734s) [upload=12736]: Got next segment. Inline: true Aug 9 05:42:04.688438845 (12h16m26.647536093s) [upload=12736]: Waiting for error group managing segments... Aug 9 05:42:04.688554471 (12h16m26.647651748s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 05:42:04.688562072 (12h16m26.647659324s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 05:42:04.688567027 (12h16m26.647664276s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 05:42:04.779627204 (12h16m26.738724452s) [upload=12736]: Done uploading segments... Aug 9 05:42:04.779647843 (12h16m26.738745089s) [upload=12736]: Upload finished. err: metaclient: Too Many Requests
Duration: 827.02246ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................................X......................XX..] duration:
2.41489208s
FAIL (2025-08-09 06:22:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.414925148s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
821.184444ms
FAIL (2025-08-09 06:22:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 05:42:04.688066112 (12h16m26.647163361s) [upload=12736]: Starting upload Aug 9 05:42:04.688172228 (12h16m26.647269484s) [upload=12736]: Done starting upload Aug 9 05:42:04.688317761 (12h16m26.647415007s) [upload=12736]: Uploading segments... Aug 9 05:42:04.688428477 (12h16m26.647525734s) [upload=12736]: Got next segment. Inline: true Aug 9 05:42:04.688438845 (12h16m26.647536093s) [upload=12736]: Waiting for error group managing segments... Aug 9 05:42:04.688554471 (12h16m26.647651748s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 05:42:04.688562072 (12h16m26.647659324s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 05:42:04.688567027 (12h16m26.647664276s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 05:42:04.779627204 (12h16m26.738724452s) [upload=12736]: Done uploading segments... Aug 9 05:42:04.779647843 (12h16m26.738745089s) [upload=12736]: Upload finished. err: metaclient: Too Many Requests
Duration: 821.219029ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.066908378s
FAIL (2025-08-09 06:21:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 05:42:04.688066112 (12h16m26.647163361s) [upload=12736]: Starting upload Aug 9 05:42:04.688172228 (12h16m26.647269484s) [upload=12736]: Done starting upload Aug 9 05:42:04.688317761 (12h16m26.647415007s) [upload=12736]: Uploading segments... Aug 9 05:42:04.688428477 (12h16m26.647525734s) [upload=12736]: Got next segment. Inline: true Aug 9 05:42:04.688438845 (12h16m26.647536093s) [upload=12736]: Waiting for error group managing segments... Aug 9 05:42:04.688554471 (12h16m26.647651748s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 05:42:04.688562072 (12h16m26.647659324s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 05:42:04.688567027 (12h16m26.647664276s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 05:42:04.779627204 (12h16m26.738724452s) [upload=12736]: Done uploading segments... Aug 9 05:42:04.779647843 (12h16m26.738745089s) [upload=12736]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.066940066s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
845.865256ms
FAIL (2025-08-09 06:21:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 05:42:04.688066112 (12h16m26.647163361s) [upload=12736]: Starting upload Aug 9 05:42:04.688172228 (12h16m26.647269484s) [upload=12736]: Done starting upload Aug 9 05:42:04.688317761 (12h16m26.647415007s) [upload=12736]: Uploading segments... Aug 9 05:42:04.688428477 (12h16m26.647525734s) [upload=12736]: Got next segment. Inline: true Aug 9 05:42:04.688438845 (12h16m26.647536093s) [upload=12736]: Waiting for error group managing segments... Aug 9 05:42:04.688554471 (12h16m26.647651748s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 05:42:04.688562072 (12h16m26.647659324s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 05:42:04.688567027 (12h16m26.647664276s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 05:42:04.779627204 (12h16m26.738724452s) [upload=12736]: Done uploading segments... Aug 9 05:42:04.779647843 (12h16m26.738745089s) [upload=12736]: Upload finished. err: metaclient: Too Many Requests
Duration: 845.950152ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................................X......................XX.] duration:
2.47676524s
FAIL (2025-08-09 06:21:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.476818822s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................................X......................XX] duration:
371.303281ms
FAIL (2025-08-09 06:21:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 06:21:00.686533684 (12h55m22.645630919s) [upload=13421]: Starting upload Aug 9 06:21:00.686791748 (12h55m22.645888994s) [upload=13421]: Done starting upload Aug 9 06:21:00.686959325 (12h55m22.646056576s) [upload=13421]: Uploading segments... Aug 9 06:21:00.687143467 (12h55m22.646240707s) [upload=13421]: Got next segment. Inline: false Aug 9 06:21:00.687208910 (12h55m22.646306155s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 06:21:00.687215107 (12h55m22.646312342s) [upload=13421]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 06:21:00.778354768 (12h55m22.737452016s) [upload=13421]: Next segment err: metaclient: Too Many Requests Aug 9 06:21:00.778405178 (12h55m22.737502423s) [upload=13421]: Done uploading segments... Aug 9 06:21:00.778421488 (12h55m22.73751872s) [upload=13421]: Upload finished. err: metaclient: Too Many Requests
Duration: 371.328414ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
841.252772ms
FAIL (2025-08-09 06:20:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 05:42:04.688066112 (12h16m26.647163361s) [upload=12736]: Starting upload Aug 9 05:42:04.688172228 (12h16m26.647269484s) [upload=12736]: Done starting upload Aug 9 05:42:04.688317761 (12h16m26.647415007s) [upload=12736]: Uploading segments... Aug 9 05:42:04.688428477 (12h16m26.647525734s) [upload=12736]: Got next segment. Inline: true Aug 9 05:42:04.688438845 (12h16m26.647536093s) [upload=12736]: Waiting for error group managing segments... Aug 9 05:42:04.688554471 (12h16m26.647651748s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 05:42:04.688562072 (12h16m26.647659324s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 05:42:04.688567027 (12h16m26.647664276s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 05:42:04.779627204 (12h16m26.738724452s) [upload=12736]: Done uploading segments... Aug 9 05:42:04.779647843 (12h16m26.738745089s) [upload=12736]: Upload finished. err: metaclient: Too Many Requests
Duration: 841.2803ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X......................X] duration:
1.75186915s
FAIL (2025-08-09 06:20:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 06:20:22.015620340 (12h54m43.974717587s) [upload=13409]: Starting upload
Aug 9 06:20:22.015685895 (12h54m43.974783142s) [upload=13409]: Done starting upload
Aug 9 06:20:22.016033046 (12h54m43.975130291s) [upload=13409]: Uploading segments...
Aug 9 06:20:22.016105878 (12h54m43.975203201s) [upload=13409]: Got next segment. Inline: false
Aug 9 06:20:22.016172797 (12h54m43.975270044s) [upload=13409]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 06:20:22.016178886 (12h54m43.975276133s) [upload=13409]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 06:20:22.231534802 (12h54m44.190632123s) [seg_pos={0 0}, upload=13409]: Begin upload segment...
Aug 9 06:20:22.231608782 (12h54m44.190706014s) [seg_pos={0 0}, upload=13409]: Done begin upload segment.
Aug 9 06:20:22.231657679 (12h54m44.190754935s) [noise=true , address=104.36.82.3:4796 , piece_id=N63GABQESULHCTJUG5QFU3SZLMXXYY6VG2ZYOH5FV5X33V77WOAQ, seg_pos={0 0}, upload=13409]: Uploading piece...
Aug 9 06:20:22.231673481 (12h54m44.190770736s) [noise=true , address=104.36.82.45:4917 , piece_id=5RLRN6JZNORZMNDIN4FTNZTEYLAF6QGHRUMKUAP6HCLRQ5INI4GQ, seg_pos={0 0}, upload=13409]: Uploading piece...
Aug 9 06:20:22.232210516 (12h54m44.191307768s) [noise=true , address=104.36.82.16:4301 , piece_id=52C2WRR3DPMQGM2B4EXI6YJW6FPS5SEWEIJN5LACKE3VWNDI7CKA, seg_pos={0 0}, upload=13409]: Uploading piece...
Aug 9 06:20:22.233299164 (12h54m44.192396409s) [noise=true , address=104.36.82.17:4359 , piece_id=3ZDZXC5YCJZYGZH6VH2X5OO6OZTTFMSFY637ZYD2C4HMNJUN7GCA, seg_pos={0 0}, upload=13409]: Uploading piece...
Aug 9 06:20:22.233500340 (12h54m44.192597596s) [noise=true , address=64.49.13.27:4964 , piece_id=QCOGBS7ND55UTZSYFSAPZXDS2R72HXT6KSYIXAYS7HLQWHSS6IBA, seg_pos={0 0}, upload=13409]: Uploading piece...
Aug 9 06:20:22.233865074 (12h54m44.19296233s) [noise=true , address=104.36.82.23:4466 , piece_id=Z4DVAZYH3M64ZGV5FBPZA6D7VCYPHKZG5QYKQMZW3IBIW4HYWSUA, seg_pos={0 0}, upload=13409]: Uploading piece...
Aug 9 06:20:22.234049615 (12h54m44.193146855s) [noise=true , address=104.36.82.47:4544 , piece_id=ZAFGG3SARHBBNUNJ7OCOTAZMTT3XVQRQTMTMGMNF6LU33X7D73NA, seg_pos={0 0}, upload=13409]: Uploading piece...
Aug 9 06:20:22.234381735 (12h54m44.193478987s) [noise=true , address=45.91.116.10:4110 , piece_id=D72Z5ALTGQ2RB7SFD3TGIT6QFHOBDHP4I3G2XWQTMYGIV22L5HWQ, seg_pos={0 0}, upload=13409]: Uploading piece...
Aug 9 06:20:22.234514130 (12h54m44.193611371s) [noise=true , address=104.36.82.52:4111 , piece_id=WKP5F4DXKG4Q2EBPAL73H76INVQNEBP3OUYPGIU5CPO77TDJJL7A, seg_pos={0 0}, upload=13409]: Uploading piece...
Aug 9 06:20:22.235008175 (12h54m44.194105415s) [noise=true , address=104.36.82.19:4407 , piece_id=YYKOUWLXECF7V2XTMK5PP3RDOAP3LWVWLG6XPA6BRXOWQBD5WTNQ, seg_pos={0 0}, upload=13409]: Uploading piece...
Aug 9 06:20:22.235015921 (12h54m44.194113174s) [noise=true , address=104.36.82.36:4645 , piece_id=KHEPLJJVE6WJVAF4TBTU45YGDPBR5DCFYCK3UR4FS36PTJHBQQFA, seg_pos={0 0}, upload=13409]: Uploading piece...
Aug 9 06:20:22.235462043 (12h54m44.194559299s) [noise=true , address=104.36.82.55:4217 , piece_id=TTVULPUQIAUDVR55SBJHAJ5UQTP7KSBTZEAQ7X2M4ESL7S77MDXA, seg_pos={0 0}, upload=13409]: Uploading piece...
Aug 9 06:20:22.235911226 (12h54m44.195008477s) [noise=true , address=104.36.82.60:4372 , piece_id=B5S5LCLPSKSV73FRHGVFG2YZS5HNS5OCWAXKYGCVT6I2YIQSU2RA, seg_pos={0 0}, upload=13409]: Uploading piece...
Aug 9 06:20:22.236404345 (12h54m44.195501602s) [noise=true , address=104.36.82.59:4315 , piece_id=BEAHQXE7VAHVURUQWNUKJWGFFX4J2SYZAEN5EZGNOEXFJ4JQXIEQ, seg_pos={0 0}, upload=13409]: Uploading piece...
Aug 9 06:20:22.236843484 (12h54m44.195940731s) [noise=true , address=104.36.82.61:4383 , piece_id=XHHH5TP6AFL75TZMT4MF6FW5W77LE24V6KT3CEUB4UQX32LQ565A, seg_pos={0 0}, upload=13409]: Uploading piece...
Aug 9 06:20:22.237323455 (12h54m44.196420704s) [noise=true , address=104.36.82.56:4247 , piece_id=5ZPUNSRCYSM2FJ3WWWKHYMICCXD2QTBZZCYOEKYWOI2AOBUBBOVA, seg_pos={0 0}, upload=13409]: Uploading piece...
Aug 9 06:20:22.237530452 (12h54m44.196627715s) [noise=true , address=64.49.13.26:4952 , piece_id=VOUJMGH7DZ2PCNORDSCAHQCDRYCH2Y5FFBDPHB74RVP4YA4BRJWQ, seg_pos={0 0}, upload=13409]: Uploading piece...
Aug 9 06:20:22.238074801 (12h54m44.197172065s) [noise=true , address=45.91.116.13:4157 , piece_id=KQWNUBLXOIPIMOE36LNH3H6KW6OUEZPEOKMMFVKHMMKBYKQRGV6A, seg_pos={0 0}, upload=13409]: Uploading piece...
Aug 9 06:20:22.809481036 (12h54m44.768578271s) [upload=13409]: Next returned nil segment
Aug 9 06:20:22.809520504 (12h54m44.76861775s) [upload=13409]: Waiting for error group managing segments...
Aug 9 06:20:22.940738269 (12h54m44.899835539s) [noise=true , address=45.91.116.13:4157 , piece_id=KQWNUBLXOIPIMOE36LNH3H6KW6OUEZPEOKMMFVKHMMKBYKQRGV6A, seg_pos={0 0}, upload=13409]: Done uploading piece. err: <nil>
Aug 9 06:20:22.941349549 (12h54m44.900446786s) [noise=true , address=45.91.116.10:4110 , piece_id=D72Z5ALTGQ2RB7SFD3TGIT6QFHOBDHP4I3G2XWQTMYGIV22L5HWQ, seg_pos={0 0}, upload=13409]: Done uploading piece. err: <nil>
Aug 9 06:20:22.953194507 (12h54m44.912291744s) [noise=true , address=104.36.82.3:4796 , piece_id=N63GABQESULHCTJUG5QFU3SZLMXXYY6VG2ZYOH5FV5X33V77WOAQ, seg_pos={0 0}, upload=13409]: Done uploading piece. err: <nil>
Aug 9 06:20:22.958177769 (12h54m44.917275023s) [noise=true , address=104.36.82.61:4383 , piece_id=XHHH5TP6AFL75TZMT4MF6FW5W77LE24V6KT3CEUB4UQX32LQ565A, seg_pos={0 0}, upload=13409]: Done uploading piece. err: <nil>
Aug 9 06:20:22.959689566 (12h54m44.918786806s) [noise=true , address=104.36.82.19:4407 , piece_id=YYKOUWLXECF7V2XTMK5PP3RDOAP3LWVWLG6XPA6BRXOWQBD5WTNQ, seg_pos={0 0}, upload=13409]: Done uploading piece. err: <nil>
Aug 9 06:20:22.976359053 (12h54m44.935456305s) [noise=true , address=104.36.82.45:4917 , piece_id=5RLRN6JZNORZMNDIN4FTNZTEYLAF6QGHRUMKUAP6HCLRQ5INI4GQ, seg_pos={0 0}, upload=13409]: Done uploading piece. err: <nil>
Aug 9 06:20:22.977489855 (12h54m44.936587109s) [noise=true , address=104.36.82.47:4544 , piece_id=ZAFGG3SARHBBNUNJ7OCOTAZMTT3XVQRQTMTMGMNF6LU33X7D73NA, seg_pos={0 0}, upload=13409]: Done uploading piece. err: <nil>
Aug 9 06:20:22.977615160 (12h54m44.936712393s) [noise=true , address=104.36.82.59:4315 , piece_id=BEAHQXE7VAHVURUQWNUKJWGFFX4J2SYZAEN5EZGNOEXFJ4JQXIEQ, seg_pos={0 0}, upload=13409]: Done uploading piece. err: <nil>
Aug 9 06:20:22.978268924 (12h54m44.937366182s) [noise=true , address=104.36.82.36:4645 , piece_id=KHEPLJJVE6WJVAF4TBTU45YGDPBR5DCFYCK3UR4FS36PTJHBQQFA, seg_pos={0 0}, upload=13409]: Done uploading piece. err: <nil>
Aug 9 06:20:22.979459795 (12h54m44.938557033s) [noise=true , address=104.36.82.60:4372 , piece_id=B5S5LCLPSKSV73FRHGVFG2YZS5HNS5OCWAXKYGCVT6I2YIQSU2RA, seg_pos={0 0}, upload=13409]: Done uploading piece. err: <nil>
Aug 9 06:20:22.979583950 (12h54m44.938681198s) [noise=true , address=104.36.82.56:4247 , piece_id=5ZPUNSRCYSM2FJ3WWWKHYMICCXD2QTBZZCYOEKYWOI2AOBUBBOVA, seg_pos={0 0}, upload=13409]: Done uploading piece. err: <nil>
Aug 9 06:20:22.980085611 (12h54m44.939182843s) [noise=true , address=104.36.82.52:4111 , piece_id=WKP5F4DXKG4Q2EBPAL73H76INVQNEBP3OUYPGIU5CPO77TDJJL7A, seg_pos={0 0}, upload=13409]: Done uploading piece. err: <nil>
Aug 9 06:20:22.980332213 (12h54m44.939429463s) [noise=true , address=104.36.82.55:4217 , piece_id=TTVULPUQIAUDVR55SBJHAJ5UQTP7KSBTZEAQ7X2M4ESL7S77MDXA, seg_pos={0 0}, upload=13409]: Done uploading piece. err: <nil>
Aug 9 06:20:22.980565258 (12h54m44.939662496s) [noise=true , address=104.36.82.17:4359 , piece_id=3ZDZXC5YCJZYGZH6VH2X5OO6OZTTFMSFY637ZYD2C4HMNJUN7GCA, seg_pos={0 0}, upload=13409]: Done uploading piece. err: <nil>
Aug 9 06:20:22.980590484 (12h54m44.93968773s) [seg_pos={0 0}, upload=13409]: Segment reached optimal threshold of 14 pieces.
Aug 9 06:20:22.980854202 (12h54m44.939951454s) [noise=true , address=104.36.82.23:4466 , piece_id=Z4DVAZYH3M64ZGV5FBPZA6D7VCYPHKZG5QYKQMZW3IBIW4HYWSUA, seg_pos={0 0}, upload=13409]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkNnk9RUhKBJ3EsakqMRb3wYwrhRLhB4ZYbrdfKPDk8erRJpP): protocol: expected piece hash; context canceled; EOF
Aug 9 06:20:22.980900361 (12h54m44.939997598s) [noise=true , address=64.49.13.27:4964 , piece_id=QCOGBS7ND55UTZSYFSAPZXDS2R72HXT6KSYIXAYS7HLQWHSS6IBA, seg_pos={0 0}, upload=13409]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RcgfaeKP3XpZGuSB9GMURCCsjjc79WeZasUL2RRiQVDwxbnAk): protocol: write tcp 139.59.144.22:48142->64.49.13.27:4964: use of closed network connection; write tcp 139.59.144.22:48142->64.49.13.27:4964: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48142->64.49.13.27:4964: use of closed network connection
Aug 9 06:20:22.980927699 (12h54m44.940024945s) [noise=true , address=104.36.82.16:4301 , piece_id=52C2WRR3DPMQGM2B4EXI6YJW6FPS5SEWEIJN5LACKE3VWNDI7CKA, seg_pos={0 0}, upload=13409]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GWFshsj2bhjcCVMnFSkiFN4qftcX9bXzG8h6VkZoHxhWcGRSG): protocol: expected piece hash; context canceled; EOF
Aug 9 06:20:22.981149220 (12h54m44.94024652s) [noise=true , address=64.49.13.26:4952 , piece_id=VOUJMGH7DZ2PCNORDSCAHQCDRYCH2Y5FFBDPHB74RVP4YA4BRJWQ, seg_pos={0 0}, upload=13409]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okyMVGQotKJf1ysn8KeBxsmQJoR1amH1kLtYpgYGnADRcK5C8): protocol: write tcp 139.59.144.22:55982->64.49.13.26:4952: use of closed network connection; write tcp 139.59.144.22:55982->64.49.13.26:4952: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55982->64.49.13.26:4952: use of closed network connection
Aug 9 06:20:22.981174025 (12h54m44.940271261s) [seg_pos={0 0}, upload=13409]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 06:20:22.981273992 (12h54m44.940371294s) [upload=13409]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 06:20:22.981279938 (12h54m44.940377184s) [upload=13409]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 06:20:23.161174928 (12h54m45.12027218s) [upload=13409]: Done uploading segments...
Aug 9 06:20:23.161219313 (12h54m45.120316569s) [upload=13409]: Upload finished. err: <nil>
Duration: 1.751924334s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
1.174673933s
FAIL (2025-08-09 06:19:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 05:42:04.688066112 (12h16m26.647163361s) [upload=12736]: Starting upload Aug 9 05:42:04.688172228 (12h16m26.647269484s) [upload=12736]: Done starting upload Aug 9 05:42:04.688317761 (12h16m26.647415007s) [upload=12736]: Uploading segments... Aug 9 05:42:04.688428477 (12h16m26.647525734s) [upload=12736]: Got next segment. Inline: true Aug 9 05:42:04.688438845 (12h16m26.647536093s) [upload=12736]: Waiting for error group managing segments... Aug 9 05:42:04.688554471 (12h16m26.647651748s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 05:42:04.688562072 (12h16m26.647659324s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 05:42:04.688567027 (12h16m26.647664276s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 05:42:04.779627204 (12h16m26.738724452s) [upload=12736]: Done uploading segments... Aug 9 05:42:04.779647843 (12h16m26.738745089s) [upload=12736]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.174710096s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.540039891s
FAIL (2025-08-09 06:19:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 06:03:05.261115059 (12h37m27.220212294s) [upload=13107]: Starting upload
Aug 9 06:03:05.261167663 (12h37m27.220264912s) [upload=13107]: Done starting upload
Aug 9 06:03:05.261290923 (12h37m27.220388163s) [upload=13107]: Uploading segments...
Aug 9 06:03:05.261465352 (12h37m27.220562597s) [upload=13107]: Got next segment. Inline: false
Aug 9 06:03:05.261520083 (12h37m27.22061732s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 06:03:05.261526957 (12h37m27.220624204s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 06:03:05.474049817 (12h37m27.433147065s) [seg_pos={0 0}, upload=13107]: Begin upload segment...
Aug 9 06:03:05.474097137 (12h37m27.433194376s) [seg_pos={0 0}, upload=13107]: Done begin upload segment.
Aug 9 06:03:05.474130633 (12h37m27.433227888s) [noise=true , address=104.36.82.55:4197 , piece_id=B46OXX6IP5PACLFAE54OMGOC3UPDWUHMO4ZTJQDQ22NMLN3LFN6Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474148893 (12h37m27.433246144s) [noise=true , address=104.36.82.62:4437 , piece_id=NSCSITUE6ML2ATXZYLV6GIAXGXRZPIQDSZP3KRYKHJ344X54E2RA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474527790 (12h37m27.433625038s) [noise=true , address=64.49.13.169:4707 , piece_id=2YO7WVPQOWH6HLHDFOGCLSJOYRT63DW7ZEX5XPOKGOMKEUYMKW6Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474657378 (12h37m27.433754633s) [noise=true , address=104.36.82.6:4893 , piece_id=JELXQ4FFEQRR4R5SPGAF7OKBWTVA37ULXFI5ADYIADYZPCNMWGVA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474953893 (12h37m27.434051145s) [noise=true , address=104.36.82.46:4500 , piece_id=RXAHTRTUQWZFDKGNLGJOJBGVK7FT5USR7SKX7ZVPJTFI7FDEFXJA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475085886 (12h37m27.434183144s) [noise=true , address=104.36.82.9:4039 , piece_id=PTDIH56457CPFJPSEGKQCUZ5WBEM63DQP27NHSDXYUA2AIO3LKNA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475323835 (12h37m27.434421087s) [noise=true , address=104.36.82.35:4586 , piece_id=EST64JLLIIIH5G3MD4JZLWHRHXAASVU7BR4GENKR6EVQMBJOAXXA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475577944 (12h37m27.43467519s) [noise=true , address=104.36.82.23:4448 , piece_id=WMM6GF3OBFLVSP56AP7YGC2CRBJLFIBWMJNQOHEUF66GTJEEPGAQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475695433 (12h37m27.434792687s) [noise=true , address=104.36.82.61:4407 , piece_id=VY6PTZ347ZAC66IVSJ3RANX4XPJOVL6MAGQ6KZVOJOVAO4UTXVGA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475978281 (12h37m27.435075516s) [noise=true , address=104.36.82.18:4389 , piece_id=JQHFRESBP7J562BQOH5XN6D2OM3GB26VJMEGAEPC2O3RS5GLNQVA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476062095 (12h37m27.435159347s) [noise=true , address=104.36.82.13:4192 , piece_id=FMGSGXKWVNQ2BFOXIQUKEZEUMPCH4IPMR3VNG6LJOFX4NNY35WXQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476359155 (12h37m27.4354564s) [noise=true , address=104.36.82.47:4518 , piece_id=LVW45KREZCPW5NZ4FSZABQRHXMRARXPC2A5R5WHLIHGOJEQJTCFQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476405245 (12h37m27.43550249s) [noise=true , address=104.36.82.16:4300 , piece_id=JOZHNCK33CJ3OCPW6BNT75ZPJZDS53WZ242QVF35GBF5TSO4N45Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476764115 (12h37m27.435861372s) [noise=true , address=104.36.82.60:4347 , piece_id=7PFKFJY2URBNK6WM6T3O67IGEYE3FYEUDGQGKBF2CJD2J3CLW7HA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476781078 (12h37m27.435878359s) [noise=true , address=104.36.82.38:4705 , piece_id=YZZGKKHEYTWEZJQMHZY6HFHPCUOVFFOFXGABPORDAJAZ7I3RDTMQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477158613 (12h37m27.436255868s) [noise=true , address=104.36.82.23:4468 , piece_id=FMTWIZ4N33ALGHRYBT365QR4VVPIZKQIDDGRW3CZRFS4EUOIABYA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477538338 (12h37m27.436635592s) [noise=true , address=104.36.82.8:4984 , piece_id=JJUWTU7DPMGFURMPDZSBQ4G25CVSXT3EWJ64HMQRZSPTDKHL2F5A, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477876139 (12h37m27.436973388s) [noise=true , address=104.36.82.59:4324 , piece_id=D5F2XQGYZVH3TOTSQTZVQ24A7JUKG4INNPQNJCTH36AOXWDT2Q2A, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:06.052432268 (12h37m28.0115295s) [upload=13107]: Next returned nil segment
Aug 9 06:03:06.052468831 (12h37m28.011566078s) [upload=13107]: Waiting for error group managing segments...
Aug 9 06:03:06.205056866 (12h37m28.164154105s) [noise=true , address=104.36.82.47:4518 , piece_id=LVW45KREZCPW5NZ4FSZABQRHXMRARXPC2A5R5WHLIHGOJEQJTCFQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.205686300 (12h37m28.164783551s) [noise=true , address=104.36.82.38:4705 , piece_id=YZZGKKHEYTWEZJQMHZY6HFHPCUOVFFOFXGABPORDAJAZ7I3RDTMQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.206373347 (12h37m28.165470585s) [noise=true , address=104.36.82.9:4039 , piece_id=PTDIH56457CPFJPSEGKQCUZ5WBEM63DQP27NHSDXYUA2AIO3LKNA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.206957599 (12h37m28.166054838s) [noise=true , address=104.36.82.60:4347 , piece_id=7PFKFJY2URBNK6WM6T3O67IGEYE3FYEUDGQGKBF2CJD2J3CLW7HA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.207486289 (12h37m28.166583526s) [noise=true , address=104.36.82.62:4437 , piece_id=NSCSITUE6ML2ATXZYLV6GIAXGXRZPIQDSZP3KRYKHJ344X54E2RA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.207901411 (12h37m28.166998649s) [noise=true , address=104.36.82.46:4500 , piece_id=RXAHTRTUQWZFDKGNLGJOJBGVK7FT5USR7SKX7ZVPJTFI7FDEFXJA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.208401356 (12h37m28.167498596s) [noise=true , address=104.36.82.8:4984 , piece_id=JJUWTU7DPMGFURMPDZSBQ4G25CVSXT3EWJ64HMQRZSPTDKHL2F5A, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.209140960 (12h37m28.168238199s) [noise=true , address=104.36.82.23:4468 , piece_id=FMTWIZ4N33ALGHRYBT365QR4VVPIZKQIDDGRW3CZRFS4EUOIABYA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.210133578 (12h37m28.169230813s) [noise=true , address=104.36.82.6:4893 , piece_id=JELXQ4FFEQRR4R5SPGAF7OKBWTVA37ULXFI5ADYIADYZPCNMWGVA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.210570421 (12h37m28.169667662s) [noise=true , address=104.36.82.35:4586 , piece_id=EST64JLLIIIH5G3MD4JZLWHRHXAASVU7BR4GENKR6EVQMBJOAXXA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.215957963 (12h37m28.175055202s) [noise=true , address=104.36.82.55:4197 , piece_id=B46OXX6IP5PACLFAE54OMGOC3UPDWUHMO4ZTJQDQ22NMLN3LFN6Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.216608993 (12h37m28.175706231s) [noise=true , address=104.36.82.18:4389 , piece_id=JQHFRESBP7J562BQOH5XN6D2OM3GB26VJMEGAEPC2O3RS5GLNQVA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217305552 (12h37m28.176402788s) [noise=true , address=104.36.82.59:4324 , piece_id=D5F2XQGYZVH3TOTSQTZVQ24A7JUKG4INNPQNJCTH36AOXWDT2Q2A, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217555760 (12h37m28.176652992s) [noise=true , address=104.36.82.61:4407 , piece_id=VY6PTZ347ZAC66IVSJ3RANX4XPJOVL6MAGQ6KZVOJOVAO4UTXVGA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217588640 (12h37m28.17668588s) [seg_pos={0 0}, upload=13107]: Segment reached optimal threshold of 14 pieces.
Aug 9 06:03:06.217759585 (12h37m28.176856928s) [noise=true , address=104.36.82.13:4192 , piece_id=FMGSGXKWVNQ2BFOXIQUKEZEUMPCH4IPMR3VNG6LJOFX4NNY35WXQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218210610 (12h37m28.177307858s) [noise=true , address=104.36.82.16:4300 , piece_id=JOZHNCK33CJ3OCPW6BNT75ZPJZDS53WZ242QVF35GBF5TSO4N45Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218374951 (12h37m28.177472184s) [noise=true , address=104.36.82.23:4448 , piece_id=WMM6GF3OBFLVSP56AP7YGC2CRBJLFIBWMJNQOHEUF66GTJEEPGAQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218475124 (12h37m28.177572358s) [noise=true , address=64.49.13.169:4707 , piece_id=2YO7WVPQOWH6HLHDFOGCLSJOYRT63DW7ZEX5XPOKGOMKEUYMKW6Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection
Aug 9 06:03:06.218499775 (12h37m28.177597022s) [seg_pos={0 0}, upload=13107]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 06:03:06.218638053 (12h37m28.177735301s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 06:03:06.218773959 (12h37m28.177871209s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 06:03:06.504404653 (12h37m28.463501888s) [upload=13107]: Done uploading segments...
Aug 9 06:03:06.504425750 (12h37m28.463522985s) [upload=13107]: Upload finished. err: <nil>
Duration: 2.540095563s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.332868048s
FAIL (2025-08-09 06:18:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 06:03:05.261115059 (12h37m27.220212294s) [upload=13107]: Starting upload
Aug 9 06:03:05.261167663 (12h37m27.220264912s) [upload=13107]: Done starting upload
Aug 9 06:03:05.261290923 (12h37m27.220388163s) [upload=13107]: Uploading segments...
Aug 9 06:03:05.261465352 (12h37m27.220562597s) [upload=13107]: Got next segment. Inline: false
Aug 9 06:03:05.261520083 (12h37m27.22061732s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 06:03:05.261526957 (12h37m27.220624204s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 06:03:05.474049817 (12h37m27.433147065s) [seg_pos={0 0}, upload=13107]: Begin upload segment...
Aug 9 06:03:05.474097137 (12h37m27.433194376s) [seg_pos={0 0}, upload=13107]: Done begin upload segment.
Aug 9 06:03:05.474130633 (12h37m27.433227888s) [noise=true , address=104.36.82.55:4197 , piece_id=B46OXX6IP5PACLFAE54OMGOC3UPDWUHMO4ZTJQDQ22NMLN3LFN6Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474148893 (12h37m27.433246144s) [noise=true , address=104.36.82.62:4437 , piece_id=NSCSITUE6ML2ATXZYLV6GIAXGXRZPIQDSZP3KRYKHJ344X54E2RA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474527790 (12h37m27.433625038s) [noise=true , address=64.49.13.169:4707 , piece_id=2YO7WVPQOWH6HLHDFOGCLSJOYRT63DW7ZEX5XPOKGOMKEUYMKW6Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474657378 (12h37m27.433754633s) [noise=true , address=104.36.82.6:4893 , piece_id=JELXQ4FFEQRR4R5SPGAF7OKBWTVA37ULXFI5ADYIADYZPCNMWGVA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474953893 (12h37m27.434051145s) [noise=true , address=104.36.82.46:4500 , piece_id=RXAHTRTUQWZFDKGNLGJOJBGVK7FT5USR7SKX7ZVPJTFI7FDEFXJA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475085886 (12h37m27.434183144s) [noise=true , address=104.36.82.9:4039 , piece_id=PTDIH56457CPFJPSEGKQCUZ5WBEM63DQP27NHSDXYUA2AIO3LKNA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475323835 (12h37m27.434421087s) [noise=true , address=104.36.82.35:4586 , piece_id=EST64JLLIIIH5G3MD4JZLWHRHXAASVU7BR4GENKR6EVQMBJOAXXA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475577944 (12h37m27.43467519s) [noise=true , address=104.36.82.23:4448 , piece_id=WMM6GF3OBFLVSP56AP7YGC2CRBJLFIBWMJNQOHEUF66GTJEEPGAQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475695433 (12h37m27.434792687s) [noise=true , address=104.36.82.61:4407 , piece_id=VY6PTZ347ZAC66IVSJ3RANX4XPJOVL6MAGQ6KZVOJOVAO4UTXVGA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475978281 (12h37m27.435075516s) [noise=true , address=104.36.82.18:4389 , piece_id=JQHFRESBP7J562BQOH5XN6D2OM3GB26VJMEGAEPC2O3RS5GLNQVA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476062095 (12h37m27.435159347s) [noise=true , address=104.36.82.13:4192 , piece_id=FMGSGXKWVNQ2BFOXIQUKEZEUMPCH4IPMR3VNG6LJOFX4NNY35WXQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476359155 (12h37m27.4354564s) [noise=true , address=104.36.82.47:4518 , piece_id=LVW45KREZCPW5NZ4FSZABQRHXMRARXPC2A5R5WHLIHGOJEQJTCFQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476405245 (12h37m27.43550249s) [noise=true , address=104.36.82.16:4300 , piece_id=JOZHNCK33CJ3OCPW6BNT75ZPJZDS53WZ242QVF35GBF5TSO4N45Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476764115 (12h37m27.435861372s) [noise=true , address=104.36.82.60:4347 , piece_id=7PFKFJY2URBNK6WM6T3O67IGEYE3FYEUDGQGKBF2CJD2J3CLW7HA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476781078 (12h37m27.435878359s) [noise=true , address=104.36.82.38:4705 , piece_id=YZZGKKHEYTWEZJQMHZY6HFHPCUOVFFOFXGABPORDAJAZ7I3RDTMQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477158613 (12h37m27.436255868s) [noise=true , address=104.36.82.23:4468 , piece_id=FMTWIZ4N33ALGHRYBT365QR4VVPIZKQIDDGRW3CZRFS4EUOIABYA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477538338 (12h37m27.436635592s) [noise=true , address=104.36.82.8:4984 , piece_id=JJUWTU7DPMGFURMPDZSBQ4G25CVSXT3EWJ64HMQRZSPTDKHL2F5A, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477876139 (12h37m27.436973388s) [noise=true , address=104.36.82.59:4324 , piece_id=D5F2XQGYZVH3TOTSQTZVQ24A7JUKG4INNPQNJCTH36AOXWDT2Q2A, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:06.052432268 (12h37m28.0115295s) [upload=13107]: Next returned nil segment
Aug 9 06:03:06.052468831 (12h37m28.011566078s) [upload=13107]: Waiting for error group managing segments...
Aug 9 06:03:06.205056866 (12h37m28.164154105s) [noise=true , address=104.36.82.47:4518 , piece_id=LVW45KREZCPW5NZ4FSZABQRHXMRARXPC2A5R5WHLIHGOJEQJTCFQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.205686300 (12h37m28.164783551s) [noise=true , address=104.36.82.38:4705 , piece_id=YZZGKKHEYTWEZJQMHZY6HFHPCUOVFFOFXGABPORDAJAZ7I3RDTMQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.206373347 (12h37m28.165470585s) [noise=true , address=104.36.82.9:4039 , piece_id=PTDIH56457CPFJPSEGKQCUZ5WBEM63DQP27NHSDXYUA2AIO3LKNA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.206957599 (12h37m28.166054838s) [noise=true , address=104.36.82.60:4347 , piece_id=7PFKFJY2URBNK6WM6T3O67IGEYE3FYEUDGQGKBF2CJD2J3CLW7HA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.207486289 (12h37m28.166583526s) [noise=true , address=104.36.82.62:4437 , piece_id=NSCSITUE6ML2ATXZYLV6GIAXGXRZPIQDSZP3KRYKHJ344X54E2RA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.207901411 (12h37m28.166998649s) [noise=true , address=104.36.82.46:4500 , piece_id=RXAHTRTUQWZFDKGNLGJOJBGVK7FT5USR7SKX7ZVPJTFI7FDEFXJA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.208401356 (12h37m28.167498596s) [noise=true , address=104.36.82.8:4984 , piece_id=JJUWTU7DPMGFURMPDZSBQ4G25CVSXT3EWJ64HMQRZSPTDKHL2F5A, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.209140960 (12h37m28.168238199s) [noise=true , address=104.36.82.23:4468 , piece_id=FMTWIZ4N33ALGHRYBT365QR4VVPIZKQIDDGRW3CZRFS4EUOIABYA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.210133578 (12h37m28.169230813s) [noise=true , address=104.36.82.6:4893 , piece_id=JELXQ4FFEQRR4R5SPGAF7OKBWTVA37ULXFI5ADYIADYZPCNMWGVA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.210570421 (12h37m28.169667662s) [noise=true , address=104.36.82.35:4586 , piece_id=EST64JLLIIIH5G3MD4JZLWHRHXAASVU7BR4GENKR6EVQMBJOAXXA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.215957963 (12h37m28.175055202s) [noise=true , address=104.36.82.55:4197 , piece_id=B46OXX6IP5PACLFAE54OMGOC3UPDWUHMO4ZTJQDQ22NMLN3LFN6Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.216608993 (12h37m28.175706231s) [noise=true , address=104.36.82.18:4389 , piece_id=JQHFRESBP7J562BQOH5XN6D2OM3GB26VJMEGAEPC2O3RS5GLNQVA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217305552 (12h37m28.176402788s) [noise=true , address=104.36.82.59:4324 , piece_id=D5F2XQGYZVH3TOTSQTZVQ24A7JUKG4INNPQNJCTH36AOXWDT2Q2A, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217555760 (12h37m28.176652992s) [noise=true , address=104.36.82.61:4407 , piece_id=VY6PTZ347ZAC66IVSJ3RANX4XPJOVL6MAGQ6KZVOJOVAO4UTXVGA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217588640 (12h37m28.17668588s) [seg_pos={0 0}, upload=13107]: Segment reached optimal threshold of 14 pieces.
Aug 9 06:03:06.217759585 (12h37m28.176856928s) [noise=true , address=104.36.82.13:4192 , piece_id=FMGSGXKWVNQ2BFOXIQUKEZEUMPCH4IPMR3VNG6LJOFX4NNY35WXQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218210610 (12h37m28.177307858s) [noise=true , address=104.36.82.16:4300 , piece_id=JOZHNCK33CJ3OCPW6BNT75ZPJZDS53WZ242QVF35GBF5TSO4N45Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218374951 (12h37m28.177472184s) [noise=true , address=104.36.82.23:4448 , piece_id=WMM6GF3OBFLVSP56AP7YGC2CRBJLFIBWMJNQOHEUF66GTJEEPGAQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218475124 (12h37m28.177572358s) [noise=true , address=64.49.13.169:4707 , piece_id=2YO7WVPQOWH6HLHDFOGCLSJOYRT63DW7ZEX5XPOKGOMKEUYMKW6Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection
Aug 9 06:03:06.218499775 (12h37m28.177597022s) [seg_pos={0 0}, upload=13107]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 06:03:06.218638053 (12h37m28.177735301s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 06:03:06.218773959 (12h37m28.177871209s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 06:03:06.504404653 (12h37m28.463501888s) [upload=13107]: Done uploading segments...
Aug 9 06:03:06.504425750 (12h37m28.463522985s) [upload=13107]: Upload finished. err: <nil>
Duration: 2.332910308s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
894.495431ms
FAIL (2025-08-09 06:18:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 05:42:04.688066112 (12h16m26.647163361s) [upload=12736]: Starting upload Aug 9 05:42:04.688172228 (12h16m26.647269484s) [upload=12736]: Done starting upload Aug 9 05:42:04.688317761 (12h16m26.647415007s) [upload=12736]: Uploading segments... Aug 9 05:42:04.688428477 (12h16m26.647525734s) [upload=12736]: Got next segment. Inline: true Aug 9 05:42:04.688438845 (12h16m26.647536093s) [upload=12736]: Waiting for error group managing segments... Aug 9 05:42:04.688554471 (12h16m26.647651748s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 05:42:04.688562072 (12h16m26.647659324s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 05:42:04.688567027 (12h16m26.647664276s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 05:42:04.779627204 (12h16m26.738724452s) [upload=12736]: Done uploading segments... Aug 9 05:42:04.779647843 (12h16m26.738745089s) [upload=12736]: Upload finished. err: metaclient: Too Many Requests
Duration: 894.525346ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
852.438049ms
FAIL (2025-08-09 06:17:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 05:42:04.688066112 (12h16m26.647163361s) [upload=12736]: Starting upload Aug 9 05:42:04.688172228 (12h16m26.647269484s) [upload=12736]: Done starting upload Aug 9 05:42:04.688317761 (12h16m26.647415007s) [upload=12736]: Uploading segments... Aug 9 05:42:04.688428477 (12h16m26.647525734s) [upload=12736]: Got next segment. Inline: true Aug 9 05:42:04.688438845 (12h16m26.647536093s) [upload=12736]: Waiting for error group managing segments... Aug 9 05:42:04.688554471 (12h16m26.647651748s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 05:42:04.688562072 (12h16m26.647659324s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 05:42:04.688567027 (12h16m26.647664276s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 05:42:04.779627204 (12h16m26.738724452s) [upload=12736]: Done uploading segments... Aug 9 05:42:04.779647843 (12h16m26.738745089s) [upload=12736]: Upload finished. err: metaclient: Too Many Requests
Duration: 852.491654ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.522722974s
FAIL (2025-08-09 06:17:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 06:03:05.261115059 (12h37m27.220212294s) [upload=13107]: Starting upload
Aug 9 06:03:05.261167663 (12h37m27.220264912s) [upload=13107]: Done starting upload
Aug 9 06:03:05.261290923 (12h37m27.220388163s) [upload=13107]: Uploading segments...
Aug 9 06:03:05.261465352 (12h37m27.220562597s) [upload=13107]: Got next segment. Inline: false
Aug 9 06:03:05.261520083 (12h37m27.22061732s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 06:03:05.261526957 (12h37m27.220624204s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 06:03:05.474049817 (12h37m27.433147065s) [seg_pos={0 0}, upload=13107]: Begin upload segment...
Aug 9 06:03:05.474097137 (12h37m27.433194376s) [seg_pos={0 0}, upload=13107]: Done begin upload segment.
Aug 9 06:03:05.474130633 (12h37m27.433227888s) [noise=true , address=104.36.82.55:4197 , piece_id=B46OXX6IP5PACLFAE54OMGOC3UPDWUHMO4ZTJQDQ22NMLN3LFN6Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474148893 (12h37m27.433246144s) [noise=true , address=104.36.82.62:4437 , piece_id=NSCSITUE6ML2ATXZYLV6GIAXGXRZPIQDSZP3KRYKHJ344X54E2RA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474527790 (12h37m27.433625038s) [noise=true , address=64.49.13.169:4707 , piece_id=2YO7WVPQOWH6HLHDFOGCLSJOYRT63DW7ZEX5XPOKGOMKEUYMKW6Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474657378 (12h37m27.433754633s) [noise=true , address=104.36.82.6:4893 , piece_id=JELXQ4FFEQRR4R5SPGAF7OKBWTVA37ULXFI5ADYIADYZPCNMWGVA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474953893 (12h37m27.434051145s) [noise=true , address=104.36.82.46:4500 , piece_id=RXAHTRTUQWZFDKGNLGJOJBGVK7FT5USR7SKX7ZVPJTFI7FDEFXJA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475085886 (12h37m27.434183144s) [noise=true , address=104.36.82.9:4039 , piece_id=PTDIH56457CPFJPSEGKQCUZ5WBEM63DQP27NHSDXYUA2AIO3LKNA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475323835 (12h37m27.434421087s) [noise=true , address=104.36.82.35:4586 , piece_id=EST64JLLIIIH5G3MD4JZLWHRHXAASVU7BR4GENKR6EVQMBJOAXXA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475577944 (12h37m27.43467519s) [noise=true , address=104.36.82.23:4448 , piece_id=WMM6GF3OBFLVSP56AP7YGC2CRBJLFIBWMJNQOHEUF66GTJEEPGAQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475695433 (12h37m27.434792687s) [noise=true , address=104.36.82.61:4407 , piece_id=VY6PTZ347ZAC66IVSJ3RANX4XPJOVL6MAGQ6KZVOJOVAO4UTXVGA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475978281 (12h37m27.435075516s) [noise=true , address=104.36.82.18:4389 , piece_id=JQHFRESBP7J562BQOH5XN6D2OM3GB26VJMEGAEPC2O3RS5GLNQVA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476062095 (12h37m27.435159347s) [noise=true , address=104.36.82.13:4192 , piece_id=FMGSGXKWVNQ2BFOXIQUKEZEUMPCH4IPMR3VNG6LJOFX4NNY35WXQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476359155 (12h37m27.4354564s) [noise=true , address=104.36.82.47:4518 , piece_id=LVW45KREZCPW5NZ4FSZABQRHXMRARXPC2A5R5WHLIHGOJEQJTCFQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476405245 (12h37m27.43550249s) [noise=true , address=104.36.82.16:4300 , piece_id=JOZHNCK33CJ3OCPW6BNT75ZPJZDS53WZ242QVF35GBF5TSO4N45Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476764115 (12h37m27.435861372s) [noise=true , address=104.36.82.60:4347 , piece_id=7PFKFJY2URBNK6WM6T3O67IGEYE3FYEUDGQGKBF2CJD2J3CLW7HA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476781078 (12h37m27.435878359s) [noise=true , address=104.36.82.38:4705 , piece_id=YZZGKKHEYTWEZJQMHZY6HFHPCUOVFFOFXGABPORDAJAZ7I3RDTMQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477158613 (12h37m27.436255868s) [noise=true , address=104.36.82.23:4468 , piece_id=FMTWIZ4N33ALGHRYBT365QR4VVPIZKQIDDGRW3CZRFS4EUOIABYA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477538338 (12h37m27.436635592s) [noise=true , address=104.36.82.8:4984 , piece_id=JJUWTU7DPMGFURMPDZSBQ4G25CVSXT3EWJ64HMQRZSPTDKHL2F5A, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477876139 (12h37m27.436973388s) [noise=true , address=104.36.82.59:4324 , piece_id=D5F2XQGYZVH3TOTSQTZVQ24A7JUKG4INNPQNJCTH36AOXWDT2Q2A, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:06.052432268 (12h37m28.0115295s) [upload=13107]: Next returned nil segment
Aug 9 06:03:06.052468831 (12h37m28.011566078s) [upload=13107]: Waiting for error group managing segments...
Aug 9 06:03:06.205056866 (12h37m28.164154105s) [noise=true , address=104.36.82.47:4518 , piece_id=LVW45KREZCPW5NZ4FSZABQRHXMRARXPC2A5R5WHLIHGOJEQJTCFQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.205686300 (12h37m28.164783551s) [noise=true , address=104.36.82.38:4705 , piece_id=YZZGKKHEYTWEZJQMHZY6HFHPCUOVFFOFXGABPORDAJAZ7I3RDTMQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.206373347 (12h37m28.165470585s) [noise=true , address=104.36.82.9:4039 , piece_id=PTDIH56457CPFJPSEGKQCUZ5WBEM63DQP27NHSDXYUA2AIO3LKNA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.206957599 (12h37m28.166054838s) [noise=true , address=104.36.82.60:4347 , piece_id=7PFKFJY2URBNK6WM6T3O67IGEYE3FYEUDGQGKBF2CJD2J3CLW7HA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.207486289 (12h37m28.166583526s) [noise=true , address=104.36.82.62:4437 , piece_id=NSCSITUE6ML2ATXZYLV6GIAXGXRZPIQDSZP3KRYKHJ344X54E2RA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.207901411 (12h37m28.166998649s) [noise=true , address=104.36.82.46:4500 , piece_id=RXAHTRTUQWZFDKGNLGJOJBGVK7FT5USR7SKX7ZVPJTFI7FDEFXJA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.208401356 (12h37m28.167498596s) [noise=true , address=104.36.82.8:4984 , piece_id=JJUWTU7DPMGFURMPDZSBQ4G25CVSXT3EWJ64HMQRZSPTDKHL2F5A, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.209140960 (12h37m28.168238199s) [noise=true , address=104.36.82.23:4468 , piece_id=FMTWIZ4N33ALGHRYBT365QR4VVPIZKQIDDGRW3CZRFS4EUOIABYA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.210133578 (12h37m28.169230813s) [noise=true , address=104.36.82.6:4893 , piece_id=JELXQ4FFEQRR4R5SPGAF7OKBWTVA37ULXFI5ADYIADYZPCNMWGVA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.210570421 (12h37m28.169667662s) [noise=true , address=104.36.82.35:4586 , piece_id=EST64JLLIIIH5G3MD4JZLWHRHXAASVU7BR4GENKR6EVQMBJOAXXA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.215957963 (12h37m28.175055202s) [noise=true , address=104.36.82.55:4197 , piece_id=B46OXX6IP5PACLFAE54OMGOC3UPDWUHMO4ZTJQDQ22NMLN3LFN6Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.216608993 (12h37m28.175706231s) [noise=true , address=104.36.82.18:4389 , piece_id=JQHFRESBP7J562BQOH5XN6D2OM3GB26VJMEGAEPC2O3RS5GLNQVA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217305552 (12h37m28.176402788s) [noise=true , address=104.36.82.59:4324 , piece_id=D5F2XQGYZVH3TOTSQTZVQ24A7JUKG4INNPQNJCTH36AOXWDT2Q2A, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217555760 (12h37m28.176652992s) [noise=true , address=104.36.82.61:4407 , piece_id=VY6PTZ347ZAC66IVSJ3RANX4XPJOVL6MAGQ6KZVOJOVAO4UTXVGA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217588640 (12h37m28.17668588s) [seg_pos={0 0}, upload=13107]: Segment reached optimal threshold of 14 pieces.
Aug 9 06:03:06.217759585 (12h37m28.176856928s) [noise=true , address=104.36.82.13:4192 , piece_id=FMGSGXKWVNQ2BFOXIQUKEZEUMPCH4IPMR3VNG6LJOFX4NNY35WXQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218210610 (12h37m28.177307858s) [noise=true , address=104.36.82.16:4300 , piece_id=JOZHNCK33CJ3OCPW6BNT75ZPJZDS53WZ242QVF35GBF5TSO4N45Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218374951 (12h37m28.177472184s) [noise=true , address=104.36.82.23:4448 , piece_id=WMM6GF3OBFLVSP56AP7YGC2CRBJLFIBWMJNQOHEUF66GTJEEPGAQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218475124 (12h37m28.177572358s) [noise=true , address=64.49.13.169:4707 , piece_id=2YO7WVPQOWH6HLHDFOGCLSJOYRT63DW7ZEX5XPOKGOMKEUYMKW6Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection
Aug 9 06:03:06.218499775 (12h37m28.177597022s) [seg_pos={0 0}, upload=13107]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 06:03:06.218638053 (12h37m28.177735301s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 06:03:06.218773959 (12h37m28.177871209s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 06:03:06.504404653 (12h37m28.463501888s) [upload=13107]: Done uploading segments...
Aug 9 06:03:06.504425750 (12h37m28.463522985s) [upload=13107]: Upload finished. err: <nil>
Duration: 2.522776821s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
874.80026ms
FAIL (2025-08-09 06:16:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 05:42:04.688066112 (12h16m26.647163361s) [upload=12736]: Starting upload Aug 9 05:42:04.688172228 (12h16m26.647269484s) [upload=12736]: Done starting upload Aug 9 05:42:04.688317761 (12h16m26.647415007s) [upload=12736]: Uploading segments... Aug 9 05:42:04.688428477 (12h16m26.647525734s) [upload=12736]: Got next segment. Inline: true Aug 9 05:42:04.688438845 (12h16m26.647536093s) [upload=12736]: Waiting for error group managing segments... Aug 9 05:42:04.688554471 (12h16m26.647651748s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 05:42:04.688562072 (12h16m26.647659324s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 05:42:04.688567027 (12h16m26.647664276s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 05:42:04.779627204 (12h16m26.738724452s) [upload=12736]: Done uploading segments... Aug 9 05:42:04.779647843 (12h16m26.738745089s) [upload=12736]: Upload finished. err: metaclient: Too Many Requests
Duration: 874.846506ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.317169896s
FAIL (2025-08-09 06:16:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 06:03:05.261115059 (12h37m27.220212294s) [upload=13107]: Starting upload
Aug 9 06:03:05.261167663 (12h37m27.220264912s) [upload=13107]: Done starting upload
Aug 9 06:03:05.261290923 (12h37m27.220388163s) [upload=13107]: Uploading segments...
Aug 9 06:03:05.261465352 (12h37m27.220562597s) [upload=13107]: Got next segment. Inline: false
Aug 9 06:03:05.261520083 (12h37m27.22061732s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 06:03:05.261526957 (12h37m27.220624204s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 06:03:05.474049817 (12h37m27.433147065s) [seg_pos={0 0}, upload=13107]: Begin upload segment...
Aug 9 06:03:05.474097137 (12h37m27.433194376s) [seg_pos={0 0}, upload=13107]: Done begin upload segment.
Aug 9 06:03:05.474130633 (12h37m27.433227888s) [noise=true , address=104.36.82.55:4197 , piece_id=B46OXX6IP5PACLFAE54OMGOC3UPDWUHMO4ZTJQDQ22NMLN3LFN6Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474148893 (12h37m27.433246144s) [noise=true , address=104.36.82.62:4437 , piece_id=NSCSITUE6ML2ATXZYLV6GIAXGXRZPIQDSZP3KRYKHJ344X54E2RA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474527790 (12h37m27.433625038s) [noise=true , address=64.49.13.169:4707 , piece_id=2YO7WVPQOWH6HLHDFOGCLSJOYRT63DW7ZEX5XPOKGOMKEUYMKW6Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474657378 (12h37m27.433754633s) [noise=true , address=104.36.82.6:4893 , piece_id=JELXQ4FFEQRR4R5SPGAF7OKBWTVA37ULXFI5ADYIADYZPCNMWGVA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474953893 (12h37m27.434051145s) [noise=true , address=104.36.82.46:4500 , piece_id=RXAHTRTUQWZFDKGNLGJOJBGVK7FT5USR7SKX7ZVPJTFI7FDEFXJA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475085886 (12h37m27.434183144s) [noise=true , address=104.36.82.9:4039 , piece_id=PTDIH56457CPFJPSEGKQCUZ5WBEM63DQP27NHSDXYUA2AIO3LKNA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475323835 (12h37m27.434421087s) [noise=true , address=104.36.82.35:4586 , piece_id=EST64JLLIIIH5G3MD4JZLWHRHXAASVU7BR4GENKR6EVQMBJOAXXA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475577944 (12h37m27.43467519s) [noise=true , address=104.36.82.23:4448 , piece_id=WMM6GF3OBFLVSP56AP7YGC2CRBJLFIBWMJNQOHEUF66GTJEEPGAQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475695433 (12h37m27.434792687s) [noise=true , address=104.36.82.61:4407 , piece_id=VY6PTZ347ZAC66IVSJ3RANX4XPJOVL6MAGQ6KZVOJOVAO4UTXVGA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475978281 (12h37m27.435075516s) [noise=true , address=104.36.82.18:4389 , piece_id=JQHFRESBP7J562BQOH5XN6D2OM3GB26VJMEGAEPC2O3RS5GLNQVA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476062095 (12h37m27.435159347s) [noise=true , address=104.36.82.13:4192 , piece_id=FMGSGXKWVNQ2BFOXIQUKEZEUMPCH4IPMR3VNG6LJOFX4NNY35WXQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476359155 (12h37m27.4354564s) [noise=true , address=104.36.82.47:4518 , piece_id=LVW45KREZCPW5NZ4FSZABQRHXMRARXPC2A5R5WHLIHGOJEQJTCFQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476405245 (12h37m27.43550249s) [noise=true , address=104.36.82.16:4300 , piece_id=JOZHNCK33CJ3OCPW6BNT75ZPJZDS53WZ242QVF35GBF5TSO4N45Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476764115 (12h37m27.435861372s) [noise=true , address=104.36.82.60:4347 , piece_id=7PFKFJY2URBNK6WM6T3O67IGEYE3FYEUDGQGKBF2CJD2J3CLW7HA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476781078 (12h37m27.435878359s) [noise=true , address=104.36.82.38:4705 , piece_id=YZZGKKHEYTWEZJQMHZY6HFHPCUOVFFOFXGABPORDAJAZ7I3RDTMQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477158613 (12h37m27.436255868s) [noise=true , address=104.36.82.23:4468 , piece_id=FMTWIZ4N33ALGHRYBT365QR4VVPIZKQIDDGRW3CZRFS4EUOIABYA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477538338 (12h37m27.436635592s) [noise=true , address=104.36.82.8:4984 , piece_id=JJUWTU7DPMGFURMPDZSBQ4G25CVSXT3EWJ64HMQRZSPTDKHL2F5A, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477876139 (12h37m27.436973388s) [noise=true , address=104.36.82.59:4324 , piece_id=D5F2XQGYZVH3TOTSQTZVQ24A7JUKG4INNPQNJCTH36AOXWDT2Q2A, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:06.052432268 (12h37m28.0115295s) [upload=13107]: Next returned nil segment
Aug 9 06:03:06.052468831 (12h37m28.011566078s) [upload=13107]: Waiting for error group managing segments...
Aug 9 06:03:06.205056866 (12h37m28.164154105s) [noise=true , address=104.36.82.47:4518 , piece_id=LVW45KREZCPW5NZ4FSZABQRHXMRARXPC2A5R5WHLIHGOJEQJTCFQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.205686300 (12h37m28.164783551s) [noise=true , address=104.36.82.38:4705 , piece_id=YZZGKKHEYTWEZJQMHZY6HFHPCUOVFFOFXGABPORDAJAZ7I3RDTMQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.206373347 (12h37m28.165470585s) [noise=true , address=104.36.82.9:4039 , piece_id=PTDIH56457CPFJPSEGKQCUZ5WBEM63DQP27NHSDXYUA2AIO3LKNA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.206957599 (12h37m28.166054838s) [noise=true , address=104.36.82.60:4347 , piece_id=7PFKFJY2URBNK6WM6T3O67IGEYE3FYEUDGQGKBF2CJD2J3CLW7HA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.207486289 (12h37m28.166583526s) [noise=true , address=104.36.82.62:4437 , piece_id=NSCSITUE6ML2ATXZYLV6GIAXGXRZPIQDSZP3KRYKHJ344X54E2RA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.207901411 (12h37m28.166998649s) [noise=true , address=104.36.82.46:4500 , piece_id=RXAHTRTUQWZFDKGNLGJOJBGVK7FT5USR7SKX7ZVPJTFI7FDEFXJA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.208401356 (12h37m28.167498596s) [noise=true , address=104.36.82.8:4984 , piece_id=JJUWTU7DPMGFURMPDZSBQ4G25CVSXT3EWJ64HMQRZSPTDKHL2F5A, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.209140960 (12h37m28.168238199s) [noise=true , address=104.36.82.23:4468 , piece_id=FMTWIZ4N33ALGHRYBT365QR4VVPIZKQIDDGRW3CZRFS4EUOIABYA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.210133578 (12h37m28.169230813s) [noise=true , address=104.36.82.6:4893 , piece_id=JELXQ4FFEQRR4R5SPGAF7OKBWTVA37ULXFI5ADYIADYZPCNMWGVA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.210570421 (12h37m28.169667662s) [noise=true , address=104.36.82.35:4586 , piece_id=EST64JLLIIIH5G3MD4JZLWHRHXAASVU7BR4GENKR6EVQMBJOAXXA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.215957963 (12h37m28.175055202s) [noise=true , address=104.36.82.55:4197 , piece_id=B46OXX6IP5PACLFAE54OMGOC3UPDWUHMO4ZTJQDQ22NMLN3LFN6Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.216608993 (12h37m28.175706231s) [noise=true , address=104.36.82.18:4389 , piece_id=JQHFRESBP7J562BQOH5XN6D2OM3GB26VJMEGAEPC2O3RS5GLNQVA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217305552 (12h37m28.176402788s) [noise=true , address=104.36.82.59:4324 , piece_id=D5F2XQGYZVH3TOTSQTZVQ24A7JUKG4INNPQNJCTH36AOXWDT2Q2A, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217555760 (12h37m28.176652992s) [noise=true , address=104.36.82.61:4407 , piece_id=VY6PTZ347ZAC66IVSJ3RANX4XPJOVL6MAGQ6KZVOJOVAO4UTXVGA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217588640 (12h37m28.17668588s) [seg_pos={0 0}, upload=13107]: Segment reached optimal threshold of 14 pieces.
Aug 9 06:03:06.217759585 (12h37m28.176856928s) [noise=true , address=104.36.82.13:4192 , piece_id=FMGSGXKWVNQ2BFOXIQUKEZEUMPCH4IPMR3VNG6LJOFX4NNY35WXQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218210610 (12h37m28.177307858s) [noise=true , address=104.36.82.16:4300 , piece_id=JOZHNCK33CJ3OCPW6BNT75ZPJZDS53WZ242QVF35GBF5TSO4N45Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218374951 (12h37m28.177472184s) [noise=true , address=104.36.82.23:4448 , piece_id=WMM6GF3OBFLVSP56AP7YGC2CRBJLFIBWMJNQOHEUF66GTJEEPGAQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218475124 (12h37m28.177572358s) [noise=true , address=64.49.13.169:4707 , piece_id=2YO7WVPQOWH6HLHDFOGCLSJOYRT63DW7ZEX5XPOKGOMKEUYMKW6Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection
Aug 9 06:03:06.218499775 (12h37m28.177597022s) [seg_pos={0 0}, upload=13107]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 06:03:06.218638053 (12h37m28.177735301s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 06:03:06.218773959 (12h37m28.177871209s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 06:03:06.504404653 (12h37m28.463501888s) [upload=13107]: Done uploading segments...
Aug 9 06:03:06.504425750 (12h37m28.463522985s) [upload=13107]: Upload finished. err: <nil>
Duration: 2.317207048s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
829.125238ms
FAIL (2025-08-09 06:15:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 05:42:04.688066112 (12h16m26.647163361s) [upload=12736]: Starting upload Aug 9 05:42:04.688172228 (12h16m26.647269484s) [upload=12736]: Done starting upload Aug 9 05:42:04.688317761 (12h16m26.647415007s) [upload=12736]: Uploading segments... Aug 9 05:42:04.688428477 (12h16m26.647525734s) [upload=12736]: Got next segment. Inline: true Aug 9 05:42:04.688438845 (12h16m26.647536093s) [upload=12736]: Waiting for error group managing segments... Aug 9 05:42:04.688554471 (12h16m26.647651748s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 05:42:04.688562072 (12h16m26.647659324s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 05:42:04.688567027 (12h16m26.647664276s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 05:42:04.779627204 (12h16m26.738724452s) [upload=12736]: Done uploading segments... Aug 9 05:42:04.779647843 (12h16m26.738745089s) [upload=12736]: Upload finished. err: metaclient: Too Many Requests
Duration: 829.156302ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.332802362s
FAIL (2025-08-09 06:15:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 06:03:05.261115059 (12h37m27.220212294s) [upload=13107]: Starting upload
Aug 9 06:03:05.261167663 (12h37m27.220264912s) [upload=13107]: Done starting upload
Aug 9 06:03:05.261290923 (12h37m27.220388163s) [upload=13107]: Uploading segments...
Aug 9 06:03:05.261465352 (12h37m27.220562597s) [upload=13107]: Got next segment. Inline: false
Aug 9 06:03:05.261520083 (12h37m27.22061732s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 06:03:05.261526957 (12h37m27.220624204s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 06:03:05.474049817 (12h37m27.433147065s) [seg_pos={0 0}, upload=13107]: Begin upload segment...
Aug 9 06:03:05.474097137 (12h37m27.433194376s) [seg_pos={0 0}, upload=13107]: Done begin upload segment.
Aug 9 06:03:05.474130633 (12h37m27.433227888s) [noise=true , address=104.36.82.55:4197 , piece_id=B46OXX6IP5PACLFAE54OMGOC3UPDWUHMO4ZTJQDQ22NMLN3LFN6Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474148893 (12h37m27.433246144s) [noise=true , address=104.36.82.62:4437 , piece_id=NSCSITUE6ML2ATXZYLV6GIAXGXRZPIQDSZP3KRYKHJ344X54E2RA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474527790 (12h37m27.433625038s) [noise=true , address=64.49.13.169:4707 , piece_id=2YO7WVPQOWH6HLHDFOGCLSJOYRT63DW7ZEX5XPOKGOMKEUYMKW6Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474657378 (12h37m27.433754633s) [noise=true , address=104.36.82.6:4893 , piece_id=JELXQ4FFEQRR4R5SPGAF7OKBWTVA37ULXFI5ADYIADYZPCNMWGVA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474953893 (12h37m27.434051145s) [noise=true , address=104.36.82.46:4500 , piece_id=RXAHTRTUQWZFDKGNLGJOJBGVK7FT5USR7SKX7ZVPJTFI7FDEFXJA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475085886 (12h37m27.434183144s) [noise=true , address=104.36.82.9:4039 , piece_id=PTDIH56457CPFJPSEGKQCUZ5WBEM63DQP27NHSDXYUA2AIO3LKNA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475323835 (12h37m27.434421087s) [noise=true , address=104.36.82.35:4586 , piece_id=EST64JLLIIIH5G3MD4JZLWHRHXAASVU7BR4GENKR6EVQMBJOAXXA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475577944 (12h37m27.43467519s) [noise=true , address=104.36.82.23:4448 , piece_id=WMM6GF3OBFLVSP56AP7YGC2CRBJLFIBWMJNQOHEUF66GTJEEPGAQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475695433 (12h37m27.434792687s) [noise=true , address=104.36.82.61:4407 , piece_id=VY6PTZ347ZAC66IVSJ3RANX4XPJOVL6MAGQ6KZVOJOVAO4UTXVGA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475978281 (12h37m27.435075516s) [noise=true , address=104.36.82.18:4389 , piece_id=JQHFRESBP7J562BQOH5XN6D2OM3GB26VJMEGAEPC2O3RS5GLNQVA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476062095 (12h37m27.435159347s) [noise=true , address=104.36.82.13:4192 , piece_id=FMGSGXKWVNQ2BFOXIQUKEZEUMPCH4IPMR3VNG6LJOFX4NNY35WXQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476359155 (12h37m27.4354564s) [noise=true , address=104.36.82.47:4518 , piece_id=LVW45KREZCPW5NZ4FSZABQRHXMRARXPC2A5R5WHLIHGOJEQJTCFQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476405245 (12h37m27.43550249s) [noise=true , address=104.36.82.16:4300 , piece_id=JOZHNCK33CJ3OCPW6BNT75ZPJZDS53WZ242QVF35GBF5TSO4N45Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476764115 (12h37m27.435861372s) [noise=true , address=104.36.82.60:4347 , piece_id=7PFKFJY2URBNK6WM6T3O67IGEYE3FYEUDGQGKBF2CJD2J3CLW7HA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476781078 (12h37m27.435878359s) [noise=true , address=104.36.82.38:4705 , piece_id=YZZGKKHEYTWEZJQMHZY6HFHPCUOVFFOFXGABPORDAJAZ7I3RDTMQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477158613 (12h37m27.436255868s) [noise=true , address=104.36.82.23:4468 , piece_id=FMTWIZ4N33ALGHRYBT365QR4VVPIZKQIDDGRW3CZRFS4EUOIABYA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477538338 (12h37m27.436635592s) [noise=true , address=104.36.82.8:4984 , piece_id=JJUWTU7DPMGFURMPDZSBQ4G25CVSXT3EWJ64HMQRZSPTDKHL2F5A, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477876139 (12h37m27.436973388s) [noise=true , address=104.36.82.59:4324 , piece_id=D5F2XQGYZVH3TOTSQTZVQ24A7JUKG4INNPQNJCTH36AOXWDT2Q2A, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:06.052432268 (12h37m28.0115295s) [upload=13107]: Next returned nil segment
Aug 9 06:03:06.052468831 (12h37m28.011566078s) [upload=13107]: Waiting for error group managing segments...
Aug 9 06:03:06.205056866 (12h37m28.164154105s) [noise=true , address=104.36.82.47:4518 , piece_id=LVW45KREZCPW5NZ4FSZABQRHXMRARXPC2A5R5WHLIHGOJEQJTCFQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.205686300 (12h37m28.164783551s) [noise=true , address=104.36.82.38:4705 , piece_id=YZZGKKHEYTWEZJQMHZY6HFHPCUOVFFOFXGABPORDAJAZ7I3RDTMQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.206373347 (12h37m28.165470585s) [noise=true , address=104.36.82.9:4039 , piece_id=PTDIH56457CPFJPSEGKQCUZ5WBEM63DQP27NHSDXYUA2AIO3LKNA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.206957599 (12h37m28.166054838s) [noise=true , address=104.36.82.60:4347 , piece_id=7PFKFJY2URBNK6WM6T3O67IGEYE3FYEUDGQGKBF2CJD2J3CLW7HA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.207486289 (12h37m28.166583526s) [noise=true , address=104.36.82.62:4437 , piece_id=NSCSITUE6ML2ATXZYLV6GIAXGXRZPIQDSZP3KRYKHJ344X54E2RA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.207901411 (12h37m28.166998649s) [noise=true , address=104.36.82.46:4500 , piece_id=RXAHTRTUQWZFDKGNLGJOJBGVK7FT5USR7SKX7ZVPJTFI7FDEFXJA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.208401356 (12h37m28.167498596s) [noise=true , address=104.36.82.8:4984 , piece_id=JJUWTU7DPMGFURMPDZSBQ4G25CVSXT3EWJ64HMQRZSPTDKHL2F5A, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.209140960 (12h37m28.168238199s) [noise=true , address=104.36.82.23:4468 , piece_id=FMTWIZ4N33ALGHRYBT365QR4VVPIZKQIDDGRW3CZRFS4EUOIABYA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.210133578 (12h37m28.169230813s) [noise=true , address=104.36.82.6:4893 , piece_id=JELXQ4FFEQRR4R5SPGAF7OKBWTVA37ULXFI5ADYIADYZPCNMWGVA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.210570421 (12h37m28.169667662s) [noise=true , address=104.36.82.35:4586 , piece_id=EST64JLLIIIH5G3MD4JZLWHRHXAASVU7BR4GENKR6EVQMBJOAXXA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.215957963 (12h37m28.175055202s) [noise=true , address=104.36.82.55:4197 , piece_id=B46OXX6IP5PACLFAE54OMGOC3UPDWUHMO4ZTJQDQ22NMLN3LFN6Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.216608993 (12h37m28.175706231s) [noise=true , address=104.36.82.18:4389 , piece_id=JQHFRESBP7J562BQOH5XN6D2OM3GB26VJMEGAEPC2O3RS5GLNQVA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217305552 (12h37m28.176402788s) [noise=true , address=104.36.82.59:4324 , piece_id=D5F2XQGYZVH3TOTSQTZVQ24A7JUKG4INNPQNJCTH36AOXWDT2Q2A, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217555760 (12h37m28.176652992s) [noise=true , address=104.36.82.61:4407 , piece_id=VY6PTZ347ZAC66IVSJ3RANX4XPJOVL6MAGQ6KZVOJOVAO4UTXVGA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217588640 (12h37m28.17668588s) [seg_pos={0 0}, upload=13107]: Segment reached optimal threshold of 14 pieces.
Aug 9 06:03:06.217759585 (12h37m28.176856928s) [noise=true , address=104.36.82.13:4192 , piece_id=FMGSGXKWVNQ2BFOXIQUKEZEUMPCH4IPMR3VNG6LJOFX4NNY35WXQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218210610 (12h37m28.177307858s) [noise=true , address=104.36.82.16:4300 , piece_id=JOZHNCK33CJ3OCPW6BNT75ZPJZDS53WZ242QVF35GBF5TSO4N45Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218374951 (12h37m28.177472184s) [noise=true , address=104.36.82.23:4448 , piece_id=WMM6GF3OBFLVSP56AP7YGC2CRBJLFIBWMJNQOHEUF66GTJEEPGAQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218475124 (12h37m28.177572358s) [noise=true , address=64.49.13.169:4707 , piece_id=2YO7WVPQOWH6HLHDFOGCLSJOYRT63DW7ZEX5XPOKGOMKEUYMKW6Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection
Aug 9 06:03:06.218499775 (12h37m28.177597022s) [seg_pos={0 0}, upload=13107]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 06:03:06.218638053 (12h37m28.177735301s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 06:03:06.218773959 (12h37m28.177871209s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 06:03:06.504404653 (12h37m28.463501888s) [upload=13107]: Done uploading segments...
Aug 9 06:03:06.504425750 (12h37m28.463522985s) [upload=13107]: Upload finished. err: <nil>
Duration: 2.332881654s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
1.223761741s
FAIL (2025-08-09 06:15:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 05:42:04.688066112 (12h16m26.647163361s) [upload=12736]: Starting upload Aug 9 05:42:04.688172228 (12h16m26.647269484s) [upload=12736]: Done starting upload Aug 9 05:42:04.688317761 (12h16m26.647415007s) [upload=12736]: Uploading segments... Aug 9 05:42:04.688428477 (12h16m26.647525734s) [upload=12736]: Got next segment. Inline: true Aug 9 05:42:04.688438845 (12h16m26.647536093s) [upload=12736]: Waiting for error group managing segments... Aug 9 05:42:04.688554471 (12h16m26.647651748s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 05:42:04.688562072 (12h16m26.647659324s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 05:42:04.688567027 (12h16m26.647664276s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 05:42:04.779627204 (12h16m26.738724452s) [upload=12736]: Done uploading segments... Aug 9 05:42:04.779647843 (12h16m26.738745089s) [upload=12736]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.223799966s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.362809937s
FAIL (2025-08-09 06:14:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 06:03:05.261115059 (12h37m27.220212294s) [upload=13107]: Starting upload
Aug 9 06:03:05.261167663 (12h37m27.220264912s) [upload=13107]: Done starting upload
Aug 9 06:03:05.261290923 (12h37m27.220388163s) [upload=13107]: Uploading segments...
Aug 9 06:03:05.261465352 (12h37m27.220562597s) [upload=13107]: Got next segment. Inline: false
Aug 9 06:03:05.261520083 (12h37m27.22061732s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 06:03:05.261526957 (12h37m27.220624204s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 06:03:05.474049817 (12h37m27.433147065s) [seg_pos={0 0}, upload=13107]: Begin upload segment...
Aug 9 06:03:05.474097137 (12h37m27.433194376s) [seg_pos={0 0}, upload=13107]: Done begin upload segment.
Aug 9 06:03:05.474130633 (12h37m27.433227888s) [noise=true , address=104.36.82.55:4197 , piece_id=B46OXX6IP5PACLFAE54OMGOC3UPDWUHMO4ZTJQDQ22NMLN3LFN6Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474148893 (12h37m27.433246144s) [noise=true , address=104.36.82.62:4437 , piece_id=NSCSITUE6ML2ATXZYLV6GIAXGXRZPIQDSZP3KRYKHJ344X54E2RA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474527790 (12h37m27.433625038s) [noise=true , address=64.49.13.169:4707 , piece_id=2YO7WVPQOWH6HLHDFOGCLSJOYRT63DW7ZEX5XPOKGOMKEUYMKW6Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474657378 (12h37m27.433754633s) [noise=true , address=104.36.82.6:4893 , piece_id=JELXQ4FFEQRR4R5SPGAF7OKBWTVA37ULXFI5ADYIADYZPCNMWGVA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474953893 (12h37m27.434051145s) [noise=true , address=104.36.82.46:4500 , piece_id=RXAHTRTUQWZFDKGNLGJOJBGVK7FT5USR7SKX7ZVPJTFI7FDEFXJA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475085886 (12h37m27.434183144s) [noise=true , address=104.36.82.9:4039 , piece_id=PTDIH56457CPFJPSEGKQCUZ5WBEM63DQP27NHSDXYUA2AIO3LKNA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475323835 (12h37m27.434421087s) [noise=true , address=104.36.82.35:4586 , piece_id=EST64JLLIIIH5G3MD4JZLWHRHXAASVU7BR4GENKR6EVQMBJOAXXA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475577944 (12h37m27.43467519s) [noise=true , address=104.36.82.23:4448 , piece_id=WMM6GF3OBFLVSP56AP7YGC2CRBJLFIBWMJNQOHEUF66GTJEEPGAQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475695433 (12h37m27.434792687s) [noise=true , address=104.36.82.61:4407 , piece_id=VY6PTZ347ZAC66IVSJ3RANX4XPJOVL6MAGQ6KZVOJOVAO4UTXVGA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475978281 (12h37m27.435075516s) [noise=true , address=104.36.82.18:4389 , piece_id=JQHFRESBP7J562BQOH5XN6D2OM3GB26VJMEGAEPC2O3RS5GLNQVA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476062095 (12h37m27.435159347s) [noise=true , address=104.36.82.13:4192 , piece_id=FMGSGXKWVNQ2BFOXIQUKEZEUMPCH4IPMR3VNG6LJOFX4NNY35WXQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476359155 (12h37m27.4354564s) [noise=true , address=104.36.82.47:4518 , piece_id=LVW45KREZCPW5NZ4FSZABQRHXMRARXPC2A5R5WHLIHGOJEQJTCFQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476405245 (12h37m27.43550249s) [noise=true , address=104.36.82.16:4300 , piece_id=JOZHNCK33CJ3OCPW6BNT75ZPJZDS53WZ242QVF35GBF5TSO4N45Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476764115 (12h37m27.435861372s) [noise=true , address=104.36.82.60:4347 , piece_id=7PFKFJY2URBNK6WM6T3O67IGEYE3FYEUDGQGKBF2CJD2J3CLW7HA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476781078 (12h37m27.435878359s) [noise=true , address=104.36.82.38:4705 , piece_id=YZZGKKHEYTWEZJQMHZY6HFHPCUOVFFOFXGABPORDAJAZ7I3RDTMQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477158613 (12h37m27.436255868s) [noise=true , address=104.36.82.23:4468 , piece_id=FMTWIZ4N33ALGHRYBT365QR4VVPIZKQIDDGRW3CZRFS4EUOIABYA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477538338 (12h37m27.436635592s) [noise=true , address=104.36.82.8:4984 , piece_id=JJUWTU7DPMGFURMPDZSBQ4G25CVSXT3EWJ64HMQRZSPTDKHL2F5A, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477876139 (12h37m27.436973388s) [noise=true , address=104.36.82.59:4324 , piece_id=D5F2XQGYZVH3TOTSQTZVQ24A7JUKG4INNPQNJCTH36AOXWDT2Q2A, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:06.052432268 (12h37m28.0115295s) [upload=13107]: Next returned nil segment
Aug 9 06:03:06.052468831 (12h37m28.011566078s) [upload=13107]: Waiting for error group managing segments...
Aug 9 06:03:06.205056866 (12h37m28.164154105s) [noise=true , address=104.36.82.47:4518 , piece_id=LVW45KREZCPW5NZ4FSZABQRHXMRARXPC2A5R5WHLIHGOJEQJTCFQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.205686300 (12h37m28.164783551s) [noise=true , address=104.36.82.38:4705 , piece_id=YZZGKKHEYTWEZJQMHZY6HFHPCUOVFFOFXGABPORDAJAZ7I3RDTMQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.206373347 (12h37m28.165470585s) [noise=true , address=104.36.82.9:4039 , piece_id=PTDIH56457CPFJPSEGKQCUZ5WBEM63DQP27NHSDXYUA2AIO3LKNA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.206957599 (12h37m28.166054838s) [noise=true , address=104.36.82.60:4347 , piece_id=7PFKFJY2URBNK6WM6T3O67IGEYE3FYEUDGQGKBF2CJD2J3CLW7HA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.207486289 (12h37m28.166583526s) [noise=true , address=104.36.82.62:4437 , piece_id=NSCSITUE6ML2ATXZYLV6GIAXGXRZPIQDSZP3KRYKHJ344X54E2RA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.207901411 (12h37m28.166998649s) [noise=true , address=104.36.82.46:4500 , piece_id=RXAHTRTUQWZFDKGNLGJOJBGVK7FT5USR7SKX7ZVPJTFI7FDEFXJA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.208401356 (12h37m28.167498596s) [noise=true , address=104.36.82.8:4984 , piece_id=JJUWTU7DPMGFURMPDZSBQ4G25CVSXT3EWJ64HMQRZSPTDKHL2F5A, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.209140960 (12h37m28.168238199s) [noise=true , address=104.36.82.23:4468 , piece_id=FMTWIZ4N33ALGHRYBT365QR4VVPIZKQIDDGRW3CZRFS4EUOIABYA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.210133578 (12h37m28.169230813s) [noise=true , address=104.36.82.6:4893 , piece_id=JELXQ4FFEQRR4R5SPGAF7OKBWTVA37ULXFI5ADYIADYZPCNMWGVA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.210570421 (12h37m28.169667662s) [noise=true , address=104.36.82.35:4586 , piece_id=EST64JLLIIIH5G3MD4JZLWHRHXAASVU7BR4GENKR6EVQMBJOAXXA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.215957963 (12h37m28.175055202s) [noise=true , address=104.36.82.55:4197 , piece_id=B46OXX6IP5PACLFAE54OMGOC3UPDWUHMO4ZTJQDQ22NMLN3LFN6Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.216608993 (12h37m28.175706231s) [noise=true , address=104.36.82.18:4389 , piece_id=JQHFRESBP7J562BQOH5XN6D2OM3GB26VJMEGAEPC2O3RS5GLNQVA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217305552 (12h37m28.176402788s) [noise=true , address=104.36.82.59:4324 , piece_id=D5F2XQGYZVH3TOTSQTZVQ24A7JUKG4INNPQNJCTH36AOXWDT2Q2A, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217555760 (12h37m28.176652992s) [noise=true , address=104.36.82.61:4407 , piece_id=VY6PTZ347ZAC66IVSJ3RANX4XPJOVL6MAGQ6KZVOJOVAO4UTXVGA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217588640 (12h37m28.17668588s) [seg_pos={0 0}, upload=13107]: Segment reached optimal threshold of 14 pieces.
Aug 9 06:03:06.217759585 (12h37m28.176856928s) [noise=true , address=104.36.82.13:4192 , piece_id=FMGSGXKWVNQ2BFOXIQUKEZEUMPCH4IPMR3VNG6LJOFX4NNY35WXQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218210610 (12h37m28.177307858s) [noise=true , address=104.36.82.16:4300 , piece_id=JOZHNCK33CJ3OCPW6BNT75ZPJZDS53WZ242QVF35GBF5TSO4N45Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218374951 (12h37m28.177472184s) [noise=true , address=104.36.82.23:4448 , piece_id=WMM6GF3OBFLVSP56AP7YGC2CRBJLFIBWMJNQOHEUF66GTJEEPGAQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218475124 (12h37m28.177572358s) [noise=true , address=64.49.13.169:4707 , piece_id=2YO7WVPQOWH6HLHDFOGCLSJOYRT63DW7ZEX5XPOKGOMKEUYMKW6Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection
Aug 9 06:03:06.218499775 (12h37m28.177597022s) [seg_pos={0 0}, upload=13107]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 06:03:06.218638053 (12h37m28.177735301s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 06:03:06.218773959 (12h37m28.177871209s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 06:03:06.504404653 (12h37m28.463501888s) [upload=13107]: Done uploading segments...
Aug 9 06:03:06.504425750 (12h37m28.463522985s) [upload=13107]: Upload finished. err: <nil>
Duration: 2.362839164s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
973.818252ms
FAIL (2025-08-09 06:14:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 05:42:04.688066112 (12h16m26.647163361s) [upload=12736]: Starting upload Aug 9 05:42:04.688172228 (12h16m26.647269484s) [upload=12736]: Done starting upload Aug 9 05:42:04.688317761 (12h16m26.647415007s) [upload=12736]: Uploading segments... Aug 9 05:42:04.688428477 (12h16m26.647525734s) [upload=12736]: Got next segment. Inline: true Aug 9 05:42:04.688438845 (12h16m26.647536093s) [upload=12736]: Waiting for error group managing segments... Aug 9 05:42:04.688554471 (12h16m26.647651748s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 05:42:04.688562072 (12h16m26.647659324s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 05:42:04.688567027 (12h16m26.647664276s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 05:42:04.779627204 (12h16m26.738724452s) [upload=12736]: Done uploading segments... Aug 9 05:42:04.779647843 (12h16m26.738745089s) [upload=12736]: Upload finished. err: metaclient: Too Many Requests
Duration: 973.889669ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
857.085778ms
FAIL (2025-08-09 06:14:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 05:42:04.688066112 (12h16m26.647163361s) [upload=12736]: Starting upload Aug 9 05:42:04.688172228 (12h16m26.647269484s) [upload=12736]: Done starting upload Aug 9 05:42:04.688317761 (12h16m26.647415007s) [upload=12736]: Uploading segments... Aug 9 05:42:04.688428477 (12h16m26.647525734s) [upload=12736]: Got next segment. Inline: true Aug 9 05:42:04.688438845 (12h16m26.647536093s) [upload=12736]: Waiting for error group managing segments... Aug 9 05:42:04.688554471 (12h16m26.647651748s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 05:42:04.688562072 (12h16m26.647659324s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 05:42:04.688567027 (12h16m26.647664276s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 05:42:04.779627204 (12h16m26.738724452s) [upload=12736]: Done uploading segments... Aug 9 05:42:04.779647843 (12h16m26.738745089s) [upload=12736]: Upload finished. err: metaclient: Too Many Requests
Duration: 857.12947ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
982.389674ms
FAIL (2025-08-09 06:13:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 05:42:04.688066112 (12h16m26.647163361s) [upload=12736]: Starting upload Aug 9 05:42:04.688172228 (12h16m26.647269484s) [upload=12736]: Done starting upload Aug 9 05:42:04.688317761 (12h16m26.647415007s) [upload=12736]: Uploading segments... Aug 9 05:42:04.688428477 (12h16m26.647525734s) [upload=12736]: Got next segment. Inline: true Aug 9 05:42:04.688438845 (12h16m26.647536093s) [upload=12736]: Waiting for error group managing segments... Aug 9 05:42:04.688554471 (12h16m26.647651748s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 05:42:04.688562072 (12h16m26.647659324s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 05:42:04.688567027 (12h16m26.647664276s) [upload=12736]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 05:42:04.779627204 (12h16m26.738724452s) [upload=12736]: Done uploading segments... Aug 9 05:42:04.779647843 (12h16m26.738745089s) [upload=12736]: Upload finished. err: metaclient: Too Many Requests
Duration: 982.416776ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.339028329s
FAIL (2025-08-09 06:13:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 06:03:05.261115059 (12h37m27.220212294s) [upload=13107]: Starting upload
Aug 9 06:03:05.261167663 (12h37m27.220264912s) [upload=13107]: Done starting upload
Aug 9 06:03:05.261290923 (12h37m27.220388163s) [upload=13107]: Uploading segments...
Aug 9 06:03:05.261465352 (12h37m27.220562597s) [upload=13107]: Got next segment. Inline: false
Aug 9 06:03:05.261520083 (12h37m27.22061732s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 06:03:05.261526957 (12h37m27.220624204s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 06:03:05.474049817 (12h37m27.433147065s) [seg_pos={0 0}, upload=13107]: Begin upload segment...
Aug 9 06:03:05.474097137 (12h37m27.433194376s) [seg_pos={0 0}, upload=13107]: Done begin upload segment.
Aug 9 06:03:05.474130633 (12h37m27.433227888s) [noise=true , address=104.36.82.55:4197 , piece_id=B46OXX6IP5PACLFAE54OMGOC3UPDWUHMO4ZTJQDQ22NMLN3LFN6Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474148893 (12h37m27.433246144s) [noise=true , address=104.36.82.62:4437 , piece_id=NSCSITUE6ML2ATXZYLV6GIAXGXRZPIQDSZP3KRYKHJ344X54E2RA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474527790 (12h37m27.433625038s) [noise=true , address=64.49.13.169:4707 , piece_id=2YO7WVPQOWH6HLHDFOGCLSJOYRT63DW7ZEX5XPOKGOMKEUYMKW6Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474657378 (12h37m27.433754633s) [noise=true , address=104.36.82.6:4893 , piece_id=JELXQ4FFEQRR4R5SPGAF7OKBWTVA37ULXFI5ADYIADYZPCNMWGVA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474953893 (12h37m27.434051145s) [noise=true , address=104.36.82.46:4500 , piece_id=RXAHTRTUQWZFDKGNLGJOJBGVK7FT5USR7SKX7ZVPJTFI7FDEFXJA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475085886 (12h37m27.434183144s) [noise=true , address=104.36.82.9:4039 , piece_id=PTDIH56457CPFJPSEGKQCUZ5WBEM63DQP27NHSDXYUA2AIO3LKNA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475323835 (12h37m27.434421087s) [noise=true , address=104.36.82.35:4586 , piece_id=EST64JLLIIIH5G3MD4JZLWHRHXAASVU7BR4GENKR6EVQMBJOAXXA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475577944 (12h37m27.43467519s) [noise=true , address=104.36.82.23:4448 , piece_id=WMM6GF3OBFLVSP56AP7YGC2CRBJLFIBWMJNQOHEUF66GTJEEPGAQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475695433 (12h37m27.434792687s) [noise=true , address=104.36.82.61:4407 , piece_id=VY6PTZ347ZAC66IVSJ3RANX4XPJOVL6MAGQ6KZVOJOVAO4UTXVGA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475978281 (12h37m27.435075516s) [noise=true , address=104.36.82.18:4389 , piece_id=JQHFRESBP7J562BQOH5XN6D2OM3GB26VJMEGAEPC2O3RS5GLNQVA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476062095 (12h37m27.435159347s) [noise=true , address=104.36.82.13:4192 , piece_id=FMGSGXKWVNQ2BFOXIQUKEZEUMPCH4IPMR3VNG6LJOFX4NNY35WXQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476359155 (12h37m27.4354564s) [noise=true , address=104.36.82.47:4518 , piece_id=LVW45KREZCPW5NZ4FSZABQRHXMRARXPC2A5R5WHLIHGOJEQJTCFQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476405245 (12h37m27.43550249s) [noise=true , address=104.36.82.16:4300 , piece_id=JOZHNCK33CJ3OCPW6BNT75ZPJZDS53WZ242QVF35GBF5TSO4N45Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476764115 (12h37m27.435861372s) [noise=true , address=104.36.82.60:4347 , piece_id=7PFKFJY2URBNK6WM6T3O67IGEYE3FYEUDGQGKBF2CJD2J3CLW7HA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476781078 (12h37m27.435878359s) [noise=true , address=104.36.82.38:4705 , piece_id=YZZGKKHEYTWEZJQMHZY6HFHPCUOVFFOFXGABPORDAJAZ7I3RDTMQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477158613 (12h37m27.436255868s) [noise=true , address=104.36.82.23:4468 , piece_id=FMTWIZ4N33ALGHRYBT365QR4VVPIZKQIDDGRW3CZRFS4EUOIABYA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477538338 (12h37m27.436635592s) [noise=true , address=104.36.82.8:4984 , piece_id=JJUWTU7DPMGFURMPDZSBQ4G25CVSXT3EWJ64HMQRZSPTDKHL2F5A, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477876139 (12h37m27.436973388s) [noise=true , address=104.36.82.59:4324 , piece_id=D5F2XQGYZVH3TOTSQTZVQ24A7JUKG4INNPQNJCTH36AOXWDT2Q2A, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:06.052432268 (12h37m28.0115295s) [upload=13107]: Next returned nil segment
Aug 9 06:03:06.052468831 (12h37m28.011566078s) [upload=13107]: Waiting for error group managing segments...
Aug 9 06:03:06.205056866 (12h37m28.164154105s) [noise=true , address=104.36.82.47:4518 , piece_id=LVW45KREZCPW5NZ4FSZABQRHXMRARXPC2A5R5WHLIHGOJEQJTCFQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.205686300 (12h37m28.164783551s) [noise=true , address=104.36.82.38:4705 , piece_id=YZZGKKHEYTWEZJQMHZY6HFHPCUOVFFOFXGABPORDAJAZ7I3RDTMQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.206373347 (12h37m28.165470585s) [noise=true , address=104.36.82.9:4039 , piece_id=PTDIH56457CPFJPSEGKQCUZ5WBEM63DQP27NHSDXYUA2AIO3LKNA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.206957599 (12h37m28.166054838s) [noise=true , address=104.36.82.60:4347 , piece_id=7PFKFJY2URBNK6WM6T3O67IGEYE3FYEUDGQGKBF2CJD2J3CLW7HA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.207486289 (12h37m28.166583526s) [noise=true , address=104.36.82.62:4437 , piece_id=NSCSITUE6ML2ATXZYLV6GIAXGXRZPIQDSZP3KRYKHJ344X54E2RA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.207901411 (12h37m28.166998649s) [noise=true , address=104.36.82.46:4500 , piece_id=RXAHTRTUQWZFDKGNLGJOJBGVK7FT5USR7SKX7ZVPJTFI7FDEFXJA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.208401356 (12h37m28.167498596s) [noise=true , address=104.36.82.8:4984 , piece_id=JJUWTU7DPMGFURMPDZSBQ4G25CVSXT3EWJ64HMQRZSPTDKHL2F5A, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.209140960 (12h37m28.168238199s) [noise=true , address=104.36.82.23:4468 , piece_id=FMTWIZ4N33ALGHRYBT365QR4VVPIZKQIDDGRW3CZRFS4EUOIABYA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.210133578 (12h37m28.169230813s) [noise=true , address=104.36.82.6:4893 , piece_id=JELXQ4FFEQRR4R5SPGAF7OKBWTVA37ULXFI5ADYIADYZPCNMWGVA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.210570421 (12h37m28.169667662s) [noise=true , address=104.36.82.35:4586 , piece_id=EST64JLLIIIH5G3MD4JZLWHRHXAASVU7BR4GENKR6EVQMBJOAXXA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.215957963 (12h37m28.175055202s) [noise=true , address=104.36.82.55:4197 , piece_id=B46OXX6IP5PACLFAE54OMGOC3UPDWUHMO4ZTJQDQ22NMLN3LFN6Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.216608993 (12h37m28.175706231s) [noise=true , address=104.36.82.18:4389 , piece_id=JQHFRESBP7J562BQOH5XN6D2OM3GB26VJMEGAEPC2O3RS5GLNQVA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217305552 (12h37m28.176402788s) [noise=true , address=104.36.82.59:4324 , piece_id=D5F2XQGYZVH3TOTSQTZVQ24A7JUKG4INNPQNJCTH36AOXWDT2Q2A, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217555760 (12h37m28.176652992s) [noise=true , address=104.36.82.61:4407 , piece_id=VY6PTZ347ZAC66IVSJ3RANX4XPJOVL6MAGQ6KZVOJOVAO4UTXVGA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217588640 (12h37m28.17668588s) [seg_pos={0 0}, upload=13107]: Segment reached optimal threshold of 14 pieces.
Aug 9 06:03:06.217759585 (12h37m28.176856928s) [noise=true , address=104.36.82.13:4192 , piece_id=FMGSGXKWVNQ2BFOXIQUKEZEUMPCH4IPMR3VNG6LJOFX4NNY35WXQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218210610 (12h37m28.177307858s) [noise=true , address=104.36.82.16:4300 , piece_id=JOZHNCK33CJ3OCPW6BNT75ZPJZDS53WZ242QVF35GBF5TSO4N45Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218374951 (12h37m28.177472184s) [noise=true , address=104.36.82.23:4448 , piece_id=WMM6GF3OBFLVSP56AP7YGC2CRBJLFIBWMJNQOHEUF66GTJEEPGAQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218475124 (12h37m28.177572358s) [noise=true , address=64.49.13.169:4707 , piece_id=2YO7WVPQOWH6HLHDFOGCLSJOYRT63DW7ZEX5XPOKGOMKEUYMKW6Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection
Aug 9 06:03:06.218499775 (12h37m28.177597022s) [seg_pos={0 0}, upload=13107]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 06:03:06.218638053 (12h37m28.177735301s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 06:03:06.218773959 (12h37m28.177871209s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 06:03:06.504404653 (12h37m28.463501888s) [upload=13107]: Done uploading segments...
Aug 9 06:03:06.504425750 (12h37m28.463522985s) [upload=13107]: Upload finished. err: <nil>
Duration: 2.33907396s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.347288554s
FAIL (2025-08-09 06:13:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 06:03:05.261115059 (12h37m27.220212294s) [upload=13107]: Starting upload
Aug 9 06:03:05.261167663 (12h37m27.220264912s) [upload=13107]: Done starting upload
Aug 9 06:03:05.261290923 (12h37m27.220388163s) [upload=13107]: Uploading segments...
Aug 9 06:03:05.261465352 (12h37m27.220562597s) [upload=13107]: Got next segment. Inline: false
Aug 9 06:03:05.261520083 (12h37m27.22061732s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 06:03:05.261526957 (12h37m27.220624204s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 06:03:05.474049817 (12h37m27.433147065s) [seg_pos={0 0}, upload=13107]: Begin upload segment...
Aug 9 06:03:05.474097137 (12h37m27.433194376s) [seg_pos={0 0}, upload=13107]: Done begin upload segment.
Aug 9 06:03:05.474130633 (12h37m27.433227888s) [noise=true , address=104.36.82.55:4197 , piece_id=B46OXX6IP5PACLFAE54OMGOC3UPDWUHMO4ZTJQDQ22NMLN3LFN6Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474148893 (12h37m27.433246144s) [noise=true , address=104.36.82.62:4437 , piece_id=NSCSITUE6ML2ATXZYLV6GIAXGXRZPIQDSZP3KRYKHJ344X54E2RA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474527790 (12h37m27.433625038s) [noise=true , address=64.49.13.169:4707 , piece_id=2YO7WVPQOWH6HLHDFOGCLSJOYRT63DW7ZEX5XPOKGOMKEUYMKW6Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474657378 (12h37m27.433754633s) [noise=true , address=104.36.82.6:4893 , piece_id=JELXQ4FFEQRR4R5SPGAF7OKBWTVA37ULXFI5ADYIADYZPCNMWGVA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.474953893 (12h37m27.434051145s) [noise=true , address=104.36.82.46:4500 , piece_id=RXAHTRTUQWZFDKGNLGJOJBGVK7FT5USR7SKX7ZVPJTFI7FDEFXJA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475085886 (12h37m27.434183144s) [noise=true , address=104.36.82.9:4039 , piece_id=PTDIH56457CPFJPSEGKQCUZ5WBEM63DQP27NHSDXYUA2AIO3LKNA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475323835 (12h37m27.434421087s) [noise=true , address=104.36.82.35:4586 , piece_id=EST64JLLIIIH5G3MD4JZLWHRHXAASVU7BR4GENKR6EVQMBJOAXXA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475577944 (12h37m27.43467519s) [noise=true , address=104.36.82.23:4448 , piece_id=WMM6GF3OBFLVSP56AP7YGC2CRBJLFIBWMJNQOHEUF66GTJEEPGAQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475695433 (12h37m27.434792687s) [noise=true , address=104.36.82.61:4407 , piece_id=VY6PTZ347ZAC66IVSJ3RANX4XPJOVL6MAGQ6KZVOJOVAO4UTXVGA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.475978281 (12h37m27.435075516s) [noise=true , address=104.36.82.18:4389 , piece_id=JQHFRESBP7J562BQOH5XN6D2OM3GB26VJMEGAEPC2O3RS5GLNQVA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476062095 (12h37m27.435159347s) [noise=true , address=104.36.82.13:4192 , piece_id=FMGSGXKWVNQ2BFOXIQUKEZEUMPCH4IPMR3VNG6LJOFX4NNY35WXQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476359155 (12h37m27.4354564s) [noise=true , address=104.36.82.47:4518 , piece_id=LVW45KREZCPW5NZ4FSZABQRHXMRARXPC2A5R5WHLIHGOJEQJTCFQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476405245 (12h37m27.43550249s) [noise=true , address=104.36.82.16:4300 , piece_id=JOZHNCK33CJ3OCPW6BNT75ZPJZDS53WZ242QVF35GBF5TSO4N45Q, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476764115 (12h37m27.435861372s) [noise=true , address=104.36.82.60:4347 , piece_id=7PFKFJY2URBNK6WM6T3O67IGEYE3FYEUDGQGKBF2CJD2J3CLW7HA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.476781078 (12h37m27.435878359s) [noise=true , address=104.36.82.38:4705 , piece_id=YZZGKKHEYTWEZJQMHZY6HFHPCUOVFFOFXGABPORDAJAZ7I3RDTMQ, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477158613 (12h37m27.436255868s) [noise=true , address=104.36.82.23:4468 , piece_id=FMTWIZ4N33ALGHRYBT365QR4VVPIZKQIDDGRW3CZRFS4EUOIABYA, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477538338 (12h37m27.436635592s) [noise=true , address=104.36.82.8:4984 , piece_id=JJUWTU7DPMGFURMPDZSBQ4G25CVSXT3EWJ64HMQRZSPTDKHL2F5A, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:05.477876139 (12h37m27.436973388s) [noise=true , address=104.36.82.59:4324 , piece_id=D5F2XQGYZVH3TOTSQTZVQ24A7JUKG4INNPQNJCTH36AOXWDT2Q2A, seg_pos={0 0}, upload=13107]: Uploading piece...
Aug 9 06:03:06.052432268 (12h37m28.0115295s) [upload=13107]: Next returned nil segment
Aug 9 06:03:06.052468831 (12h37m28.011566078s) [upload=13107]: Waiting for error group managing segments...
Aug 9 06:03:06.205056866 (12h37m28.164154105s) [noise=true , address=104.36.82.47:4518 , piece_id=LVW45KREZCPW5NZ4FSZABQRHXMRARXPC2A5R5WHLIHGOJEQJTCFQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.205686300 (12h37m28.164783551s) [noise=true , address=104.36.82.38:4705 , piece_id=YZZGKKHEYTWEZJQMHZY6HFHPCUOVFFOFXGABPORDAJAZ7I3RDTMQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.206373347 (12h37m28.165470585s) [noise=true , address=104.36.82.9:4039 , piece_id=PTDIH56457CPFJPSEGKQCUZ5WBEM63DQP27NHSDXYUA2AIO3LKNA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.206957599 (12h37m28.166054838s) [noise=true , address=104.36.82.60:4347 , piece_id=7PFKFJY2URBNK6WM6T3O67IGEYE3FYEUDGQGKBF2CJD2J3CLW7HA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.207486289 (12h37m28.166583526s) [noise=true , address=104.36.82.62:4437 , piece_id=NSCSITUE6ML2ATXZYLV6GIAXGXRZPIQDSZP3KRYKHJ344X54E2RA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.207901411 (12h37m28.166998649s) [noise=true , address=104.36.82.46:4500 , piece_id=RXAHTRTUQWZFDKGNLGJOJBGVK7FT5USR7SKX7ZVPJTFI7FDEFXJA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.208401356 (12h37m28.167498596s) [noise=true , address=104.36.82.8:4984 , piece_id=JJUWTU7DPMGFURMPDZSBQ4G25CVSXT3EWJ64HMQRZSPTDKHL2F5A, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.209140960 (12h37m28.168238199s) [noise=true , address=104.36.82.23:4468 , piece_id=FMTWIZ4N33ALGHRYBT365QR4VVPIZKQIDDGRW3CZRFS4EUOIABYA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.210133578 (12h37m28.169230813s) [noise=true , address=104.36.82.6:4893 , piece_id=JELXQ4FFEQRR4R5SPGAF7OKBWTVA37ULXFI5ADYIADYZPCNMWGVA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.210570421 (12h37m28.169667662s) [noise=true , address=104.36.82.35:4586 , piece_id=EST64JLLIIIH5G3MD4JZLWHRHXAASVU7BR4GENKR6EVQMBJOAXXA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.215957963 (12h37m28.175055202s) [noise=true , address=104.36.82.55:4197 , piece_id=B46OXX6IP5PACLFAE54OMGOC3UPDWUHMO4ZTJQDQ22NMLN3LFN6Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.216608993 (12h37m28.175706231s) [noise=true , address=104.36.82.18:4389 , piece_id=JQHFRESBP7J562BQOH5XN6D2OM3GB26VJMEGAEPC2O3RS5GLNQVA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217305552 (12h37m28.176402788s) [noise=true , address=104.36.82.59:4324 , piece_id=D5F2XQGYZVH3TOTSQTZVQ24A7JUKG4INNPQNJCTH36AOXWDT2Q2A, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217555760 (12h37m28.176652992s) [noise=true , address=104.36.82.61:4407 , piece_id=VY6PTZ347ZAC66IVSJ3RANX4XPJOVL6MAGQ6KZVOJOVAO4UTXVGA, seg_pos={0 0}, upload=13107]: Done uploading piece. err: <nil>
Aug 9 06:03:06.217588640 (12h37m28.17668588s) [seg_pos={0 0}, upload=13107]: Segment reached optimal threshold of 14 pieces.
Aug 9 06:03:06.217759585 (12h37m28.176856928s) [noise=true , address=104.36.82.13:4192 , piece_id=FMGSGXKWVNQ2BFOXIQUKEZEUMPCH4IPMR3VNG6LJOFX4NNY35WXQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218210610 (12h37m28.177307858s) [noise=true , address=104.36.82.16:4300 , piece_id=JOZHNCK33CJ3OCPW6BNT75ZPJZDS53WZ242QVF35GBF5TSO4N45Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218374951 (12h37m28.177472184s) [noise=true , address=104.36.82.23:4448 , piece_id=WMM6GF3OBFLVSP56AP7YGC2CRBJLFIBWMJNQOHEUF66GTJEEPGAQ, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF
Aug 9 06:03:06.218475124 (12h37m28.177572358s) [noise=true , address=64.49.13.169:4707 , piece_id=2YO7WVPQOWH6HLHDFOGCLSJOYRT63DW7ZEX5XPOKGOMKEUYMKW6Q, seg_pos={0 0}, upload=13107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection; write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55716->64.49.13.169:4707: use of closed network connection
Aug 9 06:03:06.218499775 (12h37m28.177597022s) [seg_pos={0 0}, upload=13107]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 06:03:06.218638053 (12h37m28.177735301s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 06:03:06.218773959 (12h37m28.177871209s) [upload=13107]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 06:03:06.504404653 (12h37m28.463501888s) [upload=13107]: Done uploading segments...
Aug 9 06:03:06.504425750 (12h37m28.463522985s) [upload=13107]: Upload finished. err: <nil>
Duration: 2.347316167s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|