Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................X.............X.......X................X..] duration:
937.047826ms
FAIL (2025-08-16 08:53:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a0e604b96724399cf805a69e282d1443c5a8994b90a802ebf4cbfe3906db35b6 != before c1fc4ad8dde774281c1227dd1f7db9af8003285856c7eb44bdb9b4252781d92b ======LOGS====== Aug 16 08:51:59.089313971 (183h26m21.048411207s) [upload=190969]: Starting upload Aug 16 08:51:59.089372525 (183h26m21.048469779s) [upload=190969]: Done starting upload Aug 16 08:51:59.089455408 (183h26m21.048552644s) [upload=190969]: Uploading segments... Aug 16 08:51:59.089521410 (183h26m21.048618664s) [upload=190969]: Got next segment. Inline: true Aug 16 08:51:59.089527504 (183h26m21.048624749s) [upload=190969]: Waiting for error group managing segments... Aug 16 08:51:59.089583304 (183h26m21.048680549s) [upload=190969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:51:59.089588199 (183h26m21.048685445s) [upload=190969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:51:59.089591884 (183h26m21.048689122s) [upload=190969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:51:59.231431130 (183h26m21.190528367s) [upload=190969]: Done uploading segments... Aug 16 08:51:59.231452910 (183h26m21.190550149s) [upload=190969]: Upload finished. err: <nil>
Duration: 937.077661ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X..................X............................X...X.] duration:
2.648522391s
FAIL (2025-08-16 08:53:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:52:33.089439316 (183h26m55.048536569s) [upload=190977]: Starting upload Aug 16 08:52:33.089518693 (183h26m55.048615941s) [upload=190977]: Done starting upload Aug 16 08:52:33.089617470 (183h26m55.04871472s) [upload=190977]: Uploading segments... Aug 16 08:52:33.089777297 (183h26m55.048874541s) [upload=190977]: Got next segment. Inline: false Aug 16 08:52:33.089819538 (183h26m55.048916785s) [upload=190977]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:52:33.089827009 (183h26m55.048924254s) [upload=190977]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 08:52:33.178372132 (183h26m55.137469384s) [upload=190977]: Next segment err: metaclient: Too Many Requests Aug 16 08:52:33.178428627 (183h26m55.137525873s) [upload=190977]: Done uploading segments... Aug 16 08:52:33.178448860 (183h26m55.137546101s)
Duration: 2.648597541s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...................X.............X.......X................X.] duration:
861.911733ms
FAIL (2025-08-16 08:52:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a0e604b96724399cf805a69e282d1443c5a8994b90a802ebf4cbfe3906db35b6 != before c1fc4ad8dde774281c1227dd1f7db9af8003285856c7eb44bdb9b4252781d92b ======LOGS====== Aug 16 08:51:59.089313971 (183h26m21.048411207s) [upload=190969]: Starting upload Aug 16 08:51:59.089372525 (183h26m21.048469779s) [upload=190969]: Done starting upload Aug 16 08:51:59.089455408 (183h26m21.048552644s) [upload=190969]: Uploading segments... Aug 16 08:51:59.089521410 (183h26m21.048618664s) [upload=190969]: Got next segment. Inline: true Aug 16 08:51:59.089527504 (183h26m21.048624749s) [upload=190969]: Waiting for error group managing segments... Aug 16 08:51:59.089583304 (183h26m21.048680549s) [upload=190969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:51:59.089588199 (183h26m21.048685445s) [upload=190969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:51:59.089591884 (183h26m21.048689122s) [upload=190969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:51:59.231431130 (183h26m21.190528367s) [upload=190969]: Done uploading segments... Aug 16 08:51:59.231452910 (183h26m21.190550149s) [upload=190969]: Upload finished. err: <nil>
Duration: 862.013035ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X..................X............................X...X] duration:
361.764303ms
FAIL (2025-08-16 08:52:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:52:33.089439316 (183h26m55.048536569s) [upload=190977]: Starting upload Aug 16 08:52:33.089518693 (183h26m55.048615941s) [upload=190977]: Done starting upload Aug 16 08:52:33.089617470 (183h26m55.04871472s) [upload=190977]: Uploading segments... Aug 16 08:52:33.089777297 (183h26m55.048874541s) [upload=190977]: Got next segment. Inline: false Aug 16 08:52:33.089819538 (183h26m55.048916785s) [upload=190977]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:52:33.089827009 (183h26m55.048924254s) [upload=190977]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 08:52:33.178372132 (183h26m55.137469384s) [upload=190977]: Next segment err: metaclient: Too Many Requests Aug 16 08:52:33.178428627 (183h26m55.137525873s) [upload=190977]: Done uploading segments... Aug 16 08:52:33.178448860 (183h26m55.137546101s)
Duration: 361.790547ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....................X.............X.......X................X] duration:
715.031788ms
FAIL (2025-08-16 08:51:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after a0e604b96724399cf805a69e282d1443c5a8994b90a802ebf4cbfe3906db35b6 != before c1fc4ad8dde774281c1227dd1f7db9af8003285856c7eb44bdb9b4252781d92b ======LOGS====== Aug 16 08:51:59.089313971 (183h26m21.048411207s) [upload=190969]: Starting upload Aug 16 08:51:59.089372525 (183h26m21.048469779s) [upload=190969]: Done starting upload Aug 16 08:51:59.089455408 (183h26m21.048552644s) [upload=190969]: Uploading segments... Aug 16 08:51:59.089521410 (183h26m21.048618664s) [upload=190969]: Got next segment. Inline: true Aug 16 08:51:59.089527504 (183h26m21.048624749s) [upload=190969]: Waiting for error group managing segments... Aug 16 08:51:59.089583304 (183h26m21.048680549s) [upload=190969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:51:59.089588199 (183h26m21.048685445s) [upload=190969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:51:59.089591884 (183h26m21.048689122s) [upload=190969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:51:59.231431130 (183h26m21.190528367s) [upload=190969]: Done uploading segments... Aug 16 08:51:59.231452910 (183h26m21.190550149s) [upload=190969]: Upload finished. err: <nil>
Duration: 715.062202ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.............X.......X................] duration:
834.047461ms
FAIL (2025-08-16 08:51:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:39:48.987058790 (183h14m10.946156022s) [upload=190753]: Starting upload Aug 16 08:39:48.987125829 (183h14m10.946223078s) [upload=190753]: Done starting upload Aug 16 08:39:48.987183429 (183h14m10.946280661s) [upload=190753]: Uploading segments... Aug 16 08:39:48.987259075 (183h14m10.94635632s) [upload=190753]: Got next segment. Inline: true Aug 16 08:39:48.987275918 (183h14m10.946373166s) [upload=190753]: Waiting for error group managing segments... Aug 16 08:39:48.987315024 (183h14m10.946412269s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:39:48.987318995 (183h14m10.946416241s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:39:48.987321784 (183h14m10.946419028s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:39:49.075021115 (183h14m11.034118361s) [upload=190753]: Done uploading segments... Aug 16 08:39:49.075039913 (183h14m11.034137148s) [upload=190753]: Upload finished. err: metaclient: Too Many Requests
Duration: 834.078477ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X..................X............................X...] duration:
2.417130607s
FAIL (2025-08-16 08:51:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:48:19.866206393 (183h22m41.825303646s) [upload=190907]: Starting upload Aug 16 08:48:19.866309998 (183h22m41.825407253s) [upload=190907]: Done starting upload Aug 16 08:48:19.866445050 (183h22m41.8255423s) [upload=190907]: Uploading segments... Aug 16 08:48:19.866885287 (183h22m41.825982525s) [upload=190907]: Got next segment. Inline: false Aug 16 08:48:19.866963094 (183h22m41.826060347s) [upload=190907]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:48:19.866969544 (183h22m41.826066794s) [upload=190907]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 08:48:19.961328902 (183h22m41.920426171s) [upload=190907]: Next segment err: metaclient: Too Many Requests Aug 16 08:48:19.961350154 (183h22m41.920447406s) [upload=190907]: Done uploading segments... Aug 16 08:48:19.961378612 (183h22m41.920475857s) [upload=190907]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.417169852s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X.............X.......X...............] duration:
816.738075ms
FAIL (2025-08-16 08:51:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:39:48.987058790 (183h14m10.946156022s) [upload=190753]: Starting upload Aug 16 08:39:48.987125829 (183h14m10.946223078s) [upload=190753]: Done starting upload Aug 16 08:39:48.987183429 (183h14m10.946280661s) [upload=190753]: Uploading segments... Aug 16 08:39:48.987259075 (183h14m10.94635632s) [upload=190753]: Got next segment. Inline: true Aug 16 08:39:48.987275918 (183h14m10.946373166s) [upload=190753]: Waiting for error group managing segments... Aug 16 08:39:48.987315024 (183h14m10.946412269s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:39:48.987318995 (183h14m10.946416241s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:39:48.987321784 (183h14m10.946419028s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:39:49.075021115 (183h14m11.034118361s) [upload=190753]: Done uploading segments... Aug 16 08:39:49.075039913 (183h14m11.034137148s) [upload=190753]: Upload finished. err: metaclient: Too Many Requests
Duration: 816.771203ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................X.............X.......X..............] duration:
2.33788281s
FAIL (2025-08-16 08:50:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:39:48.987058790 (183h14m10.946156022s) [upload=190753]: Starting upload Aug 16 08:39:48.987125829 (183h14m10.946223078s) [upload=190753]: Done starting upload Aug 16 08:39:48.987183429 (183h14m10.946280661s) [upload=190753]: Uploading segments... Aug 16 08:39:48.987259075 (183h14m10.94635632s) [upload=190753]: Got next segment. Inline: true Aug 16 08:39:48.987275918 (183h14m10.946373166s) [upload=190753]: Waiting for error group managing segments... Aug 16 08:39:48.987315024 (183h14m10.946412269s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:39:48.987318995 (183h14m10.946416241s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:39:48.987321784 (183h14m10.946419028s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:39:49.075021115 (183h14m11.034118361s) [upload=190753]: Done uploading segments... Aug 16 08:39:49.075039913 (183h14m11.034137148s) [upload=190753]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.337915585s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X..................X............................X..] duration:
2.563646663s
FAIL (2025-08-16 08:50:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:48:19.866206393 (183h22m41.825303646s) [upload=190907]: Starting upload Aug 16 08:48:19.866309998 (183h22m41.825407253s) [upload=190907]: Done starting upload Aug 16 08:48:19.866445050 (183h22m41.8255423s) [upload=190907]: Uploading segments... Aug 16 08:48:19.866885287 (183h22m41.825982525s) [upload=190907]: Got next segment. Inline: false Aug 16 08:48:19.866963094 (183h22m41.826060347s) [upload=190907]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:48:19.866969544 (183h22m41.826066794s) [upload=190907]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 08:48:19.961328902 (183h22m41.920426171s) [upload=190907]: Next segment err: metaclient: Too Many Requests Aug 16 08:48:19.961350154 (183h22m41.920447406s) [upload=190907]: Done uploading segments... Aug 16 08:48:19.961378612 (183h22m41.920475857s) [upload=190907]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.563681769s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................X.............X.......X.............] duration:
1.103551636s
FAIL (2025-08-16 08:49:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:39:48.987058790 (183h14m10.946156022s) [upload=190753]: Starting upload Aug 16 08:39:48.987125829 (183h14m10.946223078s) [upload=190753]: Done starting upload Aug 16 08:39:48.987183429 (183h14m10.946280661s) [upload=190753]: Uploading segments... Aug 16 08:39:48.987259075 (183h14m10.94635632s) [upload=190753]: Got next segment. Inline: true Aug 16 08:39:48.987275918 (183h14m10.946373166s) [upload=190753]: Waiting for error group managing segments... Aug 16 08:39:48.987315024 (183h14m10.946412269s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:39:48.987318995 (183h14m10.946416241s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:39:48.987321784 (183h14m10.946419028s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:39:49.075021115 (183h14m11.034118361s) [upload=190753]: Done uploading segments... Aug 16 08:39:49.075039913 (183h14m11.034137148s) [upload=190753]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.103598625s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X..................X............................X.] duration:
2.500596329s
FAIL (2025-08-16 08:49:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:48:19.866206393 (183h22m41.825303646s) [upload=190907]: Starting upload Aug 16 08:48:19.866309998 (183h22m41.825407253s) [upload=190907]: Done starting upload Aug 16 08:48:19.866445050 (183h22m41.8255423s) [upload=190907]: Uploading segments... Aug 16 08:48:19.866885287 (183h22m41.825982525s) [upload=190907]: Got next segment. Inline: false Aug 16 08:48:19.866963094 (183h22m41.826060347s) [upload=190907]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:48:19.866969544 (183h22m41.826066794s) [upload=190907]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 08:48:19.961328902 (183h22m41.920426171s) [upload=190907]: Next segment err: metaclient: Too Many Requests Aug 16 08:48:19.961350154 (183h22m41.920447406s) [upload=190907]: Done uploading segments... Aug 16 08:48:19.961378612 (183h22m41.920475857s) [upload=190907]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.50063201s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........................X.............X.......X............] duration:
1.050187481s
FAIL (2025-08-16 08:49:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:39:48.987058790 (183h14m10.946156022s) [upload=190753]: Starting upload Aug 16 08:39:48.987125829 (183h14m10.946223078s) [upload=190753]: Done starting upload Aug 16 08:39:48.987183429 (183h14m10.946280661s) [upload=190753]: Uploading segments... Aug 16 08:39:48.987259075 (183h14m10.94635632s) [upload=190753]: Got next segment. Inline: true Aug 16 08:39:48.987275918 (183h14m10.946373166s) [upload=190753]: Waiting for error group managing segments... Aug 16 08:39:48.987315024 (183h14m10.946412269s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:39:48.987318995 (183h14m10.946416241s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:39:48.987321784 (183h14m10.946419028s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:39:49.075021115 (183h14m11.034118361s) [upload=190753]: Done uploading segments... Aug 16 08:39:49.075039913 (183h14m11.034137148s) [upload=190753]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.050221716s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X..................X............................X] duration:
375.031362ms
FAIL (2025-08-16 08:48:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:48:19.866206393 (183h22m41.825303646s) [upload=190907]: Starting upload Aug 16 08:48:19.866309998 (183h22m41.825407253s) [upload=190907]: Done starting upload Aug 16 08:48:19.866445050 (183h22m41.8255423s) [upload=190907]: Uploading segments... Aug 16 08:48:19.866885287 (183h22m41.825982525s) [upload=190907]: Got next segment. Inline: false Aug 16 08:48:19.866963094 (183h22m41.826060347s) [upload=190907]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:48:19.866969544 (183h22m41.826066794s) [upload=190907]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 08:48:19.961328902 (183h22m41.920426171s) [upload=190907]: Next segment err: metaclient: Too Many Requests Aug 16 08:48:19.961350154 (183h22m41.920447406s) [upload=190907]: Done uploading segments... Aug 16 08:48:19.961378612 (183h22m41.920475857s) [upload=190907]: Upload finished. err: metaclient: Too Many Requests
Duration: 375.056572ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........................X.............X.......X...........] duration:
835.549453ms
FAIL (2025-08-16 08:48:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:39:48.987058790 (183h14m10.946156022s) [upload=190753]: Starting upload Aug 16 08:39:48.987125829 (183h14m10.946223078s) [upload=190753]: Done starting upload Aug 16 08:39:48.987183429 (183h14m10.946280661s) [upload=190753]: Uploading segments... Aug 16 08:39:48.987259075 (183h14m10.94635632s) [upload=190753]: Got next segment. Inline: true Aug 16 08:39:48.987275918 (183h14m10.946373166s) [upload=190753]: Waiting for error group managing segments... Aug 16 08:39:48.987315024 (183h14m10.946412269s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:39:48.987318995 (183h14m10.946416241s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:39:48.987321784 (183h14m10.946419028s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:39:49.075021115 (183h14m11.034118361s) [upload=190753]: Done uploading segments... Aug 16 08:39:49.075039913 (183h14m11.034137148s) [upload=190753]: Upload finished. err: metaclient: Too Many Requests
Duration: 835.578724ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X..................X............................] duration:
2.604753135s
FAIL (2025-08-16 08:47:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 08:25:10.435543520 (182h59m32.394640765s) [upload=190500]: Starting upload
Aug 16 08:25:10.435617686 (182h59m32.394714935s) [upload=190500]: Done starting upload
Aug 16 08:25:10.435777771 (182h59m32.394875022s) [upload=190500]: Uploading segments...
Aug 16 08:25:10.435954869 (182h59m32.395052104s) [upload=190500]: Got next segment. Inline: false
Aug 16 08:25:10.435999461 (182h59m32.395096699s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 08:25:10.436004620 (182h59m32.395101857s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 08:25:10.667953820 (182h59m32.627051074s) [seg_pos={0 0}, upload=190500]: Begin upload segment...
Aug 16 08:25:10.668028328 (182h59m32.627125578s) [seg_pos={0 0}, upload=190500]: Done begin upload segment.
Aug 16 08:25:10.668083090 (182h59m32.627180344s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668090498 (182h59m32.627187754s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668754640 (182h59m32.627851895s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668792951 (182h59m32.627890215s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669266238 (182h59m32.628363493s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669708034 (182h59m32.628805289s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670160480 (182h59m32.629257735s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670256384 (182h59m32.629353647s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670650921 (182h59m32.629748176s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671013991 (182h59m32.630111246s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671415786 (182h59m32.630513042s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671845165 (182h59m32.630942421s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672118656 (182h59m32.631215911s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672507638 (182h59m32.631604892s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672823166 (182h59m32.63192042s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673211587 (182h59m32.632308934s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673425745 (182h59m32.632523002s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673786523 (182h59m32.632883762s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:11.232176093 (182h59m33.191273339s) [upload=190500]: Next returned nil segment
Aug 16 08:25:11.232200906 (182h59m33.19129816s) [upload=190500]: Waiting for error group managing segments...
Aug 16 08:25:11.368269277 (182h59m33.327366524s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.372753538 (182h59m33.331850795s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.386286989 (182h59m33.345384228s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.390430352 (182h59m33.349527606s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.394419607 (182h59m33.353516843s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.403417833 (182h59m33.362515082s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.415680776 (182h59m33.374778031s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.425538202 (182h59m33.384635447s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.429380836 (182h59m33.388478074s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.451830778 (182h59m33.410928052s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.474060851 (182h59m33.433158103s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.487412242 (182h59m33.446509473s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.502903342 (182h59m33.462000591s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505569355 (182h59m33.464666586s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505621932 (182h59m33.464719181s) [seg_pos={0 0}, upload=190500]: Segment reached optimal threshold of 14 pieces.
Aug 16 08:25:11.505929835 (182h59m33.465027085s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M5ger8kngGvMCD9c2qBxpFNCpLxka2fh8iWrf2XerxRiQEUja): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506046012 (182h59m33.465143284s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection
Aug 16 08:25:11.506072204 (182h59m33.465169454s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506147263 (182h59m33.465244499s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506176779 (182h59m33.465274034s) [seg_pos={0 0}, upload=190500]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 08:25:11.506273070 (182h59m33.465370302s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 08:25:11.506279562 (182h59m33.465376809s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 08:25:11.653588056 (182h59m33.612685301s) [upload=190500]: Done uploading segments...
Aug 16 08:25:11.653608757 (182h59m33.612706002s) [upload=190500]: Upload finished. err: <nil>
Duration: 2.604779581s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........................X.............X.......X..........] duration:
808.562337ms
FAIL (2025-08-16 08:47:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:39:48.987058790 (183h14m10.946156022s) [upload=190753]: Starting upload Aug 16 08:39:48.987125829 (183h14m10.946223078s) [upload=190753]: Done starting upload Aug 16 08:39:48.987183429 (183h14m10.946280661s) [upload=190753]: Uploading segments... Aug 16 08:39:48.987259075 (183h14m10.94635632s) [upload=190753]: Got next segment. Inline: true Aug 16 08:39:48.987275918 (183h14m10.946373166s) [upload=190753]: Waiting for error group managing segments... Aug 16 08:39:48.987315024 (183h14m10.946412269s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:39:48.987318995 (183h14m10.946416241s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:39:48.987321784 (183h14m10.946419028s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:39:49.075021115 (183h14m11.034118361s) [upload=190753]: Done uploading segments... Aug 16 08:39:49.075039913 (183h14m11.034137148s) [upload=190753]: Upload finished. err: metaclient: Too Many Requests
Duration: 808.610956ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............................X.............X.......X.........] duration:
1.479234693s
FAIL (2025-08-16 08:46:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:39:48.987058790 (183h14m10.946156022s) [upload=190753]: Starting upload Aug 16 08:39:48.987125829 (183h14m10.946223078s) [upload=190753]: Done starting upload Aug 16 08:39:48.987183429 (183h14m10.946280661s) [upload=190753]: Uploading segments... Aug 16 08:39:48.987259075 (183h14m10.94635632s) [upload=190753]: Got next segment. Inline: true Aug 16 08:39:48.987275918 (183h14m10.946373166s) [upload=190753]: Waiting for error group managing segments... Aug 16 08:39:48.987315024 (183h14m10.946412269s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:39:48.987318995 (183h14m10.946416241s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:39:48.987321784 (183h14m10.946419028s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:39:49.075021115 (183h14m11.034118361s) [upload=190753]: Done uploading segments... Aug 16 08:39:49.075039913 (183h14m11.034137148s) [upload=190753]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.47926125s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X..................X...........................] duration:
2.453334328s
FAIL (2025-08-16 08:46:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 08:25:10.435543520 (182h59m32.394640765s) [upload=190500]: Starting upload
Aug 16 08:25:10.435617686 (182h59m32.394714935s) [upload=190500]: Done starting upload
Aug 16 08:25:10.435777771 (182h59m32.394875022s) [upload=190500]: Uploading segments...
Aug 16 08:25:10.435954869 (182h59m32.395052104s) [upload=190500]: Got next segment. Inline: false
Aug 16 08:25:10.435999461 (182h59m32.395096699s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 08:25:10.436004620 (182h59m32.395101857s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 08:25:10.667953820 (182h59m32.627051074s) [seg_pos={0 0}, upload=190500]: Begin upload segment...
Aug 16 08:25:10.668028328 (182h59m32.627125578s) [seg_pos={0 0}, upload=190500]: Done begin upload segment.
Aug 16 08:25:10.668083090 (182h59m32.627180344s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668090498 (182h59m32.627187754s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668754640 (182h59m32.627851895s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668792951 (182h59m32.627890215s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669266238 (182h59m32.628363493s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669708034 (182h59m32.628805289s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670160480 (182h59m32.629257735s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670256384 (182h59m32.629353647s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670650921 (182h59m32.629748176s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671013991 (182h59m32.630111246s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671415786 (182h59m32.630513042s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671845165 (182h59m32.630942421s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672118656 (182h59m32.631215911s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672507638 (182h59m32.631604892s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672823166 (182h59m32.63192042s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673211587 (182h59m32.632308934s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673425745 (182h59m32.632523002s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673786523 (182h59m32.632883762s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:11.232176093 (182h59m33.191273339s) [upload=190500]: Next returned nil segment
Aug 16 08:25:11.232200906 (182h59m33.19129816s) [upload=190500]: Waiting for error group managing segments...
Aug 16 08:25:11.368269277 (182h59m33.327366524s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.372753538 (182h59m33.331850795s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.386286989 (182h59m33.345384228s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.390430352 (182h59m33.349527606s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.394419607 (182h59m33.353516843s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.403417833 (182h59m33.362515082s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.415680776 (182h59m33.374778031s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.425538202 (182h59m33.384635447s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.429380836 (182h59m33.388478074s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.451830778 (182h59m33.410928052s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.474060851 (182h59m33.433158103s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.487412242 (182h59m33.446509473s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.502903342 (182h59m33.462000591s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505569355 (182h59m33.464666586s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505621932 (182h59m33.464719181s) [seg_pos={0 0}, upload=190500]: Segment reached optimal threshold of 14 pieces.
Aug 16 08:25:11.505929835 (182h59m33.465027085s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M5ger8kngGvMCD9c2qBxpFNCpLxka2fh8iWrf2XerxRiQEUja): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506046012 (182h59m33.465143284s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection
Aug 16 08:25:11.506072204 (182h59m33.465169454s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506147263 (182h59m33.465244499s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506176779 (182h59m33.465274034s) [seg_pos={0 0}, upload=190500]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 08:25:11.506273070 (182h59m33.465370302s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 08:25:11.506279562 (182h59m33.465376809s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 08:25:11.653588056 (182h59m33.612685301s) [upload=190500]: Done uploading segments...
Aug 16 08:25:11.653608757 (182h59m33.612706002s) [upload=190500]: Upload finished. err: <nil>
Duration: 2.453373917s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............................X.............X.......X........] duration:
1.017075073s
FAIL (2025-08-16 08:46:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:39:48.987058790 (183h14m10.946156022s) [upload=190753]: Starting upload Aug 16 08:39:48.987125829 (183h14m10.946223078s) [upload=190753]: Done starting upload Aug 16 08:39:48.987183429 (183h14m10.946280661s) [upload=190753]: Uploading segments... Aug 16 08:39:48.987259075 (183h14m10.94635632s) [upload=190753]: Got next segment. Inline: true Aug 16 08:39:48.987275918 (183h14m10.946373166s) [upload=190753]: Waiting for error group managing segments... Aug 16 08:39:48.987315024 (183h14m10.946412269s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:39:48.987318995 (183h14m10.946416241s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:39:48.987321784 (183h14m10.946419028s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:39:49.075021115 (183h14m11.034118361s) [upload=190753]: Done uploading segments... Aug 16 08:39:49.075039913 (183h14m11.034137148s) [upload=190753]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.017108509s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X..................X..........................] duration:
2.385939932s
FAIL (2025-08-16 08:46:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 08:25:10.435543520 (182h59m32.394640765s) [upload=190500]: Starting upload
Aug 16 08:25:10.435617686 (182h59m32.394714935s) [upload=190500]: Done starting upload
Aug 16 08:25:10.435777771 (182h59m32.394875022s) [upload=190500]: Uploading segments...
Aug 16 08:25:10.435954869 (182h59m32.395052104s) [upload=190500]: Got next segment. Inline: false
Aug 16 08:25:10.435999461 (182h59m32.395096699s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 08:25:10.436004620 (182h59m32.395101857s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 08:25:10.667953820 (182h59m32.627051074s) [seg_pos={0 0}, upload=190500]: Begin upload segment...
Aug 16 08:25:10.668028328 (182h59m32.627125578s) [seg_pos={0 0}, upload=190500]: Done begin upload segment.
Aug 16 08:25:10.668083090 (182h59m32.627180344s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668090498 (182h59m32.627187754s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668754640 (182h59m32.627851895s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668792951 (182h59m32.627890215s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669266238 (182h59m32.628363493s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669708034 (182h59m32.628805289s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670160480 (182h59m32.629257735s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670256384 (182h59m32.629353647s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670650921 (182h59m32.629748176s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671013991 (182h59m32.630111246s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671415786 (182h59m32.630513042s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671845165 (182h59m32.630942421s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672118656 (182h59m32.631215911s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672507638 (182h59m32.631604892s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672823166 (182h59m32.63192042s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673211587 (182h59m32.632308934s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673425745 (182h59m32.632523002s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673786523 (182h59m32.632883762s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:11.232176093 (182h59m33.191273339s) [upload=190500]: Next returned nil segment
Aug 16 08:25:11.232200906 (182h59m33.19129816s) [upload=190500]: Waiting for error group managing segments...
Aug 16 08:25:11.368269277 (182h59m33.327366524s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.372753538 (182h59m33.331850795s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.386286989 (182h59m33.345384228s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.390430352 (182h59m33.349527606s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.394419607 (182h59m33.353516843s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.403417833 (182h59m33.362515082s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.415680776 (182h59m33.374778031s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.425538202 (182h59m33.384635447s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.429380836 (182h59m33.388478074s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.451830778 (182h59m33.410928052s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.474060851 (182h59m33.433158103s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.487412242 (182h59m33.446509473s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.502903342 (182h59m33.462000591s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505569355 (182h59m33.464666586s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505621932 (182h59m33.464719181s) [seg_pos={0 0}, upload=190500]: Segment reached optimal threshold of 14 pieces.
Aug 16 08:25:11.505929835 (182h59m33.465027085s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M5ger8kngGvMCD9c2qBxpFNCpLxka2fh8iWrf2XerxRiQEUja): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506046012 (182h59m33.465143284s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection
Aug 16 08:25:11.506072204 (182h59m33.465169454s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506147263 (182h59m33.465244499s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506176779 (182h59m33.465274034s) [seg_pos={0 0}, upload=190500]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 08:25:11.506273070 (182h59m33.465370302s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 08:25:11.506279562 (182h59m33.465376809s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 08:25:11.653588056 (182h59m33.612685301s) [upload=190500]: Done uploading segments...
Aug 16 08:25:11.653608757 (182h59m33.612706002s) [upload=190500]: Upload finished. err: <nil>
Duration: 2.385979283s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X..................X.........................] duration:
3.292850678s
FAIL (2025-08-16 08:45:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 08:25:10.435543520 (182h59m32.394640765s) [upload=190500]: Starting upload
Aug 16 08:25:10.435617686 (182h59m32.394714935s) [upload=190500]: Done starting upload
Aug 16 08:25:10.435777771 (182h59m32.394875022s) [upload=190500]: Uploading segments...
Aug 16 08:25:10.435954869 (182h59m32.395052104s) [upload=190500]: Got next segment. Inline: false
Aug 16 08:25:10.435999461 (182h59m32.395096699s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 08:25:10.436004620 (182h59m32.395101857s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 08:25:10.667953820 (182h59m32.627051074s) [seg_pos={0 0}, upload=190500]: Begin upload segment...
Aug 16 08:25:10.668028328 (182h59m32.627125578s) [seg_pos={0 0}, upload=190500]: Done begin upload segment.
Aug 16 08:25:10.668083090 (182h59m32.627180344s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668090498 (182h59m32.627187754s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668754640 (182h59m32.627851895s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668792951 (182h59m32.627890215s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669266238 (182h59m32.628363493s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669708034 (182h59m32.628805289s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670160480 (182h59m32.629257735s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670256384 (182h59m32.629353647s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670650921 (182h59m32.629748176s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671013991 (182h59m32.630111246s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671415786 (182h59m32.630513042s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671845165 (182h59m32.630942421s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672118656 (182h59m32.631215911s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672507638 (182h59m32.631604892s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672823166 (182h59m32.63192042s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673211587 (182h59m32.632308934s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673425745 (182h59m32.632523002s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673786523 (182h59m32.632883762s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:11.232176093 (182h59m33.191273339s) [upload=190500]: Next returned nil segment
Aug 16 08:25:11.232200906 (182h59m33.19129816s) [upload=190500]: Waiting for error group managing segments...
Aug 16 08:25:11.368269277 (182h59m33.327366524s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.372753538 (182h59m33.331850795s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.386286989 (182h59m33.345384228s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.390430352 (182h59m33.349527606s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.394419607 (182h59m33.353516843s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.403417833 (182h59m33.362515082s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.415680776 (182h59m33.374778031s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.425538202 (182h59m33.384635447s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.429380836 (182h59m33.388478074s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.451830778 (182h59m33.410928052s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.474060851 (182h59m33.433158103s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.487412242 (182h59m33.446509473s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.502903342 (182h59m33.462000591s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505569355 (182h59m33.464666586s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505621932 (182h59m33.464719181s) [seg_pos={0 0}, upload=190500]: Segment reached optimal threshold of 14 pieces.
Aug 16 08:25:11.505929835 (182h59m33.465027085s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M5ger8kngGvMCD9c2qBxpFNCpLxka2fh8iWrf2XerxRiQEUja): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506046012 (182h59m33.465143284s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection
Aug 16 08:25:11.506072204 (182h59m33.465169454s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506147263 (182h59m33.465244499s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506176779 (182h59m33.465274034s) [seg_pos={0 0}, upload=190500]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 08:25:11.506273070 (182h59m33.465370302s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 08:25:11.506279562 (182h59m33.465376809s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 08:25:11.653588056 (182h59m33.612685301s) [upload=190500]: Done uploading segments...
Aug 16 08:25:11.653608757 (182h59m33.612706002s) [upload=190500]: Upload finished. err: <nil>
Duration: 3.292904304s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............................X.............X.......X.......] duration:
974.945726ms
FAIL (2025-08-16 08:45:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:39:48.987058790 (183h14m10.946156022s) [upload=190753]: Starting upload Aug 16 08:39:48.987125829 (183h14m10.946223078s) [upload=190753]: Done starting upload Aug 16 08:39:48.987183429 (183h14m10.946280661s) [upload=190753]: Uploading segments... Aug 16 08:39:48.987259075 (183h14m10.94635632s) [upload=190753]: Got next segment. Inline: true Aug 16 08:39:48.987275918 (183h14m10.946373166s) [upload=190753]: Waiting for error group managing segments... Aug 16 08:39:48.987315024 (183h14m10.946412269s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:39:48.987318995 (183h14m10.946416241s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:39:48.987321784 (183h14m10.946419028s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:39:49.075021115 (183h14m11.034118361s) [upload=190753]: Done uploading segments... Aug 16 08:39:49.075039913 (183h14m11.034137148s) [upload=190753]: Upload finished. err: metaclient: Too Many Requests
Duration: 974.986056ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X..................X........................] duration:
3.049057507s
FAIL (2025-08-16 08:44:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 08:25:10.435543520 (182h59m32.394640765s) [upload=190500]: Starting upload
Aug 16 08:25:10.435617686 (182h59m32.394714935s) [upload=190500]: Done starting upload
Aug 16 08:25:10.435777771 (182h59m32.394875022s) [upload=190500]: Uploading segments...
Aug 16 08:25:10.435954869 (182h59m32.395052104s) [upload=190500]: Got next segment. Inline: false
Aug 16 08:25:10.435999461 (182h59m32.395096699s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 08:25:10.436004620 (182h59m32.395101857s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 08:25:10.667953820 (182h59m32.627051074s) [seg_pos={0 0}, upload=190500]: Begin upload segment...
Aug 16 08:25:10.668028328 (182h59m32.627125578s) [seg_pos={0 0}, upload=190500]: Done begin upload segment.
Aug 16 08:25:10.668083090 (182h59m32.627180344s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668090498 (182h59m32.627187754s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668754640 (182h59m32.627851895s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668792951 (182h59m32.627890215s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669266238 (182h59m32.628363493s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669708034 (182h59m32.628805289s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670160480 (182h59m32.629257735s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670256384 (182h59m32.629353647s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670650921 (182h59m32.629748176s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671013991 (182h59m32.630111246s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671415786 (182h59m32.630513042s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671845165 (182h59m32.630942421s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672118656 (182h59m32.631215911s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672507638 (182h59m32.631604892s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672823166 (182h59m32.63192042s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673211587 (182h59m32.632308934s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673425745 (182h59m32.632523002s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673786523 (182h59m32.632883762s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:11.232176093 (182h59m33.191273339s) [upload=190500]: Next returned nil segment
Aug 16 08:25:11.232200906 (182h59m33.19129816s) [upload=190500]: Waiting for error group managing segments...
Aug 16 08:25:11.368269277 (182h59m33.327366524s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.372753538 (182h59m33.331850795s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.386286989 (182h59m33.345384228s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.390430352 (182h59m33.349527606s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.394419607 (182h59m33.353516843s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.403417833 (182h59m33.362515082s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.415680776 (182h59m33.374778031s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.425538202 (182h59m33.384635447s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.429380836 (182h59m33.388478074s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.451830778 (182h59m33.410928052s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.474060851 (182h59m33.433158103s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.487412242 (182h59m33.446509473s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.502903342 (182h59m33.462000591s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505569355 (182h59m33.464666586s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505621932 (182h59m33.464719181s) [seg_pos={0 0}, upload=190500]: Segment reached optimal threshold of 14 pieces.
Aug 16 08:25:11.505929835 (182h59m33.465027085s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M5ger8kngGvMCD9c2qBxpFNCpLxka2fh8iWrf2XerxRiQEUja): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506046012 (182h59m33.465143284s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection
Aug 16 08:25:11.506072204 (182h59m33.465169454s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506147263 (182h59m33.465244499s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506176779 (182h59m33.465274034s) [seg_pos={0 0}, upload=190500]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 08:25:11.506273070 (182h59m33.465370302s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 08:25:11.506279562 (182h59m33.465376809s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 08:25:11.653588056 (182h59m33.612685301s) [upload=190500]: Done uploading segments...
Aug 16 08:25:11.653608757 (182h59m33.612706002s) [upload=190500]: Upload finished. err: <nil>
Duration: 3.049116445s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............................X.............X.......X......] duration:
878.531584ms
FAIL (2025-08-16 08:44:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:39:48.987058790 (183h14m10.946156022s) [upload=190753]: Starting upload Aug 16 08:39:48.987125829 (183h14m10.946223078s) [upload=190753]: Done starting upload Aug 16 08:39:48.987183429 (183h14m10.946280661s) [upload=190753]: Uploading segments... Aug 16 08:39:48.987259075 (183h14m10.94635632s) [upload=190753]: Got next segment. Inline: true Aug 16 08:39:48.987275918 (183h14m10.946373166s) [upload=190753]: Waiting for error group managing segments... Aug 16 08:39:48.987315024 (183h14m10.946412269s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:39:48.987318995 (183h14m10.946416241s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:39:48.987321784 (183h14m10.946419028s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:39:49.075021115 (183h14m11.034118361s) [upload=190753]: Done uploading segments... Aug 16 08:39:49.075039913 (183h14m11.034137148s) [upload=190753]: Upload finished. err: metaclient: Too Many Requests
Duration: 878.566955ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X..................X.......................] duration:
2.759406036s
FAIL (2025-08-16 08:43:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 08:25:10.435543520 (182h59m32.394640765s) [upload=190500]: Starting upload
Aug 16 08:25:10.435617686 (182h59m32.394714935s) [upload=190500]: Done starting upload
Aug 16 08:25:10.435777771 (182h59m32.394875022s) [upload=190500]: Uploading segments...
Aug 16 08:25:10.435954869 (182h59m32.395052104s) [upload=190500]: Got next segment. Inline: false
Aug 16 08:25:10.435999461 (182h59m32.395096699s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 08:25:10.436004620 (182h59m32.395101857s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 08:25:10.667953820 (182h59m32.627051074s) [seg_pos={0 0}, upload=190500]: Begin upload segment...
Aug 16 08:25:10.668028328 (182h59m32.627125578s) [seg_pos={0 0}, upload=190500]: Done begin upload segment.
Aug 16 08:25:10.668083090 (182h59m32.627180344s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668090498 (182h59m32.627187754s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668754640 (182h59m32.627851895s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668792951 (182h59m32.627890215s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669266238 (182h59m32.628363493s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669708034 (182h59m32.628805289s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670160480 (182h59m32.629257735s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670256384 (182h59m32.629353647s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670650921 (182h59m32.629748176s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671013991 (182h59m32.630111246s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671415786 (182h59m32.630513042s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671845165 (182h59m32.630942421s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672118656 (182h59m32.631215911s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672507638 (182h59m32.631604892s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672823166 (182h59m32.63192042s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673211587 (182h59m32.632308934s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673425745 (182h59m32.632523002s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673786523 (182h59m32.632883762s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:11.232176093 (182h59m33.191273339s) [upload=190500]: Next returned nil segment
Aug 16 08:25:11.232200906 (182h59m33.19129816s) [upload=190500]: Waiting for error group managing segments...
Aug 16 08:25:11.368269277 (182h59m33.327366524s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.372753538 (182h59m33.331850795s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.386286989 (182h59m33.345384228s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.390430352 (182h59m33.349527606s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.394419607 (182h59m33.353516843s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.403417833 (182h59m33.362515082s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.415680776 (182h59m33.374778031s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.425538202 (182h59m33.384635447s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.429380836 (182h59m33.388478074s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.451830778 (182h59m33.410928052s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.474060851 (182h59m33.433158103s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.487412242 (182h59m33.446509473s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.502903342 (182h59m33.462000591s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505569355 (182h59m33.464666586s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505621932 (182h59m33.464719181s) [seg_pos={0 0}, upload=190500]: Segment reached optimal threshold of 14 pieces.
Aug 16 08:25:11.505929835 (182h59m33.465027085s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M5ger8kngGvMCD9c2qBxpFNCpLxka2fh8iWrf2XerxRiQEUja): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506046012 (182h59m33.465143284s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection
Aug 16 08:25:11.506072204 (182h59m33.465169454s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506147263 (182h59m33.465244499s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506176779 (182h59m33.465274034s) [seg_pos={0 0}, upload=190500]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 08:25:11.506273070 (182h59m33.465370302s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 08:25:11.506279562 (182h59m33.465376809s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 08:25:11.653588056 (182h59m33.612685301s) [upload=190500]: Done uploading segments...
Aug 16 08:25:11.653608757 (182h59m33.612706002s) [upload=190500]: Upload finished. err: <nil>
Duration: 2.759434632s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X..................X......................] duration:
2.506123719s
FAIL (2025-08-16 08:43:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 08:25:10.435543520 (182h59m32.394640765s) [upload=190500]: Starting upload
Aug 16 08:25:10.435617686 (182h59m32.394714935s) [upload=190500]: Done starting upload
Aug 16 08:25:10.435777771 (182h59m32.394875022s) [upload=190500]: Uploading segments...
Aug 16 08:25:10.435954869 (182h59m32.395052104s) [upload=190500]: Got next segment. Inline: false
Aug 16 08:25:10.435999461 (182h59m32.395096699s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 08:25:10.436004620 (182h59m32.395101857s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 08:25:10.667953820 (182h59m32.627051074s) [seg_pos={0 0}, upload=190500]: Begin upload segment...
Aug 16 08:25:10.668028328 (182h59m32.627125578s) [seg_pos={0 0}, upload=190500]: Done begin upload segment.
Aug 16 08:25:10.668083090 (182h59m32.627180344s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668090498 (182h59m32.627187754s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668754640 (182h59m32.627851895s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668792951 (182h59m32.627890215s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669266238 (182h59m32.628363493s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669708034 (182h59m32.628805289s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670160480 (182h59m32.629257735s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670256384 (182h59m32.629353647s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670650921 (182h59m32.629748176s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671013991 (182h59m32.630111246s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671415786 (182h59m32.630513042s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671845165 (182h59m32.630942421s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672118656 (182h59m32.631215911s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672507638 (182h59m32.631604892s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672823166 (182h59m32.63192042s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673211587 (182h59m32.632308934s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673425745 (182h59m32.632523002s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673786523 (182h59m32.632883762s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:11.232176093 (182h59m33.191273339s) [upload=190500]: Next returned nil segment
Aug 16 08:25:11.232200906 (182h59m33.19129816s) [upload=190500]: Waiting for error group managing segments...
Aug 16 08:25:11.368269277 (182h59m33.327366524s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.372753538 (182h59m33.331850795s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.386286989 (182h59m33.345384228s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.390430352 (182h59m33.349527606s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.394419607 (182h59m33.353516843s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.403417833 (182h59m33.362515082s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.415680776 (182h59m33.374778031s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.425538202 (182h59m33.384635447s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.429380836 (182h59m33.388478074s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.451830778 (182h59m33.410928052s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.474060851 (182h59m33.433158103s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.487412242 (182h59m33.446509473s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.502903342 (182h59m33.462000591s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505569355 (182h59m33.464666586s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505621932 (182h59m33.464719181s) [seg_pos={0 0}, upload=190500]: Segment reached optimal threshold of 14 pieces.
Aug 16 08:25:11.505929835 (182h59m33.465027085s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M5ger8kngGvMCD9c2qBxpFNCpLxka2fh8iWrf2XerxRiQEUja): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506046012 (182h59m33.465143284s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection
Aug 16 08:25:11.506072204 (182h59m33.465169454s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506147263 (182h59m33.465244499s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506176779 (182h59m33.465274034s) [seg_pos={0 0}, upload=190500]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 08:25:11.506273070 (182h59m33.465370302s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 08:25:11.506279562 (182h59m33.465376809s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 08:25:11.653588056 (182h59m33.612685301s) [upload=190500]: Done uploading segments...
Aug 16 08:25:11.653608757 (182h59m33.612706002s) [upload=190500]: Upload finished. err: <nil>
Duration: 2.506187627s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................................X.............X.......X.....] duration:
1.188153661s
FAIL (2025-08-16 08:43:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:39:48.987058790 (183h14m10.946156022s) [upload=190753]: Starting upload Aug 16 08:39:48.987125829 (183h14m10.946223078s) [upload=190753]: Done starting upload Aug 16 08:39:48.987183429 (183h14m10.946280661s) [upload=190753]: Uploading segments... Aug 16 08:39:48.987259075 (183h14m10.94635632s) [upload=190753]: Got next segment. Inline: true Aug 16 08:39:48.987275918 (183h14m10.946373166s) [upload=190753]: Waiting for error group managing segments... Aug 16 08:39:48.987315024 (183h14m10.946412269s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:39:48.987318995 (183h14m10.946416241s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:39:48.987321784 (183h14m10.946419028s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:39:49.075021115 (183h14m11.034118361s) [upload=190753]: Done uploading segments... Aug 16 08:39:49.075039913 (183h14m11.034137148s) [upload=190753]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.188189309s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................................X.............X.......X....] duration:
846.440698ms
FAIL (2025-08-16 08:43:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:39:48.987058790 (183h14m10.946156022s) [upload=190753]: Starting upload Aug 16 08:39:48.987125829 (183h14m10.946223078s) [upload=190753]: Done starting upload Aug 16 08:39:48.987183429 (183h14m10.946280661s) [upload=190753]: Uploading segments... Aug 16 08:39:48.987259075 (183h14m10.94635632s) [upload=190753]: Got next segment. Inline: true Aug 16 08:39:48.987275918 (183h14m10.946373166s) [upload=190753]: Waiting for error group managing segments... Aug 16 08:39:48.987315024 (183h14m10.946412269s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:39:48.987318995 (183h14m10.946416241s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:39:48.987321784 (183h14m10.946419028s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:39:49.075021115 (183h14m11.034118361s) [upload=190753]: Done uploading segments... Aug 16 08:39:49.075039913 (183h14m11.034137148s) [upload=190753]: Upload finished. err: metaclient: Too Many Requests
Duration: 846.475799ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X..................X.....................] duration:
2.764610287s
FAIL (2025-08-16 08:42:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 08:25:10.435543520 (182h59m32.394640765s) [upload=190500]: Starting upload
Aug 16 08:25:10.435617686 (182h59m32.394714935s) [upload=190500]: Done starting upload
Aug 16 08:25:10.435777771 (182h59m32.394875022s) [upload=190500]: Uploading segments...
Aug 16 08:25:10.435954869 (182h59m32.395052104s) [upload=190500]: Got next segment. Inline: false
Aug 16 08:25:10.435999461 (182h59m32.395096699s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 08:25:10.436004620 (182h59m32.395101857s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 08:25:10.667953820 (182h59m32.627051074s) [seg_pos={0 0}, upload=190500]: Begin upload segment...
Aug 16 08:25:10.668028328 (182h59m32.627125578s) [seg_pos={0 0}, upload=190500]: Done begin upload segment.
Aug 16 08:25:10.668083090 (182h59m32.627180344s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668090498 (182h59m32.627187754s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668754640 (182h59m32.627851895s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668792951 (182h59m32.627890215s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669266238 (182h59m32.628363493s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669708034 (182h59m32.628805289s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670160480 (182h59m32.629257735s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670256384 (182h59m32.629353647s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670650921 (182h59m32.629748176s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671013991 (182h59m32.630111246s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671415786 (182h59m32.630513042s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671845165 (182h59m32.630942421s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672118656 (182h59m32.631215911s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672507638 (182h59m32.631604892s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672823166 (182h59m32.63192042s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673211587 (182h59m32.632308934s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673425745 (182h59m32.632523002s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673786523 (182h59m32.632883762s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:11.232176093 (182h59m33.191273339s) [upload=190500]: Next returned nil segment
Aug 16 08:25:11.232200906 (182h59m33.19129816s) [upload=190500]: Waiting for error group managing segments...
Aug 16 08:25:11.368269277 (182h59m33.327366524s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.372753538 (182h59m33.331850795s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.386286989 (182h59m33.345384228s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.390430352 (182h59m33.349527606s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.394419607 (182h59m33.353516843s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.403417833 (182h59m33.362515082s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.415680776 (182h59m33.374778031s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.425538202 (182h59m33.384635447s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.429380836 (182h59m33.388478074s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.451830778 (182h59m33.410928052s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.474060851 (182h59m33.433158103s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.487412242 (182h59m33.446509473s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.502903342 (182h59m33.462000591s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505569355 (182h59m33.464666586s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505621932 (182h59m33.464719181s) [seg_pos={0 0}, upload=190500]: Segment reached optimal threshold of 14 pieces.
Aug 16 08:25:11.505929835 (182h59m33.465027085s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M5ger8kngGvMCD9c2qBxpFNCpLxka2fh8iWrf2XerxRiQEUja): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506046012 (182h59m33.465143284s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection
Aug 16 08:25:11.506072204 (182h59m33.465169454s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506147263 (182h59m33.465244499s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506176779 (182h59m33.465274034s) [seg_pos={0 0}, upload=190500]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 08:25:11.506273070 (182h59m33.465370302s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 08:25:11.506279562 (182h59m33.465376809s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 08:25:11.653588056 (182h59m33.612685301s) [upload=190500]: Done uploading segments...
Aug 16 08:25:11.653608757 (182h59m33.612706002s) [upload=190500]: Upload finished. err: <nil>
Duration: 2.764651111s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................................X.............X.......X...] duration:
916.336964ms
FAIL (2025-08-16 08:42:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:39:48.987058790 (183h14m10.946156022s) [upload=190753]: Starting upload Aug 16 08:39:48.987125829 (183h14m10.946223078s) [upload=190753]: Done starting upload Aug 16 08:39:48.987183429 (183h14m10.946280661s) [upload=190753]: Uploading segments... Aug 16 08:39:48.987259075 (183h14m10.94635632s) [upload=190753]: Got next segment. Inline: true Aug 16 08:39:48.987275918 (183h14m10.946373166s) [upload=190753]: Waiting for error group managing segments... Aug 16 08:39:48.987315024 (183h14m10.946412269s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:39:48.987318995 (183h14m10.946416241s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:39:48.987321784 (183h14m10.946419028s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:39:49.075021115 (183h14m11.034118361s) [upload=190753]: Done uploading segments... Aug 16 08:39:49.075039913 (183h14m11.034137148s) [upload=190753]: Upload finished. err: metaclient: Too Many Requests
Duration: 916.370928ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X..................X....................] duration:
2.400053612s
FAIL (2025-08-16 08:42:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 08:25:10.435543520 (182h59m32.394640765s) [upload=190500]: Starting upload
Aug 16 08:25:10.435617686 (182h59m32.394714935s) [upload=190500]: Done starting upload
Aug 16 08:25:10.435777771 (182h59m32.394875022s) [upload=190500]: Uploading segments...
Aug 16 08:25:10.435954869 (182h59m32.395052104s) [upload=190500]: Got next segment. Inline: false
Aug 16 08:25:10.435999461 (182h59m32.395096699s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 08:25:10.436004620 (182h59m32.395101857s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 08:25:10.667953820 (182h59m32.627051074s) [seg_pos={0 0}, upload=190500]: Begin upload segment...
Aug 16 08:25:10.668028328 (182h59m32.627125578s) [seg_pos={0 0}, upload=190500]: Done begin upload segment.
Aug 16 08:25:10.668083090 (182h59m32.627180344s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668090498 (182h59m32.627187754s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668754640 (182h59m32.627851895s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668792951 (182h59m32.627890215s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669266238 (182h59m32.628363493s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669708034 (182h59m32.628805289s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670160480 (182h59m32.629257735s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670256384 (182h59m32.629353647s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670650921 (182h59m32.629748176s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671013991 (182h59m32.630111246s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671415786 (182h59m32.630513042s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671845165 (182h59m32.630942421s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672118656 (182h59m32.631215911s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672507638 (182h59m32.631604892s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672823166 (182h59m32.63192042s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673211587 (182h59m32.632308934s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673425745 (182h59m32.632523002s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673786523 (182h59m32.632883762s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:11.232176093 (182h59m33.191273339s) [upload=190500]: Next returned nil segment
Aug 16 08:25:11.232200906 (182h59m33.19129816s) [upload=190500]: Waiting for error group managing segments...
Aug 16 08:25:11.368269277 (182h59m33.327366524s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.372753538 (182h59m33.331850795s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.386286989 (182h59m33.345384228s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.390430352 (182h59m33.349527606s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.394419607 (182h59m33.353516843s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.403417833 (182h59m33.362515082s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.415680776 (182h59m33.374778031s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.425538202 (182h59m33.384635447s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.429380836 (182h59m33.388478074s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.451830778 (182h59m33.410928052s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.474060851 (182h59m33.433158103s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.487412242 (182h59m33.446509473s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.502903342 (182h59m33.462000591s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505569355 (182h59m33.464666586s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505621932 (182h59m33.464719181s) [seg_pos={0 0}, upload=190500]: Segment reached optimal threshold of 14 pieces.
Aug 16 08:25:11.505929835 (182h59m33.465027085s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M5ger8kngGvMCD9c2qBxpFNCpLxka2fh8iWrf2XerxRiQEUja): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506046012 (182h59m33.465143284s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection
Aug 16 08:25:11.506072204 (182h59m33.465169454s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506147263 (182h59m33.465244499s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506176779 (182h59m33.465274034s) [seg_pos={0 0}, upload=190500]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 08:25:11.506273070 (182h59m33.465370302s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 08:25:11.506279562 (182h59m33.465376809s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 08:25:11.653588056 (182h59m33.612685301s) [upload=190500]: Done uploading segments...
Aug 16 08:25:11.653608757 (182h59m33.612706002s) [upload=190500]: Upload finished. err: <nil>
Duration: 2.400161444s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................................X.............X.......X..] duration:
829.982927ms
FAIL (2025-08-16 08:41:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:39:48.987058790 (183h14m10.946156022s) [upload=190753]: Starting upload Aug 16 08:39:48.987125829 (183h14m10.946223078s) [upload=190753]: Done starting upload Aug 16 08:39:48.987183429 (183h14m10.946280661s) [upload=190753]: Uploading segments... Aug 16 08:39:48.987259075 (183h14m10.94635632s) [upload=190753]: Got next segment. Inline: true Aug 16 08:39:48.987275918 (183h14m10.946373166s) [upload=190753]: Waiting for error group managing segments... Aug 16 08:39:48.987315024 (183h14m10.946412269s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:39:48.987318995 (183h14m10.946416241s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:39:48.987321784 (183h14m10.946419028s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:39:49.075021115 (183h14m11.034118361s) [upload=190753]: Done uploading segments... Aug 16 08:39:49.075039913 (183h14m11.034137148s) [upload=190753]: Upload finished. err: metaclient: Too Many Requests
Duration: 830.086383ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X..................X...................] duration:
2.57211445s
FAIL (2025-08-16 08:41:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 08:25:10.435543520 (182h59m32.394640765s) [upload=190500]: Starting upload
Aug 16 08:25:10.435617686 (182h59m32.394714935s) [upload=190500]: Done starting upload
Aug 16 08:25:10.435777771 (182h59m32.394875022s) [upload=190500]: Uploading segments...
Aug 16 08:25:10.435954869 (182h59m32.395052104s) [upload=190500]: Got next segment. Inline: false
Aug 16 08:25:10.435999461 (182h59m32.395096699s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 08:25:10.436004620 (182h59m32.395101857s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 08:25:10.667953820 (182h59m32.627051074s) [seg_pos={0 0}, upload=190500]: Begin upload segment...
Aug 16 08:25:10.668028328 (182h59m32.627125578s) [seg_pos={0 0}, upload=190500]: Done begin upload segment.
Aug 16 08:25:10.668083090 (182h59m32.627180344s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668090498 (182h59m32.627187754s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668754640 (182h59m32.627851895s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668792951 (182h59m32.627890215s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669266238 (182h59m32.628363493s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669708034 (182h59m32.628805289s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670160480 (182h59m32.629257735s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670256384 (182h59m32.629353647s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670650921 (182h59m32.629748176s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671013991 (182h59m32.630111246s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671415786 (182h59m32.630513042s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671845165 (182h59m32.630942421s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672118656 (182h59m32.631215911s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672507638 (182h59m32.631604892s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672823166 (182h59m32.63192042s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673211587 (182h59m32.632308934s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673425745 (182h59m32.632523002s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673786523 (182h59m32.632883762s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:11.232176093 (182h59m33.191273339s) [upload=190500]: Next returned nil segment
Aug 16 08:25:11.232200906 (182h59m33.19129816s) [upload=190500]: Waiting for error group managing segments...
Aug 16 08:25:11.368269277 (182h59m33.327366524s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.372753538 (182h59m33.331850795s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.386286989 (182h59m33.345384228s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.390430352 (182h59m33.349527606s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.394419607 (182h59m33.353516843s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.403417833 (182h59m33.362515082s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.415680776 (182h59m33.374778031s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.425538202 (182h59m33.384635447s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.429380836 (182h59m33.388478074s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.451830778 (182h59m33.410928052s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.474060851 (182h59m33.433158103s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.487412242 (182h59m33.446509473s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.502903342 (182h59m33.462000591s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505569355 (182h59m33.464666586s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505621932 (182h59m33.464719181s) [seg_pos={0 0}, upload=190500]: Segment reached optimal threshold of 14 pieces.
Aug 16 08:25:11.505929835 (182h59m33.465027085s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M5ger8kngGvMCD9c2qBxpFNCpLxka2fh8iWrf2XerxRiQEUja): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506046012 (182h59m33.465143284s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection
Aug 16 08:25:11.506072204 (182h59m33.465169454s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506147263 (182h59m33.465244499s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506176779 (182h59m33.465274034s) [seg_pos={0 0}, upload=190500]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 08:25:11.506273070 (182h59m33.465370302s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 08:25:11.506279562 (182h59m33.465376809s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 08:25:11.653588056 (182h59m33.612685301s) [upload=190500]: Done uploading segments...
Aug 16 08:25:11.653608757 (182h59m33.612706002s) [upload=190500]: Upload finished. err: <nil>
Duration: 2.572150588s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................................X.............X.......X.] duration:
1.095688228s
FAIL (2025-08-16 08:40:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:39:48.987058790 (183h14m10.946156022s) [upload=190753]: Starting upload Aug 16 08:39:48.987125829 (183h14m10.946223078s) [upload=190753]: Done starting upload Aug 16 08:39:48.987183429 (183h14m10.946280661s) [upload=190753]: Uploading segments... Aug 16 08:39:48.987259075 (183h14m10.94635632s) [upload=190753]: Got next segment. Inline: true Aug 16 08:39:48.987275918 (183h14m10.946373166s) [upload=190753]: Waiting for error group managing segments... Aug 16 08:39:48.987315024 (183h14m10.946412269s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:39:48.987318995 (183h14m10.946416241s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:39:48.987321784 (183h14m10.946419028s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:39:49.075021115 (183h14m11.034118361s) [upload=190753]: Done uploading segments... Aug 16 08:39:49.075039913 (183h14m11.034137148s) [upload=190753]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.095811675s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X..................X..................] duration:
2.460644111s
FAIL (2025-08-16 08:40:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 08:25:10.435543520 (182h59m32.394640765s) [upload=190500]: Starting upload
Aug 16 08:25:10.435617686 (182h59m32.394714935s) [upload=190500]: Done starting upload
Aug 16 08:25:10.435777771 (182h59m32.394875022s) [upload=190500]: Uploading segments...
Aug 16 08:25:10.435954869 (182h59m32.395052104s) [upload=190500]: Got next segment. Inline: false
Aug 16 08:25:10.435999461 (182h59m32.395096699s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 08:25:10.436004620 (182h59m32.395101857s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 08:25:10.667953820 (182h59m32.627051074s) [seg_pos={0 0}, upload=190500]: Begin upload segment...
Aug 16 08:25:10.668028328 (182h59m32.627125578s) [seg_pos={0 0}, upload=190500]: Done begin upload segment.
Aug 16 08:25:10.668083090 (182h59m32.627180344s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668090498 (182h59m32.627187754s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668754640 (182h59m32.627851895s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668792951 (182h59m32.627890215s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669266238 (182h59m32.628363493s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669708034 (182h59m32.628805289s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670160480 (182h59m32.629257735s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670256384 (182h59m32.629353647s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670650921 (182h59m32.629748176s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671013991 (182h59m32.630111246s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671415786 (182h59m32.630513042s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671845165 (182h59m32.630942421s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672118656 (182h59m32.631215911s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672507638 (182h59m32.631604892s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672823166 (182h59m32.63192042s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673211587 (182h59m32.632308934s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673425745 (182h59m32.632523002s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673786523 (182h59m32.632883762s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:11.232176093 (182h59m33.191273339s) [upload=190500]: Next returned nil segment
Aug 16 08:25:11.232200906 (182h59m33.19129816s) [upload=190500]: Waiting for error group managing segments...
Aug 16 08:25:11.368269277 (182h59m33.327366524s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.372753538 (182h59m33.331850795s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.386286989 (182h59m33.345384228s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.390430352 (182h59m33.349527606s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.394419607 (182h59m33.353516843s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.403417833 (182h59m33.362515082s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.415680776 (182h59m33.374778031s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.425538202 (182h59m33.384635447s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.429380836 (182h59m33.388478074s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.451830778 (182h59m33.410928052s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.474060851 (182h59m33.433158103s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.487412242 (182h59m33.446509473s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.502903342 (182h59m33.462000591s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505569355 (182h59m33.464666586s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505621932 (182h59m33.464719181s) [seg_pos={0 0}, upload=190500]: Segment reached optimal threshold of 14 pieces.
Aug 16 08:25:11.505929835 (182h59m33.465027085s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M5ger8kngGvMCD9c2qBxpFNCpLxka2fh8iWrf2XerxRiQEUja): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506046012 (182h59m33.465143284s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection
Aug 16 08:25:11.506072204 (182h59m33.465169454s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506147263 (182h59m33.465244499s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506176779 (182h59m33.465274034s) [seg_pos={0 0}, upload=190500]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 08:25:11.506273070 (182h59m33.465370302s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 08:25:11.506279562 (182h59m33.465376809s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 08:25:11.653588056 (182h59m33.612685301s) [upload=190500]: Done uploading segments...
Aug 16 08:25:11.653608757 (182h59m33.612706002s) [upload=190500]: Upload finished. err: <nil>
Duration: 2.460676993s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................................X.............X.......X] duration:
357.979821ms
FAIL (2025-08-16 08:39:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:39:48.987058790 (183h14m10.946156022s) [upload=190753]: Starting upload Aug 16 08:39:48.987125829 (183h14m10.946223078s) [upload=190753]: Done starting upload Aug 16 08:39:48.987183429 (183h14m10.946280661s) [upload=190753]: Uploading segments... Aug 16 08:39:48.987259075 (183h14m10.94635632s) [upload=190753]: Got next segment. Inline: true Aug 16 08:39:48.987275918 (183h14m10.946373166s) [upload=190753]: Waiting for error group managing segments... Aug 16 08:39:48.987315024 (183h14m10.946412269s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:39:48.987318995 (183h14m10.946416241s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:39:48.987321784 (183h14m10.946419028s) [upload=190753]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:39:49.075021115 (183h14m11.034118361s) [upload=190753]: Done uploading segments... Aug 16 08:39:49.075039913 (183h14m11.034137148s) [upload=190753]: Upload finished. err: metaclient: Too Many Requests
Duration: 358.001887ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X..................X.................] duration:
2.54757304s
FAIL (2025-08-16 08:39:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 08:25:10.435543520 (182h59m32.394640765s) [upload=190500]: Starting upload
Aug 16 08:25:10.435617686 (182h59m32.394714935s) [upload=190500]: Done starting upload
Aug 16 08:25:10.435777771 (182h59m32.394875022s) [upload=190500]: Uploading segments...
Aug 16 08:25:10.435954869 (182h59m32.395052104s) [upload=190500]: Got next segment. Inline: false
Aug 16 08:25:10.435999461 (182h59m32.395096699s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 08:25:10.436004620 (182h59m32.395101857s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 08:25:10.667953820 (182h59m32.627051074s) [seg_pos={0 0}, upload=190500]: Begin upload segment...
Aug 16 08:25:10.668028328 (182h59m32.627125578s) [seg_pos={0 0}, upload=190500]: Done begin upload segment.
Aug 16 08:25:10.668083090 (182h59m32.627180344s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668090498 (182h59m32.627187754s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668754640 (182h59m32.627851895s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668792951 (182h59m32.627890215s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669266238 (182h59m32.628363493s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669708034 (182h59m32.628805289s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670160480 (182h59m32.629257735s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670256384 (182h59m32.629353647s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670650921 (182h59m32.629748176s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671013991 (182h59m32.630111246s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671415786 (182h59m32.630513042s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671845165 (182h59m32.630942421s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672118656 (182h59m32.631215911s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672507638 (182h59m32.631604892s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672823166 (182h59m32.63192042s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673211587 (182h59m32.632308934s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673425745 (182h59m32.632523002s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673786523 (182h59m32.632883762s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:11.232176093 (182h59m33.191273339s) [upload=190500]: Next returned nil segment
Aug 16 08:25:11.232200906 (182h59m33.19129816s) [upload=190500]: Waiting for error group managing segments...
Aug 16 08:25:11.368269277 (182h59m33.327366524s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.372753538 (182h59m33.331850795s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.386286989 (182h59m33.345384228s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.390430352 (182h59m33.349527606s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.394419607 (182h59m33.353516843s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.403417833 (182h59m33.362515082s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.415680776 (182h59m33.374778031s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.425538202 (182h59m33.384635447s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.429380836 (182h59m33.388478074s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.451830778 (182h59m33.410928052s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.474060851 (182h59m33.433158103s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.487412242 (182h59m33.446509473s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.502903342 (182h59m33.462000591s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505569355 (182h59m33.464666586s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505621932 (182h59m33.464719181s) [seg_pos={0 0}, upload=190500]: Segment reached optimal threshold of 14 pieces.
Aug 16 08:25:11.505929835 (182h59m33.465027085s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M5ger8kngGvMCD9c2qBxpFNCpLxka2fh8iWrf2XerxRiQEUja): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506046012 (182h59m33.465143284s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection
Aug 16 08:25:11.506072204 (182h59m33.465169454s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506147263 (182h59m33.465244499s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506176779 (182h59m33.465274034s) [seg_pos={0 0}, upload=190500]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 08:25:11.506273070 (182h59m33.465370302s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 08:25:11.506279562 (182h59m33.465376809s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 08:25:11.653588056 (182h59m33.612685301s) [upload=190500]: Done uploading segments...
Aug 16 08:25:11.653608757 (182h59m33.612706002s) [upload=190500]: Upload finished. err: <nil>
Duration: 2.547604533s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X.............X.......] duration:
808.194164ms
FAIL (2025-08-16 08:38:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:33:31.538829414 (183h7m53.497926664s) [upload=190650]: Starting upload Aug 16 08:33:31.538919329 (183h7m53.498016576s) [upload=190650]: Done starting upload Aug 16 08:33:31.539018547 (183h7m53.498115784s) [upload=190650]: Uploading segments... Aug 16 08:33:31.539092808 (183h7m53.498190062s) [upload=190650]: Got next segment. Inline: true Aug 16 08:33:31.539098720 (183h7m53.498195966s) [upload=190650]: Waiting for error group managing segments... Aug 16 08:33:31.539155423 (183h7m53.498252672s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:33:31.539161082 (183h7m53.498258327s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:33:31.539165032 (183h7m53.498262277s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:33:31.666274621 (183h7m53.625371876s) [upload=190650]: Done uploading segments... Aug 16 08:33:31.666298490 (183h7m53.625395748s) [upload=190650]: Upload finished. err: metaclient: Too Many Requests
Duration: 808.323781ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X..................X................] duration:
2.62389589s
FAIL (2025-08-16 08:38:21 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 08:25:10.435543520 (182h59m32.394640765s) [upload=190500]: Starting upload
Aug 16 08:25:10.435617686 (182h59m32.394714935s) [upload=190500]: Done starting upload
Aug 16 08:25:10.435777771 (182h59m32.394875022s) [upload=190500]: Uploading segments...
Aug 16 08:25:10.435954869 (182h59m32.395052104s) [upload=190500]: Got next segment. Inline: false
Aug 16 08:25:10.435999461 (182h59m32.395096699s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 08:25:10.436004620 (182h59m32.395101857s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 08:25:10.667953820 (182h59m32.627051074s) [seg_pos={0 0}, upload=190500]: Begin upload segment...
Aug 16 08:25:10.668028328 (182h59m32.627125578s) [seg_pos={0 0}, upload=190500]: Done begin upload segment.
Aug 16 08:25:10.668083090 (182h59m32.627180344s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668090498 (182h59m32.627187754s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668754640 (182h59m32.627851895s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668792951 (182h59m32.627890215s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669266238 (182h59m32.628363493s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669708034 (182h59m32.628805289s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670160480 (182h59m32.629257735s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670256384 (182h59m32.629353647s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670650921 (182h59m32.629748176s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671013991 (182h59m32.630111246s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671415786 (182h59m32.630513042s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671845165 (182h59m32.630942421s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672118656 (182h59m32.631215911s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672507638 (182h59m32.631604892s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672823166 (182h59m32.63192042s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673211587 (182h59m32.632308934s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673425745 (182h59m32.632523002s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673786523 (182h59m32.632883762s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:11.232176093 (182h59m33.191273339s) [upload=190500]: Next returned nil segment
Aug 16 08:25:11.232200906 (182h59m33.19129816s) [upload=190500]: Waiting for error group managing segments...
Aug 16 08:25:11.368269277 (182h59m33.327366524s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.372753538 (182h59m33.331850795s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.386286989 (182h59m33.345384228s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.390430352 (182h59m33.349527606s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.394419607 (182h59m33.353516843s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.403417833 (182h59m33.362515082s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.415680776 (182h59m33.374778031s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.425538202 (182h59m33.384635447s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.429380836 (182h59m33.388478074s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.451830778 (182h59m33.410928052s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.474060851 (182h59m33.433158103s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.487412242 (182h59m33.446509473s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.502903342 (182h59m33.462000591s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505569355 (182h59m33.464666586s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505621932 (182h59m33.464719181s) [seg_pos={0 0}, upload=190500]: Segment reached optimal threshold of 14 pieces.
Aug 16 08:25:11.505929835 (182h59m33.465027085s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M5ger8kngGvMCD9c2qBxpFNCpLxka2fh8iWrf2XerxRiQEUja): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506046012 (182h59m33.465143284s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection
Aug 16 08:25:11.506072204 (182h59m33.465169454s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506147263 (182h59m33.465244499s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506176779 (182h59m33.465274034s) [seg_pos={0 0}, upload=190500]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 08:25:11.506273070 (182h59m33.465370302s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 08:25:11.506279562 (182h59m33.465376809s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 08:25:11.653588056 (182h59m33.612685301s) [upload=190500]: Done uploading segments...
Aug 16 08:25:11.653608757 (182h59m33.612706002s) [upload=190500]: Upload finished. err: <nil>
Duration: 2.623928679s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X.............X......] duration:
886.773922ms
FAIL (2025-08-16 08:38:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:33:31.538829414 (183h7m53.497926664s) [upload=190650]: Starting upload Aug 16 08:33:31.538919329 (183h7m53.498016576s) [upload=190650]: Done starting upload Aug 16 08:33:31.539018547 (183h7m53.498115784s) [upload=190650]: Uploading segments... Aug 16 08:33:31.539092808 (183h7m53.498190062s) [upload=190650]: Got next segment. Inline: true Aug 16 08:33:31.539098720 (183h7m53.498195966s) [upload=190650]: Waiting for error group managing segments... Aug 16 08:33:31.539155423 (183h7m53.498252672s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:33:31.539161082 (183h7m53.498258327s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:33:31.539165032 (183h7m53.498262277s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:33:31.666274621 (183h7m53.625371876s) [upload=190650]: Done uploading segments... Aug 16 08:33:31.666298490 (183h7m53.625395748s) [upload=190650]: Upload finished. err: metaclient: Too Many Requests
Duration: 887.041513ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.......................................X.............X.....] duration:
812.967707ms
FAIL (2025-08-16 08:37:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:33:31.538829414 (183h7m53.497926664s) [upload=190650]: Starting upload Aug 16 08:33:31.538919329 (183h7m53.498016576s) [upload=190650]: Done starting upload Aug 16 08:33:31.539018547 (183h7m53.498115784s) [upload=190650]: Uploading segments... Aug 16 08:33:31.539092808 (183h7m53.498190062s) [upload=190650]: Got next segment. Inline: true Aug 16 08:33:31.539098720 (183h7m53.498195966s) [upload=190650]: Waiting for error group managing segments... Aug 16 08:33:31.539155423 (183h7m53.498252672s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:33:31.539161082 (183h7m53.498258327s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:33:31.539165032 (183h7m53.498262277s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:33:31.666274621 (183h7m53.625371876s) [upload=190650]: Done uploading segments... Aug 16 08:33:31.666298490 (183h7m53.625395748s) [upload=190650]: Upload finished. err: metaclient: Too Many Requests
Duration: 812.999654ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X........................X..................X...............] duration:
2.443848945s
FAIL (2025-08-16 08:37:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 08:25:10.435543520 (182h59m32.394640765s) [upload=190500]: Starting upload
Aug 16 08:25:10.435617686 (182h59m32.394714935s) [upload=190500]: Done starting upload
Aug 16 08:25:10.435777771 (182h59m32.394875022s) [upload=190500]: Uploading segments...
Aug 16 08:25:10.435954869 (182h59m32.395052104s) [upload=190500]: Got next segment. Inline: false
Aug 16 08:25:10.435999461 (182h59m32.395096699s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 08:25:10.436004620 (182h59m32.395101857s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 08:25:10.667953820 (182h59m32.627051074s) [seg_pos={0 0}, upload=190500]: Begin upload segment...
Aug 16 08:25:10.668028328 (182h59m32.627125578s) [seg_pos={0 0}, upload=190500]: Done begin upload segment.
Aug 16 08:25:10.668083090 (182h59m32.627180344s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668090498 (182h59m32.627187754s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668754640 (182h59m32.627851895s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668792951 (182h59m32.627890215s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669266238 (182h59m32.628363493s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669708034 (182h59m32.628805289s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670160480 (182h59m32.629257735s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670256384 (182h59m32.629353647s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670650921 (182h59m32.629748176s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671013991 (182h59m32.630111246s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671415786 (182h59m32.630513042s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671845165 (182h59m32.630942421s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672118656 (182h59m32.631215911s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672507638 (182h59m32.631604892s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672823166 (182h59m32.63192042s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673211587 (182h59m32.632308934s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673425745 (182h59m32.632523002s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673786523 (182h59m32.632883762s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:11.232176093 (182h59m33.191273339s) [upload=190500]: Next returned nil segment
Aug 16 08:25:11.232200906 (182h59m33.19129816s) [upload=190500]: Waiting for error group managing segments...
Aug 16 08:25:11.368269277 (182h59m33.327366524s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.372753538 (182h59m33.331850795s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.386286989 (182h59m33.345384228s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.390430352 (182h59m33.349527606s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.394419607 (182h59m33.353516843s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.403417833 (182h59m33.362515082s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.415680776 (182h59m33.374778031s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.425538202 (182h59m33.384635447s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.429380836 (182h59m33.388478074s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.451830778 (182h59m33.410928052s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.474060851 (182h59m33.433158103s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.487412242 (182h59m33.446509473s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.502903342 (182h59m33.462000591s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505569355 (182h59m33.464666586s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505621932 (182h59m33.464719181s) [seg_pos={0 0}, upload=190500]: Segment reached optimal threshold of 14 pieces.
Aug 16 08:25:11.505929835 (182h59m33.465027085s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M5ger8kngGvMCD9c2qBxpFNCpLxka2fh8iWrf2XerxRiQEUja): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506046012 (182h59m33.465143284s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection
Aug 16 08:25:11.506072204 (182h59m33.465169454s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506147263 (182h59m33.465244499s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506176779 (182h59m33.465274034s) [seg_pos={0 0}, upload=190500]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 08:25:11.506273070 (182h59m33.465370302s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 08:25:11.506279562 (182h59m33.465376809s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 08:25:11.653588056 (182h59m33.612685301s) [upload=190500]: Done uploading segments...
Aug 16 08:25:11.653608757 (182h59m33.612706002s) [upload=190500]: Upload finished. err: <nil>
Duration: 2.443937109s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X.......................................X.............X....] duration:
1.759250385s
FAIL (2025-08-16 08:36:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:33:31.538829414 (183h7m53.497926664s) [upload=190650]: Starting upload Aug 16 08:33:31.538919329 (183h7m53.498016576s) [upload=190650]: Done starting upload Aug 16 08:33:31.539018547 (183h7m53.498115784s) [upload=190650]: Uploading segments... Aug 16 08:33:31.539092808 (183h7m53.498190062s) [upload=190650]: Got next segment. Inline: true Aug 16 08:33:31.539098720 (183h7m53.498195966s) [upload=190650]: Waiting for error group managing segments... Aug 16 08:33:31.539155423 (183h7m53.498252672s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:33:31.539161082 (183h7m53.498258327s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:33:31.539165032 (183h7m53.498262277s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:33:31.666274621 (183h7m53.625371876s) [upload=190650]: Done uploading segments... Aug 16 08:33:31.666298490 (183h7m53.625395748s) [upload=190650]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.759281032s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X........................X..................X..............] duration:
2.378513841s
FAIL (2025-08-16 08:36:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 08:25:10.435543520 (182h59m32.394640765s) [upload=190500]: Starting upload
Aug 16 08:25:10.435617686 (182h59m32.394714935s) [upload=190500]: Done starting upload
Aug 16 08:25:10.435777771 (182h59m32.394875022s) [upload=190500]: Uploading segments...
Aug 16 08:25:10.435954869 (182h59m32.395052104s) [upload=190500]: Got next segment. Inline: false
Aug 16 08:25:10.435999461 (182h59m32.395096699s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 08:25:10.436004620 (182h59m32.395101857s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 08:25:10.667953820 (182h59m32.627051074s) [seg_pos={0 0}, upload=190500]: Begin upload segment...
Aug 16 08:25:10.668028328 (182h59m32.627125578s) [seg_pos={0 0}, upload=190500]: Done begin upload segment.
Aug 16 08:25:10.668083090 (182h59m32.627180344s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668090498 (182h59m32.627187754s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668754640 (182h59m32.627851895s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668792951 (182h59m32.627890215s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669266238 (182h59m32.628363493s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669708034 (182h59m32.628805289s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670160480 (182h59m32.629257735s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670256384 (182h59m32.629353647s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670650921 (182h59m32.629748176s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671013991 (182h59m32.630111246s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671415786 (182h59m32.630513042s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671845165 (182h59m32.630942421s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672118656 (182h59m32.631215911s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672507638 (182h59m32.631604892s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672823166 (182h59m32.63192042s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673211587 (182h59m32.632308934s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673425745 (182h59m32.632523002s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673786523 (182h59m32.632883762s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:11.232176093 (182h59m33.191273339s) [upload=190500]: Next returned nil segment
Aug 16 08:25:11.232200906 (182h59m33.19129816s) [upload=190500]: Waiting for error group managing segments...
Aug 16 08:25:11.368269277 (182h59m33.327366524s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.372753538 (182h59m33.331850795s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.386286989 (182h59m33.345384228s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.390430352 (182h59m33.349527606s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.394419607 (182h59m33.353516843s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.403417833 (182h59m33.362515082s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.415680776 (182h59m33.374778031s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.425538202 (182h59m33.384635447s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.429380836 (182h59m33.388478074s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.451830778 (182h59m33.410928052s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.474060851 (182h59m33.433158103s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.487412242 (182h59m33.446509473s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.502903342 (182h59m33.462000591s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505569355 (182h59m33.464666586s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505621932 (182h59m33.464719181s) [seg_pos={0 0}, upload=190500]: Segment reached optimal threshold of 14 pieces.
Aug 16 08:25:11.505929835 (182h59m33.465027085s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M5ger8kngGvMCD9c2qBxpFNCpLxka2fh8iWrf2XerxRiQEUja): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506046012 (182h59m33.465143284s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection
Aug 16 08:25:11.506072204 (182h59m33.465169454s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506147263 (182h59m33.465244499s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506176779 (182h59m33.465274034s) [seg_pos={0 0}, upload=190500]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 08:25:11.506273070 (182h59m33.465370302s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 08:25:11.506279562 (182h59m33.465376809s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 08:25:11.653588056 (182h59m33.612685301s) [upload=190500]: Done uploading segments...
Aug 16 08:25:11.653608757 (182h59m33.612706002s) [upload=190500]: Upload finished. err: <nil>
Duration: 2.378573932s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X........................X..................X.............] duration:
2.33286176s
FAIL (2025-08-16 08:35:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 08:25:10.435543520 (182h59m32.394640765s) [upload=190500]: Starting upload
Aug 16 08:25:10.435617686 (182h59m32.394714935s) [upload=190500]: Done starting upload
Aug 16 08:25:10.435777771 (182h59m32.394875022s) [upload=190500]: Uploading segments...
Aug 16 08:25:10.435954869 (182h59m32.395052104s) [upload=190500]: Got next segment. Inline: false
Aug 16 08:25:10.435999461 (182h59m32.395096699s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 08:25:10.436004620 (182h59m32.395101857s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 08:25:10.667953820 (182h59m32.627051074s) [seg_pos={0 0}, upload=190500]: Begin upload segment...
Aug 16 08:25:10.668028328 (182h59m32.627125578s) [seg_pos={0 0}, upload=190500]: Done begin upload segment.
Aug 16 08:25:10.668083090 (182h59m32.627180344s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668090498 (182h59m32.627187754s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668754640 (182h59m32.627851895s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668792951 (182h59m32.627890215s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669266238 (182h59m32.628363493s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669708034 (182h59m32.628805289s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670160480 (182h59m32.629257735s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670256384 (182h59m32.629353647s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670650921 (182h59m32.629748176s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671013991 (182h59m32.630111246s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671415786 (182h59m32.630513042s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671845165 (182h59m32.630942421s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672118656 (182h59m32.631215911s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672507638 (182h59m32.631604892s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672823166 (182h59m32.63192042s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673211587 (182h59m32.632308934s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673425745 (182h59m32.632523002s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673786523 (182h59m32.632883762s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:11.232176093 (182h59m33.191273339s) [upload=190500]: Next returned nil segment
Aug 16 08:25:11.232200906 (182h59m33.19129816s) [upload=190500]: Waiting for error group managing segments...
Aug 16 08:25:11.368269277 (182h59m33.327366524s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.372753538 (182h59m33.331850795s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.386286989 (182h59m33.345384228s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.390430352 (182h59m33.349527606s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.394419607 (182h59m33.353516843s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.403417833 (182h59m33.362515082s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.415680776 (182h59m33.374778031s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.425538202 (182h59m33.384635447s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.429380836 (182h59m33.388478074s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.451830778 (182h59m33.410928052s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.474060851 (182h59m33.433158103s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.487412242 (182h59m33.446509473s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.502903342 (182h59m33.462000591s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505569355 (182h59m33.464666586s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505621932 (182h59m33.464719181s) [seg_pos={0 0}, upload=190500]: Segment reached optimal threshold of 14 pieces.
Aug 16 08:25:11.505929835 (182h59m33.465027085s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M5ger8kngGvMCD9c2qBxpFNCpLxka2fh8iWrf2XerxRiQEUja): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506046012 (182h59m33.465143284s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection
Aug 16 08:25:11.506072204 (182h59m33.465169454s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506147263 (182h59m33.465244499s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506176779 (182h59m33.465274034s) [seg_pos={0 0}, upload=190500]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 08:25:11.506273070 (182h59m33.465370302s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 08:25:11.506279562 (182h59m33.465376809s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 08:25:11.653588056 (182h59m33.612685301s) [upload=190500]: Done uploading segments...
Aug 16 08:25:11.653608757 (182h59m33.612706002s) [upload=190500]: Upload finished. err: <nil>
Duration: 2.332905552s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X.......................................X.............X...] duration:
870.02131ms
FAIL (2025-08-16 08:35:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:33:31.538829414 (183h7m53.497926664s) [upload=190650]: Starting upload Aug 16 08:33:31.538919329 (183h7m53.498016576s) [upload=190650]: Done starting upload Aug 16 08:33:31.539018547 (183h7m53.498115784s) [upload=190650]: Uploading segments... Aug 16 08:33:31.539092808 (183h7m53.498190062s) [upload=190650]: Got next segment. Inline: true Aug 16 08:33:31.539098720 (183h7m53.498195966s) [upload=190650]: Waiting for error group managing segments... Aug 16 08:33:31.539155423 (183h7m53.498252672s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:33:31.539161082 (183h7m53.498258327s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:33:31.539165032 (183h7m53.498262277s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:33:31.666274621 (183h7m53.625371876s) [upload=190650]: Done uploading segments... Aug 16 08:33:31.666298490 (183h7m53.625395748s) [upload=190650]: Upload finished. err: metaclient: Too Many Requests
Duration: 870.067151ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X........................X..................X............] duration:
2.472650405s
FAIL (2025-08-16 08:35:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 16 08:25:10.435543520 (182h59m32.394640765s) [upload=190500]: Starting upload
Aug 16 08:25:10.435617686 (182h59m32.394714935s) [upload=190500]: Done starting upload
Aug 16 08:25:10.435777771 (182h59m32.394875022s) [upload=190500]: Uploading segments...
Aug 16 08:25:10.435954869 (182h59m32.395052104s) [upload=190500]: Got next segment. Inline: false
Aug 16 08:25:10.435999461 (182h59m32.395096699s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 08:25:10.436004620 (182h59m32.395101857s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 08:25:10.667953820 (182h59m32.627051074s) [seg_pos={0 0}, upload=190500]: Begin upload segment...
Aug 16 08:25:10.668028328 (182h59m32.627125578s) [seg_pos={0 0}, upload=190500]: Done begin upload segment.
Aug 16 08:25:10.668083090 (182h59m32.627180344s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668090498 (182h59m32.627187754s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668754640 (182h59m32.627851895s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.668792951 (182h59m32.627890215s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669266238 (182h59m32.628363493s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.669708034 (182h59m32.628805289s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670160480 (182h59m32.629257735s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670256384 (182h59m32.629353647s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.670650921 (182h59m32.629748176s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671013991 (182h59m32.630111246s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671415786 (182h59m32.630513042s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.671845165 (182h59m32.630942421s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672118656 (182h59m32.631215911s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672507638 (182h59m32.631604892s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.672823166 (182h59m32.63192042s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673211587 (182h59m32.632308934s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673425745 (182h59m32.632523002s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:10.673786523 (182h59m32.632883762s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Uploading piece...
Aug 16 08:25:11.232176093 (182h59m33.191273339s) [upload=190500]: Next returned nil segment
Aug 16 08:25:11.232200906 (182h59m33.19129816s) [upload=190500]: Waiting for error group managing segments...
Aug 16 08:25:11.368269277 (182h59m33.327366524s) [noise=true , address=45.91.116.12:4236 , piece_id=SQSF55EYLFHOTJDNQNKGUOWOHI22XC7KQ2HFAZ2PN7NLP7UMNJHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.372753538 (182h59m33.331850795s) [noise=true , address=77.90.31.18:4816 , piece_id=RADFLOSANMN3G37QQ2RQSL3KV6O4EXOB3UIRLRDTKPSI5UM4QIZQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.386286989 (182h59m33.345384228s) [noise=true , address=77.90.31.15:4724 , piece_id=2AJZMRGIDMMFOLUCP7UL6EFZZXIGKT7A2ARQVVAATMTG4ERP5KCA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.390430352 (182h59m33.349527606s) [noise=true , address=45.91.116.11:4131 , piece_id=JOZXM3EN4PD6RE5I22V22W47QHWF3RJ4SME5BFFNFKAHKW5FL4DA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.394419607 (182h59m33.353516843s) [noise=true , address=45.91.116.7:4014 , piece_id=XQRFTIS2RBDJVNVRQJFSVDKCSISMPNCFNDNF5U5DQTBDOLH2AYGQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.403417833 (182h59m33.362515082s) [noise=true , address=104.36.82.4:4815 , piece_id=XCUXZLT7X7OVSWSJEQYIGQY7CE6DPJIAY5JHOM5XTI5DI54B3SOA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.415680776 (182h59m33.374778031s) [noise=true , address=104.36.82.23:4468 , piece_id=NSCV3USHLKOJB6B6ASAVMBGVY4ODABJU64JLMESUYPQO44UXQ6YQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.425538202 (182h59m33.384635447s) [noise=true , address=104.36.82.60:4348 , piece_id=7FUX2ZXCM7U6L3RNH2A6U7CRWRFQJ2SNYXFDZSPPEPNTWYG2SLFQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.429380836 (182h59m33.388478074s) [noise=true , address=79.127.219.48:4105 , piece_id=SUAWSRJXMSOWQDELG53J7LUUWTLCI7YXPKCGIG4V3VRHSV62MDEQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.451830778 (182h59m33.410928052s) [noise=true , address=104.36.82.38:4723 , piece_id=TOABXVEEM77JU7N6IAZP5QPBYB7QIQFLQL7UF3Z6HEFP5XKQJ4CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.474060851 (182h59m33.433158103s) [noise=true , address=104.36.82.58:4292 , piece_id=YCWYO5M6RHSC6XIGWSRBSB3LM7PVB4CMFZWXBBZZT64CUN3LF4GA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.487412242 (182h59m33.446509473s) [noise=true , address=104.36.82.59:4316 , piece_id=LQYYNYQCXMVFTKPIRGJWITEB2LEVVVFEEAFAYKP6TOTAZTUMOHHQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.502903342 (182h59m33.462000591s) [noise=true , address=104.36.82.5:4857 , piece_id=WV7L53MWVGYR7OHL6UPWXF76TOQHF4RDVV5EBMFDBUWDUYK6LSXA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505569355 (182h59m33.464666586s) [noise=true , address=104.36.82.34:4562 , piece_id=4WRQI2G5ASMQWH7C4L2JMHQMZSBJH3FXJTUHBLL6R32JPA7GIMDQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: <nil>
Aug 16 08:25:11.505621932 (182h59m33.464719181s) [seg_pos={0 0}, upload=190500]: Segment reached optimal threshold of 14 pieces.
Aug 16 08:25:11.505929835 (182h59m33.465027085s) [noise=true , address=77.90.31.10:4537 , piece_id=S4TMCKHHMOBOWI4NBLD27MJIXZID2H6NGCK3HO4D4EGKVYNYAAKQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M5ger8kngGvMCD9c2qBxpFNCpLxka2fh8iWrf2XerxRiQEUja): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506046012 (182h59m33.465143284s) [noise=true , address=66.23.193.175:4564 , piece_id=YPP3FB7OWUNEHVZULPZGDTDITEFFVVZV42O6RPOLQ7U2WFG2MU5Q, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46216->66.23.193.175:4564: use of closed network connection
Aug 16 08:25:11.506072204 (182h59m33.465169454s) [noise=true , address=77.90.31.21:4887 , piece_id=GBWJNF27JPKQPZZOXC7ZTKVIYT77VPCA4IJDCPATJUISIXHRJBFA, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hE2JH2wY7TepnbCVpSxkTcVifqui3QK42tLh1neU2BxZ2BRFJ): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506147263 (182h59m33.465244499s) [noise=true , address=79.127.201.215:4356 , piece_id=PO4O3YAWNHUVMCW6LCLIE43K7AXYYJ4HXI54R76NDHTU25BJI5CQ, seg_pos={0 0}, upload=190500]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 16 08:25:11.506176779 (182h59m33.465274034s) [seg_pos={0 0}, upload=190500]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 08:25:11.506273070 (182h59m33.465370302s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 08:25:11.506279562 (182h59m33.465376809s) [upload=190500]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 08:25:11.653588056 (182h59m33.612685301s) [upload=190500]: Done uploading segments...
Aug 16 08:25:11.653608757 (182h59m33.612706002s) [upload=190500]: Upload finished. err: <nil>
Duration: 2.47268389s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X.......................................X.............X..] duration:
967.44667ms
FAIL (2025-08-16 08:35:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:33:31.538829414 (183h7m53.497926664s) [upload=190650]: Starting upload Aug 16 08:33:31.538919329 (183h7m53.498016576s) [upload=190650]: Done starting upload Aug 16 08:33:31.539018547 (183h7m53.498115784s) [upload=190650]: Uploading segments... Aug 16 08:33:31.539092808 (183h7m53.498190062s) [upload=190650]: Got next segment. Inline: true Aug 16 08:33:31.539098720 (183h7m53.498195966s) [upload=190650]: Waiting for error group managing segments... Aug 16 08:33:31.539155423 (183h7m53.498252672s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:33:31.539161082 (183h7m53.498258327s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:33:31.539165032 (183h7m53.498262277s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:33:31.666274621 (183h7m53.625371876s) [upload=190650]: Done uploading segments... Aug 16 08:33:31.666298490 (183h7m53.625395748s) [upload=190650]: Upload finished. err: metaclient: Too Many Requests
Duration: 967.500469ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X.......................................X.............X.] duration:
820.114483ms
FAIL (2025-08-16 08:34:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 08:33:31.538829414 (183h7m53.497926664s) [upload=190650]: Starting upload Aug 16 08:33:31.538919329 (183h7m53.498016576s) [upload=190650]: Done starting upload Aug 16 08:33:31.539018547 (183h7m53.498115784s) [upload=190650]: Uploading segments... Aug 16 08:33:31.539092808 (183h7m53.498190062s) [upload=190650]: Got next segment. Inline: true Aug 16 08:33:31.539098720 (183h7m53.498195966s) [upload=190650]: Waiting for error group managing segments... Aug 16 08:33:31.539155423 (183h7m53.498252672s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 08:33:31.539161082 (183h7m53.498258327s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 08:33:31.539165032 (183h7m53.498262277s) [upload=190650]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 08:33:31.666274621 (183h7m53.625371876s) [upload=190650]: Done uploading segments... Aug 16 08:33:31.666298490 (183h7m53.625395748s) [upload=190650]: Upload finished. err: metaclient: Too Many Requests
Duration: 820.146962ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|