Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X...............................X.....X............] duration:
2.423607205s
FAIL (2025-08-13 02:50:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.423661933s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X.X........................X...........................] duration:
883.617298ms
FAIL (2025-08-13 02:50:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 883.651084ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X.X........................X..........................] duration:
838.111849ms
FAIL (2025-08-13 02:49:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 838.141601ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.X........................X.........................] duration:
855.430178ms
FAIL (2025-08-13 02:49:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 855.488002ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X...............................X.....X...........] duration:
2.374339556s
FAIL (2025-08-13 02:49:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.37437182s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X...............................X.....X..........] duration:
2.377311024s
FAIL (2025-08-13 02:48:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.377352215s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X.X........................X........................] duration:
839.877439ms
FAIL (2025-08-13 02:48:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 839.928146ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X.X........................X.......................] duration:
841.488064ms
FAIL (2025-08-13 02:47:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 841.522876ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X...............................X.....X.........] duration:
2.440698866s
FAIL (2025-08-13 02:47:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.440734728s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X...............................X.....X........] duration:
2.520666083s
FAIL (2025-08-13 02:47:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.520702684s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X...............................X.....X.......] duration:
2.429508082s
FAIL (2025-08-13 02:46:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.429605386s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X.X........................X......................] duration:
818.290213ms
FAIL (2025-08-13 02:46:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 818.333604ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X..........X.X........................X.....................] duration:
862.844731ms
FAIL (2025-08-13 02:45:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 862.997647ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X...............................X.....X......] duration:
2.418081202s
FAIL (2025-08-13 02:45:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.418114124s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X...............................X.....X.....] duration:
2.314594953s
FAIL (2025-08-13 02:44:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.314633983s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X..........X.X........................X....................] duration:
866.593194ms
FAIL (2025-08-13 02:44:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 866.684416ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X...............................X.....X....] duration:
2.290239432s
FAIL (2025-08-13 02:43:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.290288469s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X.................X...............................X.....X...] duration:
2.731782131s
FAIL (2025-08-13 02:43:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.731806469s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X..........X.X........................X...................] duration:
851.920591ms
FAIL (2025-08-13 02:43:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 851.951406ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X..........X.X........................X..................] duration:
845.27552ms
FAIL (2025-08-13 02:42:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 845.357491ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X.................X...............................X.....X..] duration:
2.394800669s
FAIL (2025-08-13 02:42:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.394830008s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X..........X.X........................X.................] duration:
869.014076ms
FAIL (2025-08-13 02:42:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 869.064448ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X..........X.X........................X................] duration:
982.482075ms
FAIL (2025-08-13 02:41:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 982.534008ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X.................X...............................X.....X.] duration:
2.918659631s
FAIL (2025-08-13 02:41:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.918689892s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X..........X.X........................X...............] duration:
865.225234ms
FAIL (2025-08-13 02:41:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 865.255841ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X.................X...............................X.....X] duration:
367.751124ms
FAIL (2025-08-13 02:41:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:41:02.215456396 (105h15m24.174553636s) [upload=109681]: Starting upload Aug 13 02:41:02.215535588 (105h15m24.174632837s) [upload=109681]: Done starting upload Aug 13 02:41:02.215657936 (105h15m24.17475518s) [upload=109681]: Uploading segments... Aug 13 02:41:02.216103941 (105h15m24.175201192s) [upload=109681]: Got next segment. Inline: false Aug 13 02:41:02.216169774 (105h15m24.175267025s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:41:02.216176966 (105h15m24.175274216s) [upload=109681]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 02:41:02.305435596 (105h15m24.264532847s) [upload=109681]: Next segment err: metaclient: Too Many Requests Aug 13 02:41:02.305472497 (105h15m24.264569744s) [upload=109681]: Done uploading segments... Aug 13 02:41:02.305494484 (105h15m24.264591731s) [upload=109681]: Upload finished. err: metaclient: Too Many Requests
Duration: 367.779974ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X..........X.X........................X..............] duration:
837.418421ms
FAIL (2025-08-13 02:40:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 837.626797ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X.................X...............................X.....] duration:
2.395002561s
FAIL (2025-08-13 02:40:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:37:43.045141212 (105h12m5.004238457s) [upload=109623]: Starting upload
Aug 13 02:37:43.045209004 (105h12m5.00430625s) [upload=109623]: Done starting upload
Aug 13 02:37:43.045592332 (105h12m5.004689569s) [upload=109623]: Uploading segments...
Aug 13 02:37:43.045765576 (105h12m5.004862807s) [upload=109623]: Got next segment. Inline: false
Aug 13 02:37:43.045843893 (105h12m5.004941138s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:37:43.045848977 (105h12m5.004946225s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:37:43.249407489 (105h12m5.208504767s) [seg_pos={0 0}, upload=109623]: Begin upload segment...
Aug 13 02:37:43.249508176 (105h12m5.208605422s) [seg_pos={0 0}, upload=109623]: Done begin upload segment.
Aug 13 02:37:43.249558868 (105h12m5.208656122s) [noise=true , address=104.36.82.60:4352 , piece_id=YXNNFT6UWIRVYF733CYXEBH3WNUHDGNNUCRDRRKGASG75WTLZ4GA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.249581213 (105h12m5.208678463s) [noise=true , address=104.36.82.62:4415 , piece_id=7WW5YFZFZITDFVWV7OF4TB6TIFJ5RDC6A5YPNX5ITSZ6KACD5PGQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250004407 (105h12m5.209101655s) [noise=true , address=104.36.82.61:4385 , piece_id=FGXGGXMWAAM3Y4EQU7WVHFZ7WFYHF5YIZXH37UVRTHKU2OIKNIVQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250062209 (105h12m5.209159463s) [noise=true , address=104.36.82.35:4608 , piece_id=YDG7JREFZGLEHPS32SS7EDZZLHJC2W5RULTE77WGHEPGOOJKVU2A, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250387036 (105h12m5.209484292s) [noise=true , address=104.36.82.21:4485 , piece_id=PKDPGI6GBUKWWQYN72ZL73L3LSSDZ34XEL3J7BF25XLEFFWG4HSA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250433034 (105h12m5.209530284s) [noise=true , address=66.23.193.175:4554 , piece_id=WT54NLSVWWO5QJWQNS7SD6SLCGDZ5OZAXCG4G5LLV2WK6FYGU5ZA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250729142 (105h12m5.209826387s) [noise=true , address=104.36.82.45:4911 , piece_id=3P6IKHKTF2XFVDBC3TIOQKIZCKPQ3VU5EDLFYFG64YWYNEJB6LHA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250830518 (105h12m5.209927768s) [noise=true , address=104.36.82.17:4346 , piece_id=FOEKKW4ITSFIC4A3XBQXJYFGRRO2MIB3D27LRDRHOITRPZ2XUCSQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251067141 (105h12m5.210164396s) [noise=true , address=104.36.82.46:4500 , piece_id=TANHUS5AWS5LSMZYAWL6KIRPGRCNDBPX6NQRXC2LPJ5N3AVXFVUQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251219042 (105h12m5.210316289s) [noise=true , address=104.36.82.37:4657 , piece_id=FN5KYJYS7JJ3RM3AU6B27OUPIEM55ZZC56YCVAQ2UV5Z6L5FBSIQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251428739 (105h12m5.210525984s) [noise=true , address=104.36.82.59:4309 , piece_id=LIJQXOSQBGGM4BDQWJEN76YZDKCGAX5U26FLQX5MCEOLSZTBIWOQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251558033 (105h12m5.210655289s) [noise=true , address=104.36.82.39:4732 , piece_id=2WMMXUMHYT6IWWWYKGDYXSYKG5EE6ZP2EUM5C2KBFE24KHM6AL5Q, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251769169 (105h12m5.210866414s) [noise=true , address=104.36.82.22:4537 , piece_id=2Y3GSRJW5WQ7EGSELRBGDB3B57SC5ZJY55YY2EXXRLRHCGP4GQNA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251921470 (105h12m5.211018722s) [noise=true , address=104.36.82.38:4700 , piece_id=L3XK5IQLIMEL75EYBQF5FCG3LIYDW22NEQAP5HAY3Z2TNMAARJHA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.252145503 (105h12m5.211242744s) [noise=true , address=45.91.116.10:4106 , piece_id=IJHPYM35LQIERCEYLHOUB72YZZBQW2AXCE22ZW7J6RN47IBLHRUQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.252299468 (105h12m5.211396726s) [noise=true , address=104.36.82.58:4272 , piece_id=2SKRRVYHHHOYYK47NMKNCMJIWDN63JGQZDBSDYSSEAX4DJWNIYBQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.252677274 (105h12m5.211774531s) [noise=true , address=77.90.31.19:4853 , piece_id=UCWKNV7ZKNUI3X3MD2VUQ65XD2D2CDVT3Q4FQLQSNOEGDYI42J4A, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.253090788 (105h12m5.212188038s) [noise=true , address=104.36.82.59:4333 , piece_id=VA3FQFWYWWW5WOPUOEZ4HIBXS65X6LUQEX3WLOCD2TNKHI4ZLA5Q, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.817516938 (105h12m5.776614183s) [upload=109623]: Next returned nil segment
Aug 13 02:37:43.817535614 (105h12m5.77663286s) [upload=109623]: Waiting for error group managing segments...
Aug 13 02:37:43.969526543 (105h12m5.92862378s) [noise=true , address=104.36.82.38:4700 , piece_id=L3XK5IQLIMEL75EYBQF5FCG3LIYDW22NEQAP5HAY3Z2TNMAARJHA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.974564900 (105h12m5.933662146s) [noise=true , address=104.36.82.62:4415 , piece_id=7WW5YFZFZITDFVWV7OF4TB6TIFJ5RDC6A5YPNX5ITSZ6KACD5PGQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.983439494 (105h12m5.942536745s) [noise=true , address=104.36.82.21:4485 , piece_id=PKDPGI6GBUKWWQYN72ZL73L3LSSDZ34XEL3J7BF25XLEFFWG4HSA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.984379096 (105h12m5.943476333s) [noise=true , address=77.90.31.19:4853 , piece_id=UCWKNV7ZKNUI3X3MD2VUQ65XD2D2CDVT3Q4FQLQSNOEGDYI42J4A, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.988613848 (105h12m5.947711101s) [noise=true , address=104.36.82.35:4608 , piece_id=YDG7JREFZGLEHPS32SS7EDZZLHJC2W5RULTE77WGHEPGOOJKVU2A, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.989654585 (105h12m5.948751817s) [noise=true , address=45.91.116.10:4106 , piece_id=IJHPYM35LQIERCEYLHOUB72YZZBQW2AXCE22ZW7J6RN47IBLHRUQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.991406027 (105h12m5.950503264s) [noise=true , address=104.36.82.39:4732 , piece_id=2WMMXUMHYT6IWWWYKGDYXSYKG5EE6ZP2EUM5C2KBFE24KHM6AL5Q, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.997155302 (105h12m5.956252538s) [noise=true , address=104.36.82.22:4537 , piece_id=2Y3GSRJW5WQ7EGSELRBGDB3B57SC5ZJY55YY2EXXRLRHCGP4GQNA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.001475322 (105h12m5.960572556s) [noise=true , address=104.36.82.17:4346 , piece_id=FOEKKW4ITSFIC4A3XBQXJYFGRRO2MIB3D27LRDRHOITRPZ2XUCSQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.012184501 (105h12m5.971281733s) [noise=true , address=104.36.82.45:4911 , piece_id=3P6IKHKTF2XFVDBC3TIOQKIZCKPQ3VU5EDLFYFG64YWYNEJB6LHA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.012294199 (105h12m5.971391438s) [noise=true , address=104.36.82.37:4657 , piece_id=FN5KYJYS7JJ3RM3AU6B27OUPIEM55ZZC56YCVAQ2UV5Z6L5FBSIQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.012542304 (105h12m5.971639549s) [noise=true , address=104.36.82.61:4385 , piece_id=FGXGGXMWAAM3Y4EQU7WVHFZ7WFYHF5YIZXH37UVRTHKU2OIKNIVQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.017684196 (105h12m5.976781435s) [noise=true , address=104.36.82.46:4500 , piece_id=TANHUS5AWS5LSMZYAWL6KIRPGRCNDBPX6NQRXC2LPJ5N3AVXFVUQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.017952693 (105h12m5.977049939s) [noise=true , address=104.36.82.59:4333 , piece_id=VA3FQFWYWWW5WOPUOEZ4HIBXS65X6LUQEX3WLOCD2TNKHI4ZLA5Q, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.017978224 (105h12m5.977075471s) [seg_pos={0 0}, upload=109623]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:37:44.018215187 (105h12m5.977312425s) [noise=true , address=104.36.82.58:4272 , piece_id=2SKRRVYHHHOYYK47NMKNCMJIWDN63JGQZDBSDYSSEAX4DJWNIYBQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yY39UpswsTLoWz4353JykK35fg8KB4AJWPatKGFgqTt4gDMcR): protocol: expected piece hash; context canceled; EOF
Aug 13 02:37:44.018263588 (105h12m5.977360833s) [noise=true , address=104.36.82.60:4352 , piece_id=YXNNFT6UWIRVYF733CYXEBH3WNUHDGNNUCRDRRKGASG75WTLZ4GA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RtYD3H9egoiNUbXsxJMWetAHYqjKGtfnGyNLSn6tbugdHaLXi): protocol: expected piece hash; context canceled; EOF
Aug 13 02:37:44.018333417 (105h12m5.977430656s) [noise=true , address=104.36.82.59:4309 , piece_id=LIJQXOSQBGGM4BDQWJEN76YZDKCGAX5U26FLQX5MCEOLSZTBIWOQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 13 02:37:44.018365028 (105h12m5.977462273s) [noise=true , address=66.23.193.175:4554 , piece_id=WT54NLSVWWO5QJWQNS7SD6SLCGDZ5OZAXCG4G5LLV2WK6FYGU5ZA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CraGuuckkbKe5PDLUvwF5G2ATUbgdR5g192YjkZgmP3JpqgXi): protocol: write tcp 139.59.144.22:34282->66.23.193.175:4554: use of closed network connection; write tcp 139.59.144.22:34282->66.23.193.175:4554: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34282->66.23.193.175:4554: use of closed network connection
Aug 13 02:37:44.018381393 (105h12m5.977478638s) [seg_pos={0 0}, upload=109623]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:37:44.018456401 (105h12m5.977553646s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:37:44.018461747 (105h12m5.977558991s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:37:44.187725773 (105h12m6.146823028s) [upload=109623]: Done uploading segments...
Aug 13 02:37:44.187752389 (105h12m6.146849623s) [upload=109623]: Upload finished. err: <nil>
Duration: 2.395033063s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X..........X.X........................X.............] duration:
937.275762ms
FAIL (2025-08-13 02:40:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 937.336146ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X.................X...............................X....] duration:
2.45220538s
FAIL (2025-08-13 02:39:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:37:43.045141212 (105h12m5.004238457s) [upload=109623]: Starting upload
Aug 13 02:37:43.045209004 (105h12m5.00430625s) [upload=109623]: Done starting upload
Aug 13 02:37:43.045592332 (105h12m5.004689569s) [upload=109623]: Uploading segments...
Aug 13 02:37:43.045765576 (105h12m5.004862807s) [upload=109623]: Got next segment. Inline: false
Aug 13 02:37:43.045843893 (105h12m5.004941138s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:37:43.045848977 (105h12m5.004946225s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:37:43.249407489 (105h12m5.208504767s) [seg_pos={0 0}, upload=109623]: Begin upload segment...
Aug 13 02:37:43.249508176 (105h12m5.208605422s) [seg_pos={0 0}, upload=109623]: Done begin upload segment.
Aug 13 02:37:43.249558868 (105h12m5.208656122s) [noise=true , address=104.36.82.60:4352 , piece_id=YXNNFT6UWIRVYF733CYXEBH3WNUHDGNNUCRDRRKGASG75WTLZ4GA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.249581213 (105h12m5.208678463s) [noise=true , address=104.36.82.62:4415 , piece_id=7WW5YFZFZITDFVWV7OF4TB6TIFJ5RDC6A5YPNX5ITSZ6KACD5PGQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250004407 (105h12m5.209101655s) [noise=true , address=104.36.82.61:4385 , piece_id=FGXGGXMWAAM3Y4EQU7WVHFZ7WFYHF5YIZXH37UVRTHKU2OIKNIVQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250062209 (105h12m5.209159463s) [noise=true , address=104.36.82.35:4608 , piece_id=YDG7JREFZGLEHPS32SS7EDZZLHJC2W5RULTE77WGHEPGOOJKVU2A, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250387036 (105h12m5.209484292s) [noise=true , address=104.36.82.21:4485 , piece_id=PKDPGI6GBUKWWQYN72ZL73L3LSSDZ34XEL3J7BF25XLEFFWG4HSA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250433034 (105h12m5.209530284s) [noise=true , address=66.23.193.175:4554 , piece_id=WT54NLSVWWO5QJWQNS7SD6SLCGDZ5OZAXCG4G5LLV2WK6FYGU5ZA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250729142 (105h12m5.209826387s) [noise=true , address=104.36.82.45:4911 , piece_id=3P6IKHKTF2XFVDBC3TIOQKIZCKPQ3VU5EDLFYFG64YWYNEJB6LHA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250830518 (105h12m5.209927768s) [noise=true , address=104.36.82.17:4346 , piece_id=FOEKKW4ITSFIC4A3XBQXJYFGRRO2MIB3D27LRDRHOITRPZ2XUCSQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251067141 (105h12m5.210164396s) [noise=true , address=104.36.82.46:4500 , piece_id=TANHUS5AWS5LSMZYAWL6KIRPGRCNDBPX6NQRXC2LPJ5N3AVXFVUQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251219042 (105h12m5.210316289s) [noise=true , address=104.36.82.37:4657 , piece_id=FN5KYJYS7JJ3RM3AU6B27OUPIEM55ZZC56YCVAQ2UV5Z6L5FBSIQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251428739 (105h12m5.210525984s) [noise=true , address=104.36.82.59:4309 , piece_id=LIJQXOSQBGGM4BDQWJEN76YZDKCGAX5U26FLQX5MCEOLSZTBIWOQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251558033 (105h12m5.210655289s) [noise=true , address=104.36.82.39:4732 , piece_id=2WMMXUMHYT6IWWWYKGDYXSYKG5EE6ZP2EUM5C2KBFE24KHM6AL5Q, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251769169 (105h12m5.210866414s) [noise=true , address=104.36.82.22:4537 , piece_id=2Y3GSRJW5WQ7EGSELRBGDB3B57SC5ZJY55YY2EXXRLRHCGP4GQNA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251921470 (105h12m5.211018722s) [noise=true , address=104.36.82.38:4700 , piece_id=L3XK5IQLIMEL75EYBQF5FCG3LIYDW22NEQAP5HAY3Z2TNMAARJHA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.252145503 (105h12m5.211242744s) [noise=true , address=45.91.116.10:4106 , piece_id=IJHPYM35LQIERCEYLHOUB72YZZBQW2AXCE22ZW7J6RN47IBLHRUQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.252299468 (105h12m5.211396726s) [noise=true , address=104.36.82.58:4272 , piece_id=2SKRRVYHHHOYYK47NMKNCMJIWDN63JGQZDBSDYSSEAX4DJWNIYBQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.252677274 (105h12m5.211774531s) [noise=true , address=77.90.31.19:4853 , piece_id=UCWKNV7ZKNUI3X3MD2VUQ65XD2D2CDVT3Q4FQLQSNOEGDYI42J4A, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.253090788 (105h12m5.212188038s) [noise=true , address=104.36.82.59:4333 , piece_id=VA3FQFWYWWW5WOPUOEZ4HIBXS65X6LUQEX3WLOCD2TNKHI4ZLA5Q, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.817516938 (105h12m5.776614183s) [upload=109623]: Next returned nil segment
Aug 13 02:37:43.817535614 (105h12m5.77663286s) [upload=109623]: Waiting for error group managing segments...
Aug 13 02:37:43.969526543 (105h12m5.92862378s) [noise=true , address=104.36.82.38:4700 , piece_id=L3XK5IQLIMEL75EYBQF5FCG3LIYDW22NEQAP5HAY3Z2TNMAARJHA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.974564900 (105h12m5.933662146s) [noise=true , address=104.36.82.62:4415 , piece_id=7WW5YFZFZITDFVWV7OF4TB6TIFJ5RDC6A5YPNX5ITSZ6KACD5PGQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.983439494 (105h12m5.942536745s) [noise=true , address=104.36.82.21:4485 , piece_id=PKDPGI6GBUKWWQYN72ZL73L3LSSDZ34XEL3J7BF25XLEFFWG4HSA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.984379096 (105h12m5.943476333s) [noise=true , address=77.90.31.19:4853 , piece_id=UCWKNV7ZKNUI3X3MD2VUQ65XD2D2CDVT3Q4FQLQSNOEGDYI42J4A, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.988613848 (105h12m5.947711101s) [noise=true , address=104.36.82.35:4608 , piece_id=YDG7JREFZGLEHPS32SS7EDZZLHJC2W5RULTE77WGHEPGOOJKVU2A, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.989654585 (105h12m5.948751817s) [noise=true , address=45.91.116.10:4106 , piece_id=IJHPYM35LQIERCEYLHOUB72YZZBQW2AXCE22ZW7J6RN47IBLHRUQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.991406027 (105h12m5.950503264s) [noise=true , address=104.36.82.39:4732 , piece_id=2WMMXUMHYT6IWWWYKGDYXSYKG5EE6ZP2EUM5C2KBFE24KHM6AL5Q, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.997155302 (105h12m5.956252538s) [noise=true , address=104.36.82.22:4537 , piece_id=2Y3GSRJW5WQ7EGSELRBGDB3B57SC5ZJY55YY2EXXRLRHCGP4GQNA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.001475322 (105h12m5.960572556s) [noise=true , address=104.36.82.17:4346 , piece_id=FOEKKW4ITSFIC4A3XBQXJYFGRRO2MIB3D27LRDRHOITRPZ2XUCSQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.012184501 (105h12m5.971281733s) [noise=true , address=104.36.82.45:4911 , piece_id=3P6IKHKTF2XFVDBC3TIOQKIZCKPQ3VU5EDLFYFG64YWYNEJB6LHA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.012294199 (105h12m5.971391438s) [noise=true , address=104.36.82.37:4657 , piece_id=FN5KYJYS7JJ3RM3AU6B27OUPIEM55ZZC56YCVAQ2UV5Z6L5FBSIQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.012542304 (105h12m5.971639549s) [noise=true , address=104.36.82.61:4385 , piece_id=FGXGGXMWAAM3Y4EQU7WVHFZ7WFYHF5YIZXH37UVRTHKU2OIKNIVQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.017684196 (105h12m5.976781435s) [noise=true , address=104.36.82.46:4500 , piece_id=TANHUS5AWS5LSMZYAWL6KIRPGRCNDBPX6NQRXC2LPJ5N3AVXFVUQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.017952693 (105h12m5.977049939s) [noise=true , address=104.36.82.59:4333 , piece_id=VA3FQFWYWWW5WOPUOEZ4HIBXS65X6LUQEX3WLOCD2TNKHI4ZLA5Q, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.017978224 (105h12m5.977075471s) [seg_pos={0 0}, upload=109623]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:37:44.018215187 (105h12m5.977312425s) [noise=true , address=104.36.82.58:4272 , piece_id=2SKRRVYHHHOYYK47NMKNCMJIWDN63JGQZDBSDYSSEAX4DJWNIYBQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yY39UpswsTLoWz4353JykK35fg8KB4AJWPatKGFgqTt4gDMcR): protocol: expected piece hash; context canceled; EOF
Aug 13 02:37:44.018263588 (105h12m5.977360833s) [noise=true , address=104.36.82.60:4352 , piece_id=YXNNFT6UWIRVYF733CYXEBH3WNUHDGNNUCRDRRKGASG75WTLZ4GA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RtYD3H9egoiNUbXsxJMWetAHYqjKGtfnGyNLSn6tbugdHaLXi): protocol: expected piece hash; context canceled; EOF
Aug 13 02:37:44.018333417 (105h12m5.977430656s) [noise=true , address=104.36.82.59:4309 , piece_id=LIJQXOSQBGGM4BDQWJEN76YZDKCGAX5U26FLQX5MCEOLSZTBIWOQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 13 02:37:44.018365028 (105h12m5.977462273s) [noise=true , address=66.23.193.175:4554 , piece_id=WT54NLSVWWO5QJWQNS7SD6SLCGDZ5OZAXCG4G5LLV2WK6FYGU5ZA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CraGuuckkbKe5PDLUvwF5G2ATUbgdR5g192YjkZgmP3JpqgXi): protocol: write tcp 139.59.144.22:34282->66.23.193.175:4554: use of closed network connection; write tcp 139.59.144.22:34282->66.23.193.175:4554: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34282->66.23.193.175:4554: use of closed network connection
Aug 13 02:37:44.018381393 (105h12m5.977478638s) [seg_pos={0 0}, upload=109623]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:37:44.018456401 (105h12m5.977553646s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:37:44.018461747 (105h12m5.977558991s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:37:44.187725773 (105h12m6.146823028s) [upload=109623]: Done uploading segments...
Aug 13 02:37:44.187752389 (105h12m6.146849623s) [upload=109623]: Upload finished. err: <nil>
Duration: 2.452242363s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X..........X.X........................X............] duration:
868.60318ms
FAIL (2025-08-13 02:38:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 868.69353ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X.................X...............................X...] duration:
2.374515015s
FAIL (2025-08-13 02:38:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:37:43.045141212 (105h12m5.004238457s) [upload=109623]: Starting upload
Aug 13 02:37:43.045209004 (105h12m5.00430625s) [upload=109623]: Done starting upload
Aug 13 02:37:43.045592332 (105h12m5.004689569s) [upload=109623]: Uploading segments...
Aug 13 02:37:43.045765576 (105h12m5.004862807s) [upload=109623]: Got next segment. Inline: false
Aug 13 02:37:43.045843893 (105h12m5.004941138s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:37:43.045848977 (105h12m5.004946225s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:37:43.249407489 (105h12m5.208504767s) [seg_pos={0 0}, upload=109623]: Begin upload segment...
Aug 13 02:37:43.249508176 (105h12m5.208605422s) [seg_pos={0 0}, upload=109623]: Done begin upload segment.
Aug 13 02:37:43.249558868 (105h12m5.208656122s) [noise=true , address=104.36.82.60:4352 , piece_id=YXNNFT6UWIRVYF733CYXEBH3WNUHDGNNUCRDRRKGASG75WTLZ4GA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.249581213 (105h12m5.208678463s) [noise=true , address=104.36.82.62:4415 , piece_id=7WW5YFZFZITDFVWV7OF4TB6TIFJ5RDC6A5YPNX5ITSZ6KACD5PGQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250004407 (105h12m5.209101655s) [noise=true , address=104.36.82.61:4385 , piece_id=FGXGGXMWAAM3Y4EQU7WVHFZ7WFYHF5YIZXH37UVRTHKU2OIKNIVQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250062209 (105h12m5.209159463s) [noise=true , address=104.36.82.35:4608 , piece_id=YDG7JREFZGLEHPS32SS7EDZZLHJC2W5RULTE77WGHEPGOOJKVU2A, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250387036 (105h12m5.209484292s) [noise=true , address=104.36.82.21:4485 , piece_id=PKDPGI6GBUKWWQYN72ZL73L3LSSDZ34XEL3J7BF25XLEFFWG4HSA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250433034 (105h12m5.209530284s) [noise=true , address=66.23.193.175:4554 , piece_id=WT54NLSVWWO5QJWQNS7SD6SLCGDZ5OZAXCG4G5LLV2WK6FYGU5ZA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250729142 (105h12m5.209826387s) [noise=true , address=104.36.82.45:4911 , piece_id=3P6IKHKTF2XFVDBC3TIOQKIZCKPQ3VU5EDLFYFG64YWYNEJB6LHA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250830518 (105h12m5.209927768s) [noise=true , address=104.36.82.17:4346 , piece_id=FOEKKW4ITSFIC4A3XBQXJYFGRRO2MIB3D27LRDRHOITRPZ2XUCSQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251067141 (105h12m5.210164396s) [noise=true , address=104.36.82.46:4500 , piece_id=TANHUS5AWS5LSMZYAWL6KIRPGRCNDBPX6NQRXC2LPJ5N3AVXFVUQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251219042 (105h12m5.210316289s) [noise=true , address=104.36.82.37:4657 , piece_id=FN5KYJYS7JJ3RM3AU6B27OUPIEM55ZZC56YCVAQ2UV5Z6L5FBSIQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251428739 (105h12m5.210525984s) [noise=true , address=104.36.82.59:4309 , piece_id=LIJQXOSQBGGM4BDQWJEN76YZDKCGAX5U26FLQX5MCEOLSZTBIWOQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251558033 (105h12m5.210655289s) [noise=true , address=104.36.82.39:4732 , piece_id=2WMMXUMHYT6IWWWYKGDYXSYKG5EE6ZP2EUM5C2KBFE24KHM6AL5Q, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251769169 (105h12m5.210866414s) [noise=true , address=104.36.82.22:4537 , piece_id=2Y3GSRJW5WQ7EGSELRBGDB3B57SC5ZJY55YY2EXXRLRHCGP4GQNA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251921470 (105h12m5.211018722s) [noise=true , address=104.36.82.38:4700 , piece_id=L3XK5IQLIMEL75EYBQF5FCG3LIYDW22NEQAP5HAY3Z2TNMAARJHA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.252145503 (105h12m5.211242744s) [noise=true , address=45.91.116.10:4106 , piece_id=IJHPYM35LQIERCEYLHOUB72YZZBQW2AXCE22ZW7J6RN47IBLHRUQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.252299468 (105h12m5.211396726s) [noise=true , address=104.36.82.58:4272 , piece_id=2SKRRVYHHHOYYK47NMKNCMJIWDN63JGQZDBSDYSSEAX4DJWNIYBQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.252677274 (105h12m5.211774531s) [noise=true , address=77.90.31.19:4853 , piece_id=UCWKNV7ZKNUI3X3MD2VUQ65XD2D2CDVT3Q4FQLQSNOEGDYI42J4A, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.253090788 (105h12m5.212188038s) [noise=true , address=104.36.82.59:4333 , piece_id=VA3FQFWYWWW5WOPUOEZ4HIBXS65X6LUQEX3WLOCD2TNKHI4ZLA5Q, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.817516938 (105h12m5.776614183s) [upload=109623]: Next returned nil segment
Aug 13 02:37:43.817535614 (105h12m5.77663286s) [upload=109623]: Waiting for error group managing segments...
Aug 13 02:37:43.969526543 (105h12m5.92862378s) [noise=true , address=104.36.82.38:4700 , piece_id=L3XK5IQLIMEL75EYBQF5FCG3LIYDW22NEQAP5HAY3Z2TNMAARJHA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.974564900 (105h12m5.933662146s) [noise=true , address=104.36.82.62:4415 , piece_id=7WW5YFZFZITDFVWV7OF4TB6TIFJ5RDC6A5YPNX5ITSZ6KACD5PGQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.983439494 (105h12m5.942536745s) [noise=true , address=104.36.82.21:4485 , piece_id=PKDPGI6GBUKWWQYN72ZL73L3LSSDZ34XEL3J7BF25XLEFFWG4HSA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.984379096 (105h12m5.943476333s) [noise=true , address=77.90.31.19:4853 , piece_id=UCWKNV7ZKNUI3X3MD2VUQ65XD2D2CDVT3Q4FQLQSNOEGDYI42J4A, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.988613848 (105h12m5.947711101s) [noise=true , address=104.36.82.35:4608 , piece_id=YDG7JREFZGLEHPS32SS7EDZZLHJC2W5RULTE77WGHEPGOOJKVU2A, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.989654585 (105h12m5.948751817s) [noise=true , address=45.91.116.10:4106 , piece_id=IJHPYM35LQIERCEYLHOUB72YZZBQW2AXCE22ZW7J6RN47IBLHRUQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.991406027 (105h12m5.950503264s) [noise=true , address=104.36.82.39:4732 , piece_id=2WMMXUMHYT6IWWWYKGDYXSYKG5EE6ZP2EUM5C2KBFE24KHM6AL5Q, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.997155302 (105h12m5.956252538s) [noise=true , address=104.36.82.22:4537 , piece_id=2Y3GSRJW5WQ7EGSELRBGDB3B57SC5ZJY55YY2EXXRLRHCGP4GQNA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.001475322 (105h12m5.960572556s) [noise=true , address=104.36.82.17:4346 , piece_id=FOEKKW4ITSFIC4A3XBQXJYFGRRO2MIB3D27LRDRHOITRPZ2XUCSQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.012184501 (105h12m5.971281733s) [noise=true , address=104.36.82.45:4911 , piece_id=3P6IKHKTF2XFVDBC3TIOQKIZCKPQ3VU5EDLFYFG64YWYNEJB6LHA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.012294199 (105h12m5.971391438s) [noise=true , address=104.36.82.37:4657 , piece_id=FN5KYJYS7JJ3RM3AU6B27OUPIEM55ZZC56YCVAQ2UV5Z6L5FBSIQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.012542304 (105h12m5.971639549s) [noise=true , address=104.36.82.61:4385 , piece_id=FGXGGXMWAAM3Y4EQU7WVHFZ7WFYHF5YIZXH37UVRTHKU2OIKNIVQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.017684196 (105h12m5.976781435s) [noise=true , address=104.36.82.46:4500 , piece_id=TANHUS5AWS5LSMZYAWL6KIRPGRCNDBPX6NQRXC2LPJ5N3AVXFVUQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.017952693 (105h12m5.977049939s) [noise=true , address=104.36.82.59:4333 , piece_id=VA3FQFWYWWW5WOPUOEZ4HIBXS65X6LUQEX3WLOCD2TNKHI4ZLA5Q, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.017978224 (105h12m5.977075471s) [seg_pos={0 0}, upload=109623]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:37:44.018215187 (105h12m5.977312425s) [noise=true , address=104.36.82.58:4272 , piece_id=2SKRRVYHHHOYYK47NMKNCMJIWDN63JGQZDBSDYSSEAX4DJWNIYBQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yY39UpswsTLoWz4353JykK35fg8KB4AJWPatKGFgqTt4gDMcR): protocol: expected piece hash; context canceled; EOF
Aug 13 02:37:44.018263588 (105h12m5.977360833s) [noise=true , address=104.36.82.60:4352 , piece_id=YXNNFT6UWIRVYF733CYXEBH3WNUHDGNNUCRDRRKGASG75WTLZ4GA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RtYD3H9egoiNUbXsxJMWetAHYqjKGtfnGyNLSn6tbugdHaLXi): protocol: expected piece hash; context canceled; EOF
Aug 13 02:37:44.018333417 (105h12m5.977430656s) [noise=true , address=104.36.82.59:4309 , piece_id=LIJQXOSQBGGM4BDQWJEN76YZDKCGAX5U26FLQX5MCEOLSZTBIWOQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 13 02:37:44.018365028 (105h12m5.977462273s) [noise=true , address=66.23.193.175:4554 , piece_id=WT54NLSVWWO5QJWQNS7SD6SLCGDZ5OZAXCG4G5LLV2WK6FYGU5ZA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CraGuuckkbKe5PDLUvwF5G2ATUbgdR5g192YjkZgmP3JpqgXi): protocol: write tcp 139.59.144.22:34282->66.23.193.175:4554: use of closed network connection; write tcp 139.59.144.22:34282->66.23.193.175:4554: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34282->66.23.193.175:4554: use of closed network connection
Aug 13 02:37:44.018381393 (105h12m5.977478638s) [seg_pos={0 0}, upload=109623]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:37:44.018456401 (105h12m5.977553646s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:37:44.018461747 (105h12m5.977558991s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:37:44.187725773 (105h12m6.146823028s) [upload=109623]: Done uploading segments...
Aug 13 02:37:44.187752389 (105h12m6.146849623s) [upload=109623]: Upload finished. err: <nil>
Duration: 2.374547211s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X.................X...............................X..] duration:
2.481636552s
FAIL (2025-08-13 02:38:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:37:43.045141212 (105h12m5.004238457s) [upload=109623]: Starting upload
Aug 13 02:37:43.045209004 (105h12m5.00430625s) [upload=109623]: Done starting upload
Aug 13 02:37:43.045592332 (105h12m5.004689569s) [upload=109623]: Uploading segments...
Aug 13 02:37:43.045765576 (105h12m5.004862807s) [upload=109623]: Got next segment. Inline: false
Aug 13 02:37:43.045843893 (105h12m5.004941138s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:37:43.045848977 (105h12m5.004946225s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:37:43.249407489 (105h12m5.208504767s) [seg_pos={0 0}, upload=109623]: Begin upload segment...
Aug 13 02:37:43.249508176 (105h12m5.208605422s) [seg_pos={0 0}, upload=109623]: Done begin upload segment.
Aug 13 02:37:43.249558868 (105h12m5.208656122s) [noise=true , address=104.36.82.60:4352 , piece_id=YXNNFT6UWIRVYF733CYXEBH3WNUHDGNNUCRDRRKGASG75WTLZ4GA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.249581213 (105h12m5.208678463s) [noise=true , address=104.36.82.62:4415 , piece_id=7WW5YFZFZITDFVWV7OF4TB6TIFJ5RDC6A5YPNX5ITSZ6KACD5PGQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250004407 (105h12m5.209101655s) [noise=true , address=104.36.82.61:4385 , piece_id=FGXGGXMWAAM3Y4EQU7WVHFZ7WFYHF5YIZXH37UVRTHKU2OIKNIVQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250062209 (105h12m5.209159463s) [noise=true , address=104.36.82.35:4608 , piece_id=YDG7JREFZGLEHPS32SS7EDZZLHJC2W5RULTE77WGHEPGOOJKVU2A, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250387036 (105h12m5.209484292s) [noise=true , address=104.36.82.21:4485 , piece_id=PKDPGI6GBUKWWQYN72ZL73L3LSSDZ34XEL3J7BF25XLEFFWG4HSA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250433034 (105h12m5.209530284s) [noise=true , address=66.23.193.175:4554 , piece_id=WT54NLSVWWO5QJWQNS7SD6SLCGDZ5OZAXCG4G5LLV2WK6FYGU5ZA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250729142 (105h12m5.209826387s) [noise=true , address=104.36.82.45:4911 , piece_id=3P6IKHKTF2XFVDBC3TIOQKIZCKPQ3VU5EDLFYFG64YWYNEJB6LHA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250830518 (105h12m5.209927768s) [noise=true , address=104.36.82.17:4346 , piece_id=FOEKKW4ITSFIC4A3XBQXJYFGRRO2MIB3D27LRDRHOITRPZ2XUCSQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251067141 (105h12m5.210164396s) [noise=true , address=104.36.82.46:4500 , piece_id=TANHUS5AWS5LSMZYAWL6KIRPGRCNDBPX6NQRXC2LPJ5N3AVXFVUQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251219042 (105h12m5.210316289s) [noise=true , address=104.36.82.37:4657 , piece_id=FN5KYJYS7JJ3RM3AU6B27OUPIEM55ZZC56YCVAQ2UV5Z6L5FBSIQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251428739 (105h12m5.210525984s) [noise=true , address=104.36.82.59:4309 , piece_id=LIJQXOSQBGGM4BDQWJEN76YZDKCGAX5U26FLQX5MCEOLSZTBIWOQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251558033 (105h12m5.210655289s) [noise=true , address=104.36.82.39:4732 , piece_id=2WMMXUMHYT6IWWWYKGDYXSYKG5EE6ZP2EUM5C2KBFE24KHM6AL5Q, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251769169 (105h12m5.210866414s) [noise=true , address=104.36.82.22:4537 , piece_id=2Y3GSRJW5WQ7EGSELRBGDB3B57SC5ZJY55YY2EXXRLRHCGP4GQNA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251921470 (105h12m5.211018722s) [noise=true , address=104.36.82.38:4700 , piece_id=L3XK5IQLIMEL75EYBQF5FCG3LIYDW22NEQAP5HAY3Z2TNMAARJHA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.252145503 (105h12m5.211242744s) [noise=true , address=45.91.116.10:4106 , piece_id=IJHPYM35LQIERCEYLHOUB72YZZBQW2AXCE22ZW7J6RN47IBLHRUQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.252299468 (105h12m5.211396726s) [noise=true , address=104.36.82.58:4272 , piece_id=2SKRRVYHHHOYYK47NMKNCMJIWDN63JGQZDBSDYSSEAX4DJWNIYBQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.252677274 (105h12m5.211774531s) [noise=true , address=77.90.31.19:4853 , piece_id=UCWKNV7ZKNUI3X3MD2VUQ65XD2D2CDVT3Q4FQLQSNOEGDYI42J4A, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.253090788 (105h12m5.212188038s) [noise=true , address=104.36.82.59:4333 , piece_id=VA3FQFWYWWW5WOPUOEZ4HIBXS65X6LUQEX3WLOCD2TNKHI4ZLA5Q, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.817516938 (105h12m5.776614183s) [upload=109623]: Next returned nil segment
Aug 13 02:37:43.817535614 (105h12m5.77663286s) [upload=109623]: Waiting for error group managing segments...
Aug 13 02:37:43.969526543 (105h12m5.92862378s) [noise=true , address=104.36.82.38:4700 , piece_id=L3XK5IQLIMEL75EYBQF5FCG3LIYDW22NEQAP5HAY3Z2TNMAARJHA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.974564900 (105h12m5.933662146s) [noise=true , address=104.36.82.62:4415 , piece_id=7WW5YFZFZITDFVWV7OF4TB6TIFJ5RDC6A5YPNX5ITSZ6KACD5PGQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.983439494 (105h12m5.942536745s) [noise=true , address=104.36.82.21:4485 , piece_id=PKDPGI6GBUKWWQYN72ZL73L3LSSDZ34XEL3J7BF25XLEFFWG4HSA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.984379096 (105h12m5.943476333s) [noise=true , address=77.90.31.19:4853 , piece_id=UCWKNV7ZKNUI3X3MD2VUQ65XD2D2CDVT3Q4FQLQSNOEGDYI42J4A, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.988613848 (105h12m5.947711101s) [noise=true , address=104.36.82.35:4608 , piece_id=YDG7JREFZGLEHPS32SS7EDZZLHJC2W5RULTE77WGHEPGOOJKVU2A, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.989654585 (105h12m5.948751817s) [noise=true , address=45.91.116.10:4106 , piece_id=IJHPYM35LQIERCEYLHOUB72YZZBQW2AXCE22ZW7J6RN47IBLHRUQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.991406027 (105h12m5.950503264s) [noise=true , address=104.36.82.39:4732 , piece_id=2WMMXUMHYT6IWWWYKGDYXSYKG5EE6ZP2EUM5C2KBFE24KHM6AL5Q, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.997155302 (105h12m5.956252538s) [noise=true , address=104.36.82.22:4537 , piece_id=2Y3GSRJW5WQ7EGSELRBGDB3B57SC5ZJY55YY2EXXRLRHCGP4GQNA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.001475322 (105h12m5.960572556s) [noise=true , address=104.36.82.17:4346 , piece_id=FOEKKW4ITSFIC4A3XBQXJYFGRRO2MIB3D27LRDRHOITRPZ2XUCSQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.012184501 (105h12m5.971281733s) [noise=true , address=104.36.82.45:4911 , piece_id=3P6IKHKTF2XFVDBC3TIOQKIZCKPQ3VU5EDLFYFG64YWYNEJB6LHA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.012294199 (105h12m5.971391438s) [noise=true , address=104.36.82.37:4657 , piece_id=FN5KYJYS7JJ3RM3AU6B27OUPIEM55ZZC56YCVAQ2UV5Z6L5FBSIQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.012542304 (105h12m5.971639549s) [noise=true , address=104.36.82.61:4385 , piece_id=FGXGGXMWAAM3Y4EQU7WVHFZ7WFYHF5YIZXH37UVRTHKU2OIKNIVQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.017684196 (105h12m5.976781435s) [noise=true , address=104.36.82.46:4500 , piece_id=TANHUS5AWS5LSMZYAWL6KIRPGRCNDBPX6NQRXC2LPJ5N3AVXFVUQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.017952693 (105h12m5.977049939s) [noise=true , address=104.36.82.59:4333 , piece_id=VA3FQFWYWWW5WOPUOEZ4HIBXS65X6LUQEX3WLOCD2TNKHI4ZLA5Q, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.017978224 (105h12m5.977075471s) [seg_pos={0 0}, upload=109623]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:37:44.018215187 (105h12m5.977312425s) [noise=true , address=104.36.82.58:4272 , piece_id=2SKRRVYHHHOYYK47NMKNCMJIWDN63JGQZDBSDYSSEAX4DJWNIYBQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yY39UpswsTLoWz4353JykK35fg8KB4AJWPatKGFgqTt4gDMcR): protocol: expected piece hash; context canceled; EOF
Aug 13 02:37:44.018263588 (105h12m5.977360833s) [noise=true , address=104.36.82.60:4352 , piece_id=YXNNFT6UWIRVYF733CYXEBH3WNUHDGNNUCRDRRKGASG75WTLZ4GA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RtYD3H9egoiNUbXsxJMWetAHYqjKGtfnGyNLSn6tbugdHaLXi): protocol: expected piece hash; context canceled; EOF
Aug 13 02:37:44.018333417 (105h12m5.977430656s) [noise=true , address=104.36.82.59:4309 , piece_id=LIJQXOSQBGGM4BDQWJEN76YZDKCGAX5U26FLQX5MCEOLSZTBIWOQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 13 02:37:44.018365028 (105h12m5.977462273s) [noise=true , address=66.23.193.175:4554 , piece_id=WT54NLSVWWO5QJWQNS7SD6SLCGDZ5OZAXCG4G5LLV2WK6FYGU5ZA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CraGuuckkbKe5PDLUvwF5G2ATUbgdR5g192YjkZgmP3JpqgXi): protocol: write tcp 139.59.144.22:34282->66.23.193.175:4554: use of closed network connection; write tcp 139.59.144.22:34282->66.23.193.175:4554: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34282->66.23.193.175:4554: use of closed network connection
Aug 13 02:37:44.018381393 (105h12m5.977478638s) [seg_pos={0 0}, upload=109623]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:37:44.018456401 (105h12m5.977553646s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:37:44.018461747 (105h12m5.977558991s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:37:44.187725773 (105h12m6.146823028s) [upload=109623]: Done uploading segments...
Aug 13 02:37:44.187752389 (105h12m6.146849623s) [upload=109623]: Upload finished. err: <nil>
Duration: 2.481679024s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X..........X.X........................X...........] duration:
828.111464ms
FAIL (2025-08-13 02:38:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 828.144103ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X.................X...............................X.] duration:
2.476693462s
FAIL (2025-08-13 02:38:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:37:43.045141212 (105h12m5.004238457s) [upload=109623]: Starting upload
Aug 13 02:37:43.045209004 (105h12m5.00430625s) [upload=109623]: Done starting upload
Aug 13 02:37:43.045592332 (105h12m5.004689569s) [upload=109623]: Uploading segments...
Aug 13 02:37:43.045765576 (105h12m5.004862807s) [upload=109623]: Got next segment. Inline: false
Aug 13 02:37:43.045843893 (105h12m5.004941138s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:37:43.045848977 (105h12m5.004946225s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:37:43.249407489 (105h12m5.208504767s) [seg_pos={0 0}, upload=109623]: Begin upload segment...
Aug 13 02:37:43.249508176 (105h12m5.208605422s) [seg_pos={0 0}, upload=109623]: Done begin upload segment.
Aug 13 02:37:43.249558868 (105h12m5.208656122s) [noise=true , address=104.36.82.60:4352 , piece_id=YXNNFT6UWIRVYF733CYXEBH3WNUHDGNNUCRDRRKGASG75WTLZ4GA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.249581213 (105h12m5.208678463s) [noise=true , address=104.36.82.62:4415 , piece_id=7WW5YFZFZITDFVWV7OF4TB6TIFJ5RDC6A5YPNX5ITSZ6KACD5PGQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250004407 (105h12m5.209101655s) [noise=true , address=104.36.82.61:4385 , piece_id=FGXGGXMWAAM3Y4EQU7WVHFZ7WFYHF5YIZXH37UVRTHKU2OIKNIVQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250062209 (105h12m5.209159463s) [noise=true , address=104.36.82.35:4608 , piece_id=YDG7JREFZGLEHPS32SS7EDZZLHJC2W5RULTE77WGHEPGOOJKVU2A, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250387036 (105h12m5.209484292s) [noise=true , address=104.36.82.21:4485 , piece_id=PKDPGI6GBUKWWQYN72ZL73L3LSSDZ34XEL3J7BF25XLEFFWG4HSA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250433034 (105h12m5.209530284s) [noise=true , address=66.23.193.175:4554 , piece_id=WT54NLSVWWO5QJWQNS7SD6SLCGDZ5OZAXCG4G5LLV2WK6FYGU5ZA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250729142 (105h12m5.209826387s) [noise=true , address=104.36.82.45:4911 , piece_id=3P6IKHKTF2XFVDBC3TIOQKIZCKPQ3VU5EDLFYFG64YWYNEJB6LHA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250830518 (105h12m5.209927768s) [noise=true , address=104.36.82.17:4346 , piece_id=FOEKKW4ITSFIC4A3XBQXJYFGRRO2MIB3D27LRDRHOITRPZ2XUCSQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251067141 (105h12m5.210164396s) [noise=true , address=104.36.82.46:4500 , piece_id=TANHUS5AWS5LSMZYAWL6KIRPGRCNDBPX6NQRXC2LPJ5N3AVXFVUQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251219042 (105h12m5.210316289s) [noise=true , address=104.36.82.37:4657 , piece_id=FN5KYJYS7JJ3RM3AU6B27OUPIEM55ZZC56YCVAQ2UV5Z6L5FBSIQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251428739 (105h12m5.210525984s) [noise=true , address=104.36.82.59:4309 , piece_id=LIJQXOSQBGGM4BDQWJEN76YZDKCGAX5U26FLQX5MCEOLSZTBIWOQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251558033 (105h12m5.210655289s) [noise=true , address=104.36.82.39:4732 , piece_id=2WMMXUMHYT6IWWWYKGDYXSYKG5EE6ZP2EUM5C2KBFE24KHM6AL5Q, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251769169 (105h12m5.210866414s) [noise=true , address=104.36.82.22:4537 , piece_id=2Y3GSRJW5WQ7EGSELRBGDB3B57SC5ZJY55YY2EXXRLRHCGP4GQNA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251921470 (105h12m5.211018722s) [noise=true , address=104.36.82.38:4700 , piece_id=L3XK5IQLIMEL75EYBQF5FCG3LIYDW22NEQAP5HAY3Z2TNMAARJHA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.252145503 (105h12m5.211242744s) [noise=true , address=45.91.116.10:4106 , piece_id=IJHPYM35LQIERCEYLHOUB72YZZBQW2AXCE22ZW7J6RN47IBLHRUQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.252299468 (105h12m5.211396726s) [noise=true , address=104.36.82.58:4272 , piece_id=2SKRRVYHHHOYYK47NMKNCMJIWDN63JGQZDBSDYSSEAX4DJWNIYBQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.252677274 (105h12m5.211774531s) [noise=true , address=77.90.31.19:4853 , piece_id=UCWKNV7ZKNUI3X3MD2VUQ65XD2D2CDVT3Q4FQLQSNOEGDYI42J4A, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.253090788 (105h12m5.212188038s) [noise=true , address=104.36.82.59:4333 , piece_id=VA3FQFWYWWW5WOPUOEZ4HIBXS65X6LUQEX3WLOCD2TNKHI4ZLA5Q, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.817516938 (105h12m5.776614183s) [upload=109623]: Next returned nil segment
Aug 13 02:37:43.817535614 (105h12m5.77663286s) [upload=109623]: Waiting for error group managing segments...
Aug 13 02:37:43.969526543 (105h12m5.92862378s) [noise=true , address=104.36.82.38:4700 , piece_id=L3XK5IQLIMEL75EYBQF5FCG3LIYDW22NEQAP5HAY3Z2TNMAARJHA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.974564900 (105h12m5.933662146s) [noise=true , address=104.36.82.62:4415 , piece_id=7WW5YFZFZITDFVWV7OF4TB6TIFJ5RDC6A5YPNX5ITSZ6KACD5PGQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.983439494 (105h12m5.942536745s) [noise=true , address=104.36.82.21:4485 , piece_id=PKDPGI6GBUKWWQYN72ZL73L3LSSDZ34XEL3J7BF25XLEFFWG4HSA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.984379096 (105h12m5.943476333s) [noise=true , address=77.90.31.19:4853 , piece_id=UCWKNV7ZKNUI3X3MD2VUQ65XD2D2CDVT3Q4FQLQSNOEGDYI42J4A, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.988613848 (105h12m5.947711101s) [noise=true , address=104.36.82.35:4608 , piece_id=YDG7JREFZGLEHPS32SS7EDZZLHJC2W5RULTE77WGHEPGOOJKVU2A, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.989654585 (105h12m5.948751817s) [noise=true , address=45.91.116.10:4106 , piece_id=IJHPYM35LQIERCEYLHOUB72YZZBQW2AXCE22ZW7J6RN47IBLHRUQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.991406027 (105h12m5.950503264s) [noise=true , address=104.36.82.39:4732 , piece_id=2WMMXUMHYT6IWWWYKGDYXSYKG5EE6ZP2EUM5C2KBFE24KHM6AL5Q, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.997155302 (105h12m5.956252538s) [noise=true , address=104.36.82.22:4537 , piece_id=2Y3GSRJW5WQ7EGSELRBGDB3B57SC5ZJY55YY2EXXRLRHCGP4GQNA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.001475322 (105h12m5.960572556s) [noise=true , address=104.36.82.17:4346 , piece_id=FOEKKW4ITSFIC4A3XBQXJYFGRRO2MIB3D27LRDRHOITRPZ2XUCSQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.012184501 (105h12m5.971281733s) [noise=true , address=104.36.82.45:4911 , piece_id=3P6IKHKTF2XFVDBC3TIOQKIZCKPQ3VU5EDLFYFG64YWYNEJB6LHA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.012294199 (105h12m5.971391438s) [noise=true , address=104.36.82.37:4657 , piece_id=FN5KYJYS7JJ3RM3AU6B27OUPIEM55ZZC56YCVAQ2UV5Z6L5FBSIQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.012542304 (105h12m5.971639549s) [noise=true , address=104.36.82.61:4385 , piece_id=FGXGGXMWAAM3Y4EQU7WVHFZ7WFYHF5YIZXH37UVRTHKU2OIKNIVQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.017684196 (105h12m5.976781435s) [noise=true , address=104.36.82.46:4500 , piece_id=TANHUS5AWS5LSMZYAWL6KIRPGRCNDBPX6NQRXC2LPJ5N3AVXFVUQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.017952693 (105h12m5.977049939s) [noise=true , address=104.36.82.59:4333 , piece_id=VA3FQFWYWWW5WOPUOEZ4HIBXS65X6LUQEX3WLOCD2TNKHI4ZLA5Q, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.017978224 (105h12m5.977075471s) [seg_pos={0 0}, upload=109623]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:37:44.018215187 (105h12m5.977312425s) [noise=true , address=104.36.82.58:4272 , piece_id=2SKRRVYHHHOYYK47NMKNCMJIWDN63JGQZDBSDYSSEAX4DJWNIYBQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yY39UpswsTLoWz4353JykK35fg8KB4AJWPatKGFgqTt4gDMcR): protocol: expected piece hash; context canceled; EOF
Aug 13 02:37:44.018263588 (105h12m5.977360833s) [noise=true , address=104.36.82.60:4352 , piece_id=YXNNFT6UWIRVYF733CYXEBH3WNUHDGNNUCRDRRKGASG75WTLZ4GA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RtYD3H9egoiNUbXsxJMWetAHYqjKGtfnGyNLSn6tbugdHaLXi): protocol: expected piece hash; context canceled; EOF
Aug 13 02:37:44.018333417 (105h12m5.977430656s) [noise=true , address=104.36.82.59:4309 , piece_id=LIJQXOSQBGGM4BDQWJEN76YZDKCGAX5U26FLQX5MCEOLSZTBIWOQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 13 02:37:44.018365028 (105h12m5.977462273s) [noise=true , address=66.23.193.175:4554 , piece_id=WT54NLSVWWO5QJWQNS7SD6SLCGDZ5OZAXCG4G5LLV2WK6FYGU5ZA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CraGuuckkbKe5PDLUvwF5G2ATUbgdR5g192YjkZgmP3JpqgXi): protocol: write tcp 139.59.144.22:34282->66.23.193.175:4554: use of closed network connection; write tcp 139.59.144.22:34282->66.23.193.175:4554: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34282->66.23.193.175:4554: use of closed network connection
Aug 13 02:37:44.018381393 (105h12m5.977478638s) [seg_pos={0 0}, upload=109623]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:37:44.018456401 (105h12m5.977553646s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:37:44.018461747 (105h12m5.977558991s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:37:44.187725773 (105h12m6.146823028s) [upload=109623]: Done uploading segments...
Aug 13 02:37:44.187752389 (105h12m6.146849623s) [upload=109623]: Upload finished. err: <nil>
Duration: 2.47672622s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X.................X...............................X] duration:
1.617115764s
FAIL (2025-08-13 02:37:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:37:43.045141212 (105h12m5.004238457s) [upload=109623]: Starting upload
Aug 13 02:37:43.045209004 (105h12m5.00430625s) [upload=109623]: Done starting upload
Aug 13 02:37:43.045592332 (105h12m5.004689569s) [upload=109623]: Uploading segments...
Aug 13 02:37:43.045765576 (105h12m5.004862807s) [upload=109623]: Got next segment. Inline: false
Aug 13 02:37:43.045843893 (105h12m5.004941138s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:37:43.045848977 (105h12m5.004946225s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:37:43.249407489 (105h12m5.208504767s) [seg_pos={0 0}, upload=109623]: Begin upload segment...
Aug 13 02:37:43.249508176 (105h12m5.208605422s) [seg_pos={0 0}, upload=109623]: Done begin upload segment.
Aug 13 02:37:43.249558868 (105h12m5.208656122s) [noise=true , address=104.36.82.60:4352 , piece_id=YXNNFT6UWIRVYF733CYXEBH3WNUHDGNNUCRDRRKGASG75WTLZ4GA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.249581213 (105h12m5.208678463s) [noise=true , address=104.36.82.62:4415 , piece_id=7WW5YFZFZITDFVWV7OF4TB6TIFJ5RDC6A5YPNX5ITSZ6KACD5PGQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250004407 (105h12m5.209101655s) [noise=true , address=104.36.82.61:4385 , piece_id=FGXGGXMWAAM3Y4EQU7WVHFZ7WFYHF5YIZXH37UVRTHKU2OIKNIVQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250062209 (105h12m5.209159463s) [noise=true , address=104.36.82.35:4608 , piece_id=YDG7JREFZGLEHPS32SS7EDZZLHJC2W5RULTE77WGHEPGOOJKVU2A, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250387036 (105h12m5.209484292s) [noise=true , address=104.36.82.21:4485 , piece_id=PKDPGI6GBUKWWQYN72ZL73L3LSSDZ34XEL3J7BF25XLEFFWG4HSA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250433034 (105h12m5.209530284s) [noise=true , address=66.23.193.175:4554 , piece_id=WT54NLSVWWO5QJWQNS7SD6SLCGDZ5OZAXCG4G5LLV2WK6FYGU5ZA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250729142 (105h12m5.209826387s) [noise=true , address=104.36.82.45:4911 , piece_id=3P6IKHKTF2XFVDBC3TIOQKIZCKPQ3VU5EDLFYFG64YWYNEJB6LHA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.250830518 (105h12m5.209927768s) [noise=true , address=104.36.82.17:4346 , piece_id=FOEKKW4ITSFIC4A3XBQXJYFGRRO2MIB3D27LRDRHOITRPZ2XUCSQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251067141 (105h12m5.210164396s) [noise=true , address=104.36.82.46:4500 , piece_id=TANHUS5AWS5LSMZYAWL6KIRPGRCNDBPX6NQRXC2LPJ5N3AVXFVUQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251219042 (105h12m5.210316289s) [noise=true , address=104.36.82.37:4657 , piece_id=FN5KYJYS7JJ3RM3AU6B27OUPIEM55ZZC56YCVAQ2UV5Z6L5FBSIQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251428739 (105h12m5.210525984s) [noise=true , address=104.36.82.59:4309 , piece_id=LIJQXOSQBGGM4BDQWJEN76YZDKCGAX5U26FLQX5MCEOLSZTBIWOQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251558033 (105h12m5.210655289s) [noise=true , address=104.36.82.39:4732 , piece_id=2WMMXUMHYT6IWWWYKGDYXSYKG5EE6ZP2EUM5C2KBFE24KHM6AL5Q, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251769169 (105h12m5.210866414s) [noise=true , address=104.36.82.22:4537 , piece_id=2Y3GSRJW5WQ7EGSELRBGDB3B57SC5ZJY55YY2EXXRLRHCGP4GQNA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.251921470 (105h12m5.211018722s) [noise=true , address=104.36.82.38:4700 , piece_id=L3XK5IQLIMEL75EYBQF5FCG3LIYDW22NEQAP5HAY3Z2TNMAARJHA, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.252145503 (105h12m5.211242744s) [noise=true , address=45.91.116.10:4106 , piece_id=IJHPYM35LQIERCEYLHOUB72YZZBQW2AXCE22ZW7J6RN47IBLHRUQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.252299468 (105h12m5.211396726s) [noise=true , address=104.36.82.58:4272 , piece_id=2SKRRVYHHHOYYK47NMKNCMJIWDN63JGQZDBSDYSSEAX4DJWNIYBQ, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.252677274 (105h12m5.211774531s) [noise=true , address=77.90.31.19:4853 , piece_id=UCWKNV7ZKNUI3X3MD2VUQ65XD2D2CDVT3Q4FQLQSNOEGDYI42J4A, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.253090788 (105h12m5.212188038s) [noise=true , address=104.36.82.59:4333 , piece_id=VA3FQFWYWWW5WOPUOEZ4HIBXS65X6LUQEX3WLOCD2TNKHI4ZLA5Q, seg_pos={0 0}, upload=109623]: Uploading piece...
Aug 13 02:37:43.817516938 (105h12m5.776614183s) [upload=109623]: Next returned nil segment
Aug 13 02:37:43.817535614 (105h12m5.77663286s) [upload=109623]: Waiting for error group managing segments...
Aug 13 02:37:43.969526543 (105h12m5.92862378s) [noise=true , address=104.36.82.38:4700 , piece_id=L3XK5IQLIMEL75EYBQF5FCG3LIYDW22NEQAP5HAY3Z2TNMAARJHA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.974564900 (105h12m5.933662146s) [noise=true , address=104.36.82.62:4415 , piece_id=7WW5YFZFZITDFVWV7OF4TB6TIFJ5RDC6A5YPNX5ITSZ6KACD5PGQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.983439494 (105h12m5.942536745s) [noise=true , address=104.36.82.21:4485 , piece_id=PKDPGI6GBUKWWQYN72ZL73L3LSSDZ34XEL3J7BF25XLEFFWG4HSA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.984379096 (105h12m5.943476333s) [noise=true , address=77.90.31.19:4853 , piece_id=UCWKNV7ZKNUI3X3MD2VUQ65XD2D2CDVT3Q4FQLQSNOEGDYI42J4A, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.988613848 (105h12m5.947711101s) [noise=true , address=104.36.82.35:4608 , piece_id=YDG7JREFZGLEHPS32SS7EDZZLHJC2W5RULTE77WGHEPGOOJKVU2A, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.989654585 (105h12m5.948751817s) [noise=true , address=45.91.116.10:4106 , piece_id=IJHPYM35LQIERCEYLHOUB72YZZBQW2AXCE22ZW7J6RN47IBLHRUQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.991406027 (105h12m5.950503264s) [noise=true , address=104.36.82.39:4732 , piece_id=2WMMXUMHYT6IWWWYKGDYXSYKG5EE6ZP2EUM5C2KBFE24KHM6AL5Q, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:43.997155302 (105h12m5.956252538s) [noise=true , address=104.36.82.22:4537 , piece_id=2Y3GSRJW5WQ7EGSELRBGDB3B57SC5ZJY55YY2EXXRLRHCGP4GQNA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.001475322 (105h12m5.960572556s) [noise=true , address=104.36.82.17:4346 , piece_id=FOEKKW4ITSFIC4A3XBQXJYFGRRO2MIB3D27LRDRHOITRPZ2XUCSQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.012184501 (105h12m5.971281733s) [noise=true , address=104.36.82.45:4911 , piece_id=3P6IKHKTF2XFVDBC3TIOQKIZCKPQ3VU5EDLFYFG64YWYNEJB6LHA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.012294199 (105h12m5.971391438s) [noise=true , address=104.36.82.37:4657 , piece_id=FN5KYJYS7JJ3RM3AU6B27OUPIEM55ZZC56YCVAQ2UV5Z6L5FBSIQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.012542304 (105h12m5.971639549s) [noise=true , address=104.36.82.61:4385 , piece_id=FGXGGXMWAAM3Y4EQU7WVHFZ7WFYHF5YIZXH37UVRTHKU2OIKNIVQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.017684196 (105h12m5.976781435s) [noise=true , address=104.36.82.46:4500 , piece_id=TANHUS5AWS5LSMZYAWL6KIRPGRCNDBPX6NQRXC2LPJ5N3AVXFVUQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.017952693 (105h12m5.977049939s) [noise=true , address=104.36.82.59:4333 , piece_id=VA3FQFWYWWW5WOPUOEZ4HIBXS65X6LUQEX3WLOCD2TNKHI4ZLA5Q, seg_pos={0 0}, upload=109623]: Done uploading piece. err: <nil>
Aug 13 02:37:44.017978224 (105h12m5.977075471s) [seg_pos={0 0}, upload=109623]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:37:44.018215187 (105h12m5.977312425s) [noise=true , address=104.36.82.58:4272 , piece_id=2SKRRVYHHHOYYK47NMKNCMJIWDN63JGQZDBSDYSSEAX4DJWNIYBQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yY39UpswsTLoWz4353JykK35fg8KB4AJWPatKGFgqTt4gDMcR): protocol: expected piece hash; context canceled; EOF
Aug 13 02:37:44.018263588 (105h12m5.977360833s) [noise=true , address=104.36.82.60:4352 , piece_id=YXNNFT6UWIRVYF733CYXEBH3WNUHDGNNUCRDRRKGASG75WTLZ4GA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RtYD3H9egoiNUbXsxJMWetAHYqjKGtfnGyNLSn6tbugdHaLXi): protocol: expected piece hash; context canceled; EOF
Aug 13 02:37:44.018333417 (105h12m5.977430656s) [noise=true , address=104.36.82.59:4309 , piece_id=LIJQXOSQBGGM4BDQWJEN76YZDKCGAX5U26FLQX5MCEOLSZTBIWOQ, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 13 02:37:44.018365028 (105h12m5.977462273s) [noise=true , address=66.23.193.175:4554 , piece_id=WT54NLSVWWO5QJWQNS7SD6SLCGDZ5OZAXCG4G5LLV2WK6FYGU5ZA, seg_pos={0 0}, upload=109623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CraGuuckkbKe5PDLUvwF5G2ATUbgdR5g192YjkZgmP3JpqgXi): protocol: write tcp 139.59.144.22:34282->66.23.193.175:4554: use of closed network connection; write tcp 139.59.144.22:34282->66.23.193.175:4554: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34282->66.23.193.175:4554: use of closed network connection
Aug 13 02:37:44.018381393 (105h12m5.977478638s) [seg_pos={0 0}, upload=109623]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:37:44.018456401 (105h12m5.977553646s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:37:44.018461747 (105h12m5.977558991s) [upload=109623]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:37:44.187725773 (105h12m6.146823028s) [upload=109623]: Done uploading segments...
Aug 13 02:37:44.187752389 (105h12m6.146849623s) [upload=109623]: Upload finished. err: <nil>
Duration: 1.617144866s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X..........X.X........................X..........] duration:
1.023407228s
FAIL (2025-08-13 02:37:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 1.023438551s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.........X.................X...............................] duration:
2.639571107s
FAIL (2025-08-13 02:37:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:16:05.665562614 (104h50m27.62465986s) [upload=109250]: Starting upload
Aug 13 02:16:05.665614724 (104h50m27.624711974s) [upload=109250]: Done starting upload
Aug 13 02:16:05.665776384 (104h50m27.624873617s) [upload=109250]: Uploading segments...
Aug 13 02:16:05.665941794 (104h50m27.625039039s) [upload=109250]: Got next segment. Inline: false
Aug 13 02:16:05.665975454 (104h50m27.625072685s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:16:05.665980561 (104h50m27.625077793s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:16:05.937782401 (104h50m27.89687967s) [seg_pos={0 0}, upload=109250]: Begin upload segment...
Aug 13 02:16:05.937855917 (104h50m27.896953165s) [seg_pos={0 0}, upload=109250]: Done begin upload segment.
Aug 13 02:16:05.937886110 (104h50m27.89698336s) [noise=true , address=104.36.82.12:4157 , piece_id=AQJGWUGUSM7IPZKMW4RCYAKLZCY7LSJXZLLWMFHGLBZKIVSBICVA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938055665 (104h50m27.897152968s) [noise=true , address=104.36.82.47:4536 , piece_id=V3XXXYJ6ORYMJ4N2X6H5K64Z2S3H4NWMCATRW2CDE3LRUZRICI7A, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938507714 (104h50m27.897604963s) [noise=true , address=77.90.31.11:4575 , piece_id=ZK3HXXMJV5GCMLJMZFWWHEBZYQXFO5TZEZM65YHXDNLZKD3BRIJA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938547940 (104h50m27.897645193s) [noise=true , address=104.36.82.5:4864 , piece_id=G5KNNSF57AWYVVXAO7WJKZITPPSYHWUJHLOYF3PVZ3V3MREBSKBQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938935910 (104h50m27.898033165s) [noise=true , address=104.36.82.17:4349 , piece_id=Q4GRSQ7JNDNHV63EML3GKK6QG6MRDOFIC5E34WB6KV6IP7SLBCIQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.939008489 (104h50m27.898105744s) [noise=true , address=104.36.82.39:4741 , piece_id=D4TRFXZM5OWYF5X34ABKLURBLWOK567NCXGDP2MKITUA3VXAVXGA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.939363606 (104h50m27.89846084s) [noise=true , address=77.90.31.16:4750 , piece_id=XLBWK2PJ2JP6IUQKXPY7G2G7OH3PT7NEMPHHDQKTHMFDW35B6S3Q, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.939913858 (104h50m27.899011108s) [noise=true , address=104.36.82.61:4401 , piece_id=FKLEGG5I42TBOPL7RPJA7MV6DYNZ4YXASMJKG7MIDBOEIHWD2JKA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.940121742 (104h50m27.899218993s) [noise=true , address=104.36.82.37:4687 , piece_id=FADYVPRMFJSGSI5HYGV6EK7ZG737XAJKPVBEJT5DBR35IDSH2CHQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.940678299 (104h50m27.899775554s) [noise=true , address=104.36.82.58:4292 , piece_id=UK7NOKDH2ULHZDP2776XCSHNIXBBNYGERKOGTR3PLV5224SS7R3A, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.940913486 (104h50m27.900010738s) [noise=true , address=104.36.82.16:4324 , piece_id=6HQBCCGCWQLXQ6IY5LLG22KTWB6RBR75OWMH5DNS3757LU6PXUPQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.942042804 (104h50m27.901140056s) [noise=true , address=79.127.201.215:4356 , piece_id=EF5QMTTYUP4QT4B3HMIIZJWC344PGU5CDTECCPN72ZYS2JMOCS5Q, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.942405947 (104h50m27.901503199s) [noise=true , address=104.36.82.23:4461 , piece_id=GA3GHIUFXXTDES645UAANS4W6MAOVQEAYCEZEQWQ73Y7OA3OUUJQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.943411940 (104h50m27.902509194s) [noise=true , address=104.36.82.22:4525 , piece_id=NI4PNJOABMZECPGJBLMJV3NVBNX66TVSRHW6DP7A62DLKSJZVFXQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.943505406 (104h50m27.902602656s) [noise=true , address=104.36.82.46:4504 , piece_id=EOK5SPXMSV2EAWIGYV4KH3FL5UZJ3VAEFM2MTEL7FVQPSEKOLPNA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.944428440 (104h50m27.903525692s) [noise=true , address=77.90.31.16:4746 , piece_id=LOWDSVHZOTDTEU6K5DJ2LSXUBVYMYLNZ7L3GYHTBS2NG5XRRYFRQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.945378524 (104h50m27.904475774s) [noise=true , address=104.36.82.38:4700 , piece_id=ENX2HTWXLE3A3GM6OTEWACNT7PLFR3WQYK65KQJZ2YVCC3QNSVJA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.945813962 (104h50m27.904911212s) [noise=true , address=104.36.82.18:4367 , piece_id=JUHFQFYXSWIAUGCAPQW77F6PLAUDGDKM2IW6PPPAMFU6S4AXD4PA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:06.501285643 (104h50m28.460382893s) [upload=109250]: Next returned nil segment
Aug 13 02:16:06.501313144 (104h50m28.460410401s) [upload=109250]: Waiting for error group managing segments...
Aug 13 02:16:06.683917297 (104h50m28.643014535s) [noise=true , address=77.90.31.16:4750 , piece_id=XLBWK2PJ2JP6IUQKXPY7G2G7OH3PT7NEMPHHDQKTHMFDW35B6S3Q, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.683955930 (104h50m28.643053178s) [noise=true , address=104.36.82.17:4349 , piece_id=Q4GRSQ7JNDNHV63EML3GKK6QG6MRDOFIC5E34WB6KV6IP7SLBCIQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.690316003 (104h50m28.649413251s) [noise=true , address=104.36.82.22:4525 , piece_id=NI4PNJOABMZECPGJBLMJV3NVBNX66TVSRHW6DP7A62DLKSJZVFXQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.693334272 (104h50m28.652431519s) [noise=true , address=104.36.82.16:4324 , piece_id=6HQBCCGCWQLXQ6IY5LLG22KTWB6RBR75OWMH5DNS3757LU6PXUPQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.696114725 (104h50m28.655211972s) [noise=true , address=77.90.31.11:4575 , piece_id=ZK3HXXMJV5GCMLJMZFWWHEBZYQXFO5TZEZM65YHXDNLZKD3BRIJA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.700367300 (104h50m28.659464556s) [noise=true , address=104.36.82.39:4741 , piece_id=D4TRFXZM5OWYF5X34ABKLURBLWOK567NCXGDP2MKITUA3VXAVXGA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.702566195 (104h50m28.661663444s) [noise=true , address=77.90.31.16:4746 , piece_id=LOWDSVHZOTDTEU6K5DJ2LSXUBVYMYLNZ7L3GYHTBS2NG5XRRYFRQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.703606734 (104h50m28.662703985s) [noise=true , address=104.36.82.37:4687 , piece_id=FADYVPRMFJSGSI5HYGV6EK7ZG737XAJKPVBEJT5DBR35IDSH2CHQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.717795385 (104h50m28.67689263s) [noise=true , address=104.36.82.46:4504 , piece_id=EOK5SPXMSV2EAWIGYV4KH3FL5UZJ3VAEFM2MTEL7FVQPSEKOLPNA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.724047348 (104h50m28.683144598s) [noise=true , address=104.36.82.12:4157 , piece_id=AQJGWUGUSM7IPZKMW4RCYAKLZCY7LSJXZLLWMFHGLBZKIVSBICVA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.731017629 (104h50m28.690127114s) [noise=true , address=104.36.82.38:4700 , piece_id=ENX2HTWXLE3A3GM6OTEWACNT7PLFR3WQYK65KQJZ2YVCC3QNSVJA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.732145736 (104h50m28.691242982s) [noise=true , address=104.36.82.58:4292 , piece_id=UK7NOKDH2ULHZDP2776XCSHNIXBBNYGERKOGTR3PLV5224SS7R3A, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.735511091 (104h50m28.694608339s) [noise=true , address=104.36.82.61:4401 , piece_id=FKLEGG5I42TBOPL7RPJA7MV6DYNZ4YXASMJKG7MIDBOEIHWD2JKA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.738768168 (104h50m28.697865418s) [noise=true , address=104.36.82.23:4461 , piece_id=GA3GHIUFXXTDES645UAANS4W6MAOVQEAYCEZEQWQ73Y7OA3OUUJQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.738802337 (104h50m28.697899583s) [seg_pos={0 0}, upload=109250]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:16:06.739024852 (104h50m28.698122104s) [noise=true , address=104.36.82.47:4536 , piece_id=V3XXXYJ6ORYMJ4N2X6H5K64Z2S3H4NWMCATRW2CDE3LRUZRICI7A, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WoVNAp5RfVviaxN4RWCUDEhxLKsdGB8bgE6gcUcgZKcM4Cz1s): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739146647 (104h50m28.6982439s) [noise=true , address=104.36.82.5:4864 , piece_id=G5KNNSF57AWYVVXAO7WJKZITPPSYHWUJHLOYF3PVZ3V3MREBSKBQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739340891 (104h50m28.698438141s) [noise=true , address=79.127.201.215:4356 , piece_id=EF5QMTTYUP4QT4B3HMIIZJWC344PGU5CDTECCPN72ZYS2JMOCS5Q, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739449958 (104h50m28.698547204s) [noise=true , address=104.36.82.18:4367 , piece_id=JUHFQFYXSWIAUGCAPQW77F6PLAUDGDKM2IW6PPPAMFU6S4AXD4PA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739471195 (104h50m28.698568447s) [seg_pos={0 0}, upload=109250]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:16:06.739597424 (104h50m28.698694676s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:16:06.739605586 (104h50m28.698702836s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:16:07.666035646 (104h50m29.625132892s) [upload=109250]: Done uploading segments...
Aug 13 02:16:07.666058893 (104h50m29.625156138s) [upload=109250]: Upload finished. err: <nil>
Duration: 2.639629571s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X..........X.X........................X.........] duration:
872.447947ms
FAIL (2025-08-13 02:37:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 872.484533ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X..........X.X........................X........] duration:
843.074009ms
FAIL (2025-08-13 02:36:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 843.109831ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X.............X..........X.X........................X.......] duration:
884.960804ms
FAIL (2025-08-13 02:36:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 884.993206ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [XX.........X.................X..............................] duration:
2.632911848s
FAIL (2025-08-13 02:36:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:16:05.665562614 (104h50m27.62465986s) [upload=109250]: Starting upload
Aug 13 02:16:05.665614724 (104h50m27.624711974s) [upload=109250]: Done starting upload
Aug 13 02:16:05.665776384 (104h50m27.624873617s) [upload=109250]: Uploading segments...
Aug 13 02:16:05.665941794 (104h50m27.625039039s) [upload=109250]: Got next segment. Inline: false
Aug 13 02:16:05.665975454 (104h50m27.625072685s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:16:05.665980561 (104h50m27.625077793s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:16:05.937782401 (104h50m27.89687967s) [seg_pos={0 0}, upload=109250]: Begin upload segment...
Aug 13 02:16:05.937855917 (104h50m27.896953165s) [seg_pos={0 0}, upload=109250]: Done begin upload segment.
Aug 13 02:16:05.937886110 (104h50m27.89698336s) [noise=true , address=104.36.82.12:4157 , piece_id=AQJGWUGUSM7IPZKMW4RCYAKLZCY7LSJXZLLWMFHGLBZKIVSBICVA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938055665 (104h50m27.897152968s) [noise=true , address=104.36.82.47:4536 , piece_id=V3XXXYJ6ORYMJ4N2X6H5K64Z2S3H4NWMCATRW2CDE3LRUZRICI7A, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938507714 (104h50m27.897604963s) [noise=true , address=77.90.31.11:4575 , piece_id=ZK3HXXMJV5GCMLJMZFWWHEBZYQXFO5TZEZM65YHXDNLZKD3BRIJA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938547940 (104h50m27.897645193s) [noise=true , address=104.36.82.5:4864 , piece_id=G5KNNSF57AWYVVXAO7WJKZITPPSYHWUJHLOYF3PVZ3V3MREBSKBQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938935910 (104h50m27.898033165s) [noise=true , address=104.36.82.17:4349 , piece_id=Q4GRSQ7JNDNHV63EML3GKK6QG6MRDOFIC5E34WB6KV6IP7SLBCIQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.939008489 (104h50m27.898105744s) [noise=true , address=104.36.82.39:4741 , piece_id=D4TRFXZM5OWYF5X34ABKLURBLWOK567NCXGDP2MKITUA3VXAVXGA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.939363606 (104h50m27.89846084s) [noise=true , address=77.90.31.16:4750 , piece_id=XLBWK2PJ2JP6IUQKXPY7G2G7OH3PT7NEMPHHDQKTHMFDW35B6S3Q, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.939913858 (104h50m27.899011108s) [noise=true , address=104.36.82.61:4401 , piece_id=FKLEGG5I42TBOPL7RPJA7MV6DYNZ4YXASMJKG7MIDBOEIHWD2JKA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.940121742 (104h50m27.899218993s) [noise=true , address=104.36.82.37:4687 , piece_id=FADYVPRMFJSGSI5HYGV6EK7ZG737XAJKPVBEJT5DBR35IDSH2CHQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.940678299 (104h50m27.899775554s) [noise=true , address=104.36.82.58:4292 , piece_id=UK7NOKDH2ULHZDP2776XCSHNIXBBNYGERKOGTR3PLV5224SS7R3A, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.940913486 (104h50m27.900010738s) [noise=true , address=104.36.82.16:4324 , piece_id=6HQBCCGCWQLXQ6IY5LLG22KTWB6RBR75OWMH5DNS3757LU6PXUPQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.942042804 (104h50m27.901140056s) [noise=true , address=79.127.201.215:4356 , piece_id=EF5QMTTYUP4QT4B3HMIIZJWC344PGU5CDTECCPN72ZYS2JMOCS5Q, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.942405947 (104h50m27.901503199s) [noise=true , address=104.36.82.23:4461 , piece_id=GA3GHIUFXXTDES645UAANS4W6MAOVQEAYCEZEQWQ73Y7OA3OUUJQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.943411940 (104h50m27.902509194s) [noise=true , address=104.36.82.22:4525 , piece_id=NI4PNJOABMZECPGJBLMJV3NVBNX66TVSRHW6DP7A62DLKSJZVFXQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.943505406 (104h50m27.902602656s) [noise=true , address=104.36.82.46:4504 , piece_id=EOK5SPXMSV2EAWIGYV4KH3FL5UZJ3VAEFM2MTEL7FVQPSEKOLPNA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.944428440 (104h50m27.903525692s) [noise=true , address=77.90.31.16:4746 , piece_id=LOWDSVHZOTDTEU6K5DJ2LSXUBVYMYLNZ7L3GYHTBS2NG5XRRYFRQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.945378524 (104h50m27.904475774s) [noise=true , address=104.36.82.38:4700 , piece_id=ENX2HTWXLE3A3GM6OTEWACNT7PLFR3WQYK65KQJZ2YVCC3QNSVJA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.945813962 (104h50m27.904911212s) [noise=true , address=104.36.82.18:4367 , piece_id=JUHFQFYXSWIAUGCAPQW77F6PLAUDGDKM2IW6PPPAMFU6S4AXD4PA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:06.501285643 (104h50m28.460382893s) [upload=109250]: Next returned nil segment
Aug 13 02:16:06.501313144 (104h50m28.460410401s) [upload=109250]: Waiting for error group managing segments...
Aug 13 02:16:06.683917297 (104h50m28.643014535s) [noise=true , address=77.90.31.16:4750 , piece_id=XLBWK2PJ2JP6IUQKXPY7G2G7OH3PT7NEMPHHDQKTHMFDW35B6S3Q, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.683955930 (104h50m28.643053178s) [noise=true , address=104.36.82.17:4349 , piece_id=Q4GRSQ7JNDNHV63EML3GKK6QG6MRDOFIC5E34WB6KV6IP7SLBCIQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.690316003 (104h50m28.649413251s) [noise=true , address=104.36.82.22:4525 , piece_id=NI4PNJOABMZECPGJBLMJV3NVBNX66TVSRHW6DP7A62DLKSJZVFXQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.693334272 (104h50m28.652431519s) [noise=true , address=104.36.82.16:4324 , piece_id=6HQBCCGCWQLXQ6IY5LLG22KTWB6RBR75OWMH5DNS3757LU6PXUPQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.696114725 (104h50m28.655211972s) [noise=true , address=77.90.31.11:4575 , piece_id=ZK3HXXMJV5GCMLJMZFWWHEBZYQXFO5TZEZM65YHXDNLZKD3BRIJA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.700367300 (104h50m28.659464556s) [noise=true , address=104.36.82.39:4741 , piece_id=D4TRFXZM5OWYF5X34ABKLURBLWOK567NCXGDP2MKITUA3VXAVXGA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.702566195 (104h50m28.661663444s) [noise=true , address=77.90.31.16:4746 , piece_id=LOWDSVHZOTDTEU6K5DJ2LSXUBVYMYLNZ7L3GYHTBS2NG5XRRYFRQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.703606734 (104h50m28.662703985s) [noise=true , address=104.36.82.37:4687 , piece_id=FADYVPRMFJSGSI5HYGV6EK7ZG737XAJKPVBEJT5DBR35IDSH2CHQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.717795385 (104h50m28.67689263s) [noise=true , address=104.36.82.46:4504 , piece_id=EOK5SPXMSV2EAWIGYV4KH3FL5UZJ3VAEFM2MTEL7FVQPSEKOLPNA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.724047348 (104h50m28.683144598s) [noise=true , address=104.36.82.12:4157 , piece_id=AQJGWUGUSM7IPZKMW4RCYAKLZCY7LSJXZLLWMFHGLBZKIVSBICVA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.731017629 (104h50m28.690127114s) [noise=true , address=104.36.82.38:4700 , piece_id=ENX2HTWXLE3A3GM6OTEWACNT7PLFR3WQYK65KQJZ2YVCC3QNSVJA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.732145736 (104h50m28.691242982s) [noise=true , address=104.36.82.58:4292 , piece_id=UK7NOKDH2ULHZDP2776XCSHNIXBBNYGERKOGTR3PLV5224SS7R3A, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.735511091 (104h50m28.694608339s) [noise=true , address=104.36.82.61:4401 , piece_id=FKLEGG5I42TBOPL7RPJA7MV6DYNZ4YXASMJKG7MIDBOEIHWD2JKA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.738768168 (104h50m28.697865418s) [noise=true , address=104.36.82.23:4461 , piece_id=GA3GHIUFXXTDES645UAANS4W6MAOVQEAYCEZEQWQ73Y7OA3OUUJQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.738802337 (104h50m28.697899583s) [seg_pos={0 0}, upload=109250]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:16:06.739024852 (104h50m28.698122104s) [noise=true , address=104.36.82.47:4536 , piece_id=V3XXXYJ6ORYMJ4N2X6H5K64Z2S3H4NWMCATRW2CDE3LRUZRICI7A, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WoVNAp5RfVviaxN4RWCUDEhxLKsdGB8bgE6gcUcgZKcM4Cz1s): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739146647 (104h50m28.6982439s) [noise=true , address=104.36.82.5:4864 , piece_id=G5KNNSF57AWYVVXAO7WJKZITPPSYHWUJHLOYF3PVZ3V3MREBSKBQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739340891 (104h50m28.698438141s) [noise=true , address=79.127.201.215:4356 , piece_id=EF5QMTTYUP4QT4B3HMIIZJWC344PGU5CDTECCPN72ZYS2JMOCS5Q, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739449958 (104h50m28.698547204s) [noise=true , address=104.36.82.18:4367 , piece_id=JUHFQFYXSWIAUGCAPQW77F6PLAUDGDKM2IW6PPPAMFU6S4AXD4PA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739471195 (104h50m28.698568447s) [seg_pos={0 0}, upload=109250]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:16:06.739597424 (104h50m28.698694676s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:16:06.739605586 (104h50m28.698702836s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:16:07.666035646 (104h50m29.625132892s) [upload=109250]: Done uploading segments...
Aug 13 02:16:07.666058893 (104h50m29.625156138s) [upload=109250]: Upload finished. err: <nil>
Duration: 2.632942035s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.XX.........X.................X.............................] duration:
3.050376757s
FAIL (2025-08-13 02:36:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:16:05.665562614 (104h50m27.62465986s) [upload=109250]: Starting upload
Aug 13 02:16:05.665614724 (104h50m27.624711974s) [upload=109250]: Done starting upload
Aug 13 02:16:05.665776384 (104h50m27.624873617s) [upload=109250]: Uploading segments...
Aug 13 02:16:05.665941794 (104h50m27.625039039s) [upload=109250]: Got next segment. Inline: false
Aug 13 02:16:05.665975454 (104h50m27.625072685s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:16:05.665980561 (104h50m27.625077793s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:16:05.937782401 (104h50m27.89687967s) [seg_pos={0 0}, upload=109250]: Begin upload segment...
Aug 13 02:16:05.937855917 (104h50m27.896953165s) [seg_pos={0 0}, upload=109250]: Done begin upload segment.
Aug 13 02:16:05.937886110 (104h50m27.89698336s) [noise=true , address=104.36.82.12:4157 , piece_id=AQJGWUGUSM7IPZKMW4RCYAKLZCY7LSJXZLLWMFHGLBZKIVSBICVA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938055665 (104h50m27.897152968s) [noise=true , address=104.36.82.47:4536 , piece_id=V3XXXYJ6ORYMJ4N2X6H5K64Z2S3H4NWMCATRW2CDE3LRUZRICI7A, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938507714 (104h50m27.897604963s) [noise=true , address=77.90.31.11:4575 , piece_id=ZK3HXXMJV5GCMLJMZFWWHEBZYQXFO5TZEZM65YHXDNLZKD3BRIJA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938547940 (104h50m27.897645193s) [noise=true , address=104.36.82.5:4864 , piece_id=G5KNNSF57AWYVVXAO7WJKZITPPSYHWUJHLOYF3PVZ3V3MREBSKBQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938935910 (104h50m27.898033165s) [noise=true , address=104.36.82.17:4349 , piece_id=Q4GRSQ7JNDNHV63EML3GKK6QG6MRDOFIC5E34WB6KV6IP7SLBCIQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.939008489 (104h50m27.898105744s) [noise=true , address=104.36.82.39:4741 , piece_id=D4TRFXZM5OWYF5X34ABKLURBLWOK567NCXGDP2MKITUA3VXAVXGA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.939363606 (104h50m27.89846084s) [noise=true , address=77.90.31.16:4750 , piece_id=XLBWK2PJ2JP6IUQKXPY7G2G7OH3PT7NEMPHHDQKTHMFDW35B6S3Q, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.939913858 (104h50m27.899011108s) [noise=true , address=104.36.82.61:4401 , piece_id=FKLEGG5I42TBOPL7RPJA7MV6DYNZ4YXASMJKG7MIDBOEIHWD2JKA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.940121742 (104h50m27.899218993s) [noise=true , address=104.36.82.37:4687 , piece_id=FADYVPRMFJSGSI5HYGV6EK7ZG737XAJKPVBEJT5DBR35IDSH2CHQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.940678299 (104h50m27.899775554s) [noise=true , address=104.36.82.58:4292 , piece_id=UK7NOKDH2ULHZDP2776XCSHNIXBBNYGERKOGTR3PLV5224SS7R3A, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.940913486 (104h50m27.900010738s) [noise=true , address=104.36.82.16:4324 , piece_id=6HQBCCGCWQLXQ6IY5LLG22KTWB6RBR75OWMH5DNS3757LU6PXUPQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.942042804 (104h50m27.901140056s) [noise=true , address=79.127.201.215:4356 , piece_id=EF5QMTTYUP4QT4B3HMIIZJWC344PGU5CDTECCPN72ZYS2JMOCS5Q, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.942405947 (104h50m27.901503199s) [noise=true , address=104.36.82.23:4461 , piece_id=GA3GHIUFXXTDES645UAANS4W6MAOVQEAYCEZEQWQ73Y7OA3OUUJQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.943411940 (104h50m27.902509194s) [noise=true , address=104.36.82.22:4525 , piece_id=NI4PNJOABMZECPGJBLMJV3NVBNX66TVSRHW6DP7A62DLKSJZVFXQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.943505406 (104h50m27.902602656s) [noise=true , address=104.36.82.46:4504 , piece_id=EOK5SPXMSV2EAWIGYV4KH3FL5UZJ3VAEFM2MTEL7FVQPSEKOLPNA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.944428440 (104h50m27.903525692s) [noise=true , address=77.90.31.16:4746 , piece_id=LOWDSVHZOTDTEU6K5DJ2LSXUBVYMYLNZ7L3GYHTBS2NG5XRRYFRQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.945378524 (104h50m27.904475774s) [noise=true , address=104.36.82.38:4700 , piece_id=ENX2HTWXLE3A3GM6OTEWACNT7PLFR3WQYK65KQJZ2YVCC3QNSVJA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.945813962 (104h50m27.904911212s) [noise=true , address=104.36.82.18:4367 , piece_id=JUHFQFYXSWIAUGCAPQW77F6PLAUDGDKM2IW6PPPAMFU6S4AXD4PA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:06.501285643 (104h50m28.460382893s) [upload=109250]: Next returned nil segment
Aug 13 02:16:06.501313144 (104h50m28.460410401s) [upload=109250]: Waiting for error group managing segments...
Aug 13 02:16:06.683917297 (104h50m28.643014535s) [noise=true , address=77.90.31.16:4750 , piece_id=XLBWK2PJ2JP6IUQKXPY7G2G7OH3PT7NEMPHHDQKTHMFDW35B6S3Q, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.683955930 (104h50m28.643053178s) [noise=true , address=104.36.82.17:4349 , piece_id=Q4GRSQ7JNDNHV63EML3GKK6QG6MRDOFIC5E34WB6KV6IP7SLBCIQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.690316003 (104h50m28.649413251s) [noise=true , address=104.36.82.22:4525 , piece_id=NI4PNJOABMZECPGJBLMJV3NVBNX66TVSRHW6DP7A62DLKSJZVFXQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.693334272 (104h50m28.652431519s) [noise=true , address=104.36.82.16:4324 , piece_id=6HQBCCGCWQLXQ6IY5LLG22KTWB6RBR75OWMH5DNS3757LU6PXUPQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.696114725 (104h50m28.655211972s) [noise=true , address=77.90.31.11:4575 , piece_id=ZK3HXXMJV5GCMLJMZFWWHEBZYQXFO5TZEZM65YHXDNLZKD3BRIJA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.700367300 (104h50m28.659464556s) [noise=true , address=104.36.82.39:4741 , piece_id=D4TRFXZM5OWYF5X34ABKLURBLWOK567NCXGDP2MKITUA3VXAVXGA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.702566195 (104h50m28.661663444s) [noise=true , address=77.90.31.16:4746 , piece_id=LOWDSVHZOTDTEU6K5DJ2LSXUBVYMYLNZ7L3GYHTBS2NG5XRRYFRQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.703606734 (104h50m28.662703985s) [noise=true , address=104.36.82.37:4687 , piece_id=FADYVPRMFJSGSI5HYGV6EK7ZG737XAJKPVBEJT5DBR35IDSH2CHQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.717795385 (104h50m28.67689263s) [noise=true , address=104.36.82.46:4504 , piece_id=EOK5SPXMSV2EAWIGYV4KH3FL5UZJ3VAEFM2MTEL7FVQPSEKOLPNA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.724047348 (104h50m28.683144598s) [noise=true , address=104.36.82.12:4157 , piece_id=AQJGWUGUSM7IPZKMW4RCYAKLZCY7LSJXZLLWMFHGLBZKIVSBICVA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.731017629 (104h50m28.690127114s) [noise=true , address=104.36.82.38:4700 , piece_id=ENX2HTWXLE3A3GM6OTEWACNT7PLFR3WQYK65KQJZ2YVCC3QNSVJA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.732145736 (104h50m28.691242982s) [noise=true , address=104.36.82.58:4292 , piece_id=UK7NOKDH2ULHZDP2776XCSHNIXBBNYGERKOGTR3PLV5224SS7R3A, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.735511091 (104h50m28.694608339s) [noise=true , address=104.36.82.61:4401 , piece_id=FKLEGG5I42TBOPL7RPJA7MV6DYNZ4YXASMJKG7MIDBOEIHWD2JKA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.738768168 (104h50m28.697865418s) [noise=true , address=104.36.82.23:4461 , piece_id=GA3GHIUFXXTDES645UAANS4W6MAOVQEAYCEZEQWQ73Y7OA3OUUJQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.738802337 (104h50m28.697899583s) [seg_pos={0 0}, upload=109250]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:16:06.739024852 (104h50m28.698122104s) [noise=true , address=104.36.82.47:4536 , piece_id=V3XXXYJ6ORYMJ4N2X6H5K64Z2S3H4NWMCATRW2CDE3LRUZRICI7A, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WoVNAp5RfVviaxN4RWCUDEhxLKsdGB8bgE6gcUcgZKcM4Cz1s): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739146647 (104h50m28.6982439s) [noise=true , address=104.36.82.5:4864 , piece_id=G5KNNSF57AWYVVXAO7WJKZITPPSYHWUJHLOYF3PVZ3V3MREBSKBQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739340891 (104h50m28.698438141s) [noise=true , address=79.127.201.215:4356 , piece_id=EF5QMTTYUP4QT4B3HMIIZJWC344PGU5CDTECCPN72ZYS2JMOCS5Q, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739449958 (104h50m28.698547204s) [noise=true , address=104.36.82.18:4367 , piece_id=JUHFQFYXSWIAUGCAPQW77F6PLAUDGDKM2IW6PPPAMFU6S4AXD4PA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739471195 (104h50m28.698568447s) [seg_pos={0 0}, upload=109250]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:16:06.739597424 (104h50m28.698694676s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:16:06.739605586 (104h50m28.698702836s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:16:07.666035646 (104h50m29.625132892s) [upload=109250]: Done uploading segments...
Aug 13 02:16:07.666058893 (104h50m29.625156138s) [upload=109250]: Upload finished. err: <nil>
Duration: 3.050415485s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X.XX.........X.................X............................] duration:
2.321979809s
FAIL (2025-08-13 02:35:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:16:05.665562614 (104h50m27.62465986s) [upload=109250]: Starting upload
Aug 13 02:16:05.665614724 (104h50m27.624711974s) [upload=109250]: Done starting upload
Aug 13 02:16:05.665776384 (104h50m27.624873617s) [upload=109250]: Uploading segments...
Aug 13 02:16:05.665941794 (104h50m27.625039039s) [upload=109250]: Got next segment. Inline: false
Aug 13 02:16:05.665975454 (104h50m27.625072685s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:16:05.665980561 (104h50m27.625077793s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:16:05.937782401 (104h50m27.89687967s) [seg_pos={0 0}, upload=109250]: Begin upload segment...
Aug 13 02:16:05.937855917 (104h50m27.896953165s) [seg_pos={0 0}, upload=109250]: Done begin upload segment.
Aug 13 02:16:05.937886110 (104h50m27.89698336s) [noise=true , address=104.36.82.12:4157 , piece_id=AQJGWUGUSM7IPZKMW4RCYAKLZCY7LSJXZLLWMFHGLBZKIVSBICVA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938055665 (104h50m27.897152968s) [noise=true , address=104.36.82.47:4536 , piece_id=V3XXXYJ6ORYMJ4N2X6H5K64Z2S3H4NWMCATRW2CDE3LRUZRICI7A, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938507714 (104h50m27.897604963s) [noise=true , address=77.90.31.11:4575 , piece_id=ZK3HXXMJV5GCMLJMZFWWHEBZYQXFO5TZEZM65YHXDNLZKD3BRIJA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938547940 (104h50m27.897645193s) [noise=true , address=104.36.82.5:4864 , piece_id=G5KNNSF57AWYVVXAO7WJKZITPPSYHWUJHLOYF3PVZ3V3MREBSKBQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938935910 (104h50m27.898033165s) [noise=true , address=104.36.82.17:4349 , piece_id=Q4GRSQ7JNDNHV63EML3GKK6QG6MRDOFIC5E34WB6KV6IP7SLBCIQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.939008489 (104h50m27.898105744s) [noise=true , address=104.36.82.39:4741 , piece_id=D4TRFXZM5OWYF5X34ABKLURBLWOK567NCXGDP2MKITUA3VXAVXGA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.939363606 (104h50m27.89846084s) [noise=true , address=77.90.31.16:4750 , piece_id=XLBWK2PJ2JP6IUQKXPY7G2G7OH3PT7NEMPHHDQKTHMFDW35B6S3Q, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.939913858 (104h50m27.899011108s) [noise=true , address=104.36.82.61:4401 , piece_id=FKLEGG5I42TBOPL7RPJA7MV6DYNZ4YXASMJKG7MIDBOEIHWD2JKA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.940121742 (104h50m27.899218993s) [noise=true , address=104.36.82.37:4687 , piece_id=FADYVPRMFJSGSI5HYGV6EK7ZG737XAJKPVBEJT5DBR35IDSH2CHQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.940678299 (104h50m27.899775554s) [noise=true , address=104.36.82.58:4292 , piece_id=UK7NOKDH2ULHZDP2776XCSHNIXBBNYGERKOGTR3PLV5224SS7R3A, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.940913486 (104h50m27.900010738s) [noise=true , address=104.36.82.16:4324 , piece_id=6HQBCCGCWQLXQ6IY5LLG22KTWB6RBR75OWMH5DNS3757LU6PXUPQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.942042804 (104h50m27.901140056s) [noise=true , address=79.127.201.215:4356 , piece_id=EF5QMTTYUP4QT4B3HMIIZJWC344PGU5CDTECCPN72ZYS2JMOCS5Q, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.942405947 (104h50m27.901503199s) [noise=true , address=104.36.82.23:4461 , piece_id=GA3GHIUFXXTDES645UAANS4W6MAOVQEAYCEZEQWQ73Y7OA3OUUJQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.943411940 (104h50m27.902509194s) [noise=true , address=104.36.82.22:4525 , piece_id=NI4PNJOABMZECPGJBLMJV3NVBNX66TVSRHW6DP7A62DLKSJZVFXQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.943505406 (104h50m27.902602656s) [noise=true , address=104.36.82.46:4504 , piece_id=EOK5SPXMSV2EAWIGYV4KH3FL5UZJ3VAEFM2MTEL7FVQPSEKOLPNA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.944428440 (104h50m27.903525692s) [noise=true , address=77.90.31.16:4746 , piece_id=LOWDSVHZOTDTEU6K5DJ2LSXUBVYMYLNZ7L3GYHTBS2NG5XRRYFRQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.945378524 (104h50m27.904475774s) [noise=true , address=104.36.82.38:4700 , piece_id=ENX2HTWXLE3A3GM6OTEWACNT7PLFR3WQYK65KQJZ2YVCC3QNSVJA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.945813962 (104h50m27.904911212s) [noise=true , address=104.36.82.18:4367 , piece_id=JUHFQFYXSWIAUGCAPQW77F6PLAUDGDKM2IW6PPPAMFU6S4AXD4PA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:06.501285643 (104h50m28.460382893s) [upload=109250]: Next returned nil segment
Aug 13 02:16:06.501313144 (104h50m28.460410401s) [upload=109250]: Waiting for error group managing segments...
Aug 13 02:16:06.683917297 (104h50m28.643014535s) [noise=true , address=77.90.31.16:4750 , piece_id=XLBWK2PJ2JP6IUQKXPY7G2G7OH3PT7NEMPHHDQKTHMFDW35B6S3Q, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.683955930 (104h50m28.643053178s) [noise=true , address=104.36.82.17:4349 , piece_id=Q4GRSQ7JNDNHV63EML3GKK6QG6MRDOFIC5E34WB6KV6IP7SLBCIQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.690316003 (104h50m28.649413251s) [noise=true , address=104.36.82.22:4525 , piece_id=NI4PNJOABMZECPGJBLMJV3NVBNX66TVSRHW6DP7A62DLKSJZVFXQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.693334272 (104h50m28.652431519s) [noise=true , address=104.36.82.16:4324 , piece_id=6HQBCCGCWQLXQ6IY5LLG22KTWB6RBR75OWMH5DNS3757LU6PXUPQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.696114725 (104h50m28.655211972s) [noise=true , address=77.90.31.11:4575 , piece_id=ZK3HXXMJV5GCMLJMZFWWHEBZYQXFO5TZEZM65YHXDNLZKD3BRIJA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.700367300 (104h50m28.659464556s) [noise=true , address=104.36.82.39:4741 , piece_id=D4TRFXZM5OWYF5X34ABKLURBLWOK567NCXGDP2MKITUA3VXAVXGA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.702566195 (104h50m28.661663444s) [noise=true , address=77.90.31.16:4746 , piece_id=LOWDSVHZOTDTEU6K5DJ2LSXUBVYMYLNZ7L3GYHTBS2NG5XRRYFRQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.703606734 (104h50m28.662703985s) [noise=true , address=104.36.82.37:4687 , piece_id=FADYVPRMFJSGSI5HYGV6EK7ZG737XAJKPVBEJT5DBR35IDSH2CHQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.717795385 (104h50m28.67689263s) [noise=true , address=104.36.82.46:4504 , piece_id=EOK5SPXMSV2EAWIGYV4KH3FL5UZJ3VAEFM2MTEL7FVQPSEKOLPNA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.724047348 (104h50m28.683144598s) [noise=true , address=104.36.82.12:4157 , piece_id=AQJGWUGUSM7IPZKMW4RCYAKLZCY7LSJXZLLWMFHGLBZKIVSBICVA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.731017629 (104h50m28.690127114s) [noise=true , address=104.36.82.38:4700 , piece_id=ENX2HTWXLE3A3GM6OTEWACNT7PLFR3WQYK65KQJZ2YVCC3QNSVJA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.732145736 (104h50m28.691242982s) [noise=true , address=104.36.82.58:4292 , piece_id=UK7NOKDH2ULHZDP2776XCSHNIXBBNYGERKOGTR3PLV5224SS7R3A, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.735511091 (104h50m28.694608339s) [noise=true , address=104.36.82.61:4401 , piece_id=FKLEGG5I42TBOPL7RPJA7MV6DYNZ4YXASMJKG7MIDBOEIHWD2JKA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.738768168 (104h50m28.697865418s) [noise=true , address=104.36.82.23:4461 , piece_id=GA3GHIUFXXTDES645UAANS4W6MAOVQEAYCEZEQWQ73Y7OA3OUUJQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.738802337 (104h50m28.697899583s) [seg_pos={0 0}, upload=109250]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:16:06.739024852 (104h50m28.698122104s) [noise=true , address=104.36.82.47:4536 , piece_id=V3XXXYJ6ORYMJ4N2X6H5K64Z2S3H4NWMCATRW2CDE3LRUZRICI7A, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WoVNAp5RfVviaxN4RWCUDEhxLKsdGB8bgE6gcUcgZKcM4Cz1s): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739146647 (104h50m28.6982439s) [noise=true , address=104.36.82.5:4864 , piece_id=G5KNNSF57AWYVVXAO7WJKZITPPSYHWUJHLOYF3PVZ3V3MREBSKBQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739340891 (104h50m28.698438141s) [noise=true , address=79.127.201.215:4356 , piece_id=EF5QMTTYUP4QT4B3HMIIZJWC344PGU5CDTECCPN72ZYS2JMOCS5Q, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739449958 (104h50m28.698547204s) [noise=true , address=104.36.82.18:4367 , piece_id=JUHFQFYXSWIAUGCAPQW77F6PLAUDGDKM2IW6PPPAMFU6S4AXD4PA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739471195 (104h50m28.698568447s) [seg_pos={0 0}, upload=109250]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:16:06.739597424 (104h50m28.698694676s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:16:06.739605586 (104h50m28.698702836s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:16:07.666035646 (104h50m29.625132892s) [upload=109250]: Done uploading segments...
Aug 13 02:16:07.666058893 (104h50m29.625156138s) [upload=109250]: Upload finished. err: <nil>
Duration: 2.322012752s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X.............X..........X.X........................X......] duration:
983.192524ms
FAIL (2025-08-13 02:35:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 983.221547ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X.............X..........X.X........................X.....] duration:
858.974881ms
FAIL (2025-08-13 02:34:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 859.10056ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X.XX.........X.................X...........................] duration:
2.422748722s
FAIL (2025-08-13 02:34:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:16:05.665562614 (104h50m27.62465986s) [upload=109250]: Starting upload
Aug 13 02:16:05.665614724 (104h50m27.624711974s) [upload=109250]: Done starting upload
Aug 13 02:16:05.665776384 (104h50m27.624873617s) [upload=109250]: Uploading segments...
Aug 13 02:16:05.665941794 (104h50m27.625039039s) [upload=109250]: Got next segment. Inline: false
Aug 13 02:16:05.665975454 (104h50m27.625072685s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:16:05.665980561 (104h50m27.625077793s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:16:05.937782401 (104h50m27.89687967s) [seg_pos={0 0}, upload=109250]: Begin upload segment...
Aug 13 02:16:05.937855917 (104h50m27.896953165s) [seg_pos={0 0}, upload=109250]: Done begin upload segment.
Aug 13 02:16:05.937886110 (104h50m27.89698336s) [noise=true , address=104.36.82.12:4157 , piece_id=AQJGWUGUSM7IPZKMW4RCYAKLZCY7LSJXZLLWMFHGLBZKIVSBICVA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938055665 (104h50m27.897152968s) [noise=true , address=104.36.82.47:4536 , piece_id=V3XXXYJ6ORYMJ4N2X6H5K64Z2S3H4NWMCATRW2CDE3LRUZRICI7A, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938507714 (104h50m27.897604963s) [noise=true , address=77.90.31.11:4575 , piece_id=ZK3HXXMJV5GCMLJMZFWWHEBZYQXFO5TZEZM65YHXDNLZKD3BRIJA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938547940 (104h50m27.897645193s) [noise=true , address=104.36.82.5:4864 , piece_id=G5KNNSF57AWYVVXAO7WJKZITPPSYHWUJHLOYF3PVZ3V3MREBSKBQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938935910 (104h50m27.898033165s) [noise=true , address=104.36.82.17:4349 , piece_id=Q4GRSQ7JNDNHV63EML3GKK6QG6MRDOFIC5E34WB6KV6IP7SLBCIQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.939008489 (104h50m27.898105744s) [noise=true , address=104.36.82.39:4741 , piece_id=D4TRFXZM5OWYF5X34ABKLURBLWOK567NCXGDP2MKITUA3VXAVXGA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.939363606 (104h50m27.89846084s) [noise=true , address=77.90.31.16:4750 , piece_id=XLBWK2PJ2JP6IUQKXPY7G2G7OH3PT7NEMPHHDQKTHMFDW35B6S3Q, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.939913858 (104h50m27.899011108s) [noise=true , address=104.36.82.61:4401 , piece_id=FKLEGG5I42TBOPL7RPJA7MV6DYNZ4YXASMJKG7MIDBOEIHWD2JKA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.940121742 (104h50m27.899218993s) [noise=true , address=104.36.82.37:4687 , piece_id=FADYVPRMFJSGSI5HYGV6EK7ZG737XAJKPVBEJT5DBR35IDSH2CHQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.940678299 (104h50m27.899775554s) [noise=true , address=104.36.82.58:4292 , piece_id=UK7NOKDH2ULHZDP2776XCSHNIXBBNYGERKOGTR3PLV5224SS7R3A, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.940913486 (104h50m27.900010738s) [noise=true , address=104.36.82.16:4324 , piece_id=6HQBCCGCWQLXQ6IY5LLG22KTWB6RBR75OWMH5DNS3757LU6PXUPQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.942042804 (104h50m27.901140056s) [noise=true , address=79.127.201.215:4356 , piece_id=EF5QMTTYUP4QT4B3HMIIZJWC344PGU5CDTECCPN72ZYS2JMOCS5Q, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.942405947 (104h50m27.901503199s) [noise=true , address=104.36.82.23:4461 , piece_id=GA3GHIUFXXTDES645UAANS4W6MAOVQEAYCEZEQWQ73Y7OA3OUUJQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.943411940 (104h50m27.902509194s) [noise=true , address=104.36.82.22:4525 , piece_id=NI4PNJOABMZECPGJBLMJV3NVBNX66TVSRHW6DP7A62DLKSJZVFXQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.943505406 (104h50m27.902602656s) [noise=true , address=104.36.82.46:4504 , piece_id=EOK5SPXMSV2EAWIGYV4KH3FL5UZJ3VAEFM2MTEL7FVQPSEKOLPNA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.944428440 (104h50m27.903525692s) [noise=true , address=77.90.31.16:4746 , piece_id=LOWDSVHZOTDTEU6K5DJ2LSXUBVYMYLNZ7L3GYHTBS2NG5XRRYFRQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.945378524 (104h50m27.904475774s) [noise=true , address=104.36.82.38:4700 , piece_id=ENX2HTWXLE3A3GM6OTEWACNT7PLFR3WQYK65KQJZ2YVCC3QNSVJA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.945813962 (104h50m27.904911212s) [noise=true , address=104.36.82.18:4367 , piece_id=JUHFQFYXSWIAUGCAPQW77F6PLAUDGDKM2IW6PPPAMFU6S4AXD4PA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:06.501285643 (104h50m28.460382893s) [upload=109250]: Next returned nil segment
Aug 13 02:16:06.501313144 (104h50m28.460410401s) [upload=109250]: Waiting for error group managing segments...
Aug 13 02:16:06.683917297 (104h50m28.643014535s) [noise=true , address=77.90.31.16:4750 , piece_id=XLBWK2PJ2JP6IUQKXPY7G2G7OH3PT7NEMPHHDQKTHMFDW35B6S3Q, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.683955930 (104h50m28.643053178s) [noise=true , address=104.36.82.17:4349 , piece_id=Q4GRSQ7JNDNHV63EML3GKK6QG6MRDOFIC5E34WB6KV6IP7SLBCIQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.690316003 (104h50m28.649413251s) [noise=true , address=104.36.82.22:4525 , piece_id=NI4PNJOABMZECPGJBLMJV3NVBNX66TVSRHW6DP7A62DLKSJZVFXQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.693334272 (104h50m28.652431519s) [noise=true , address=104.36.82.16:4324 , piece_id=6HQBCCGCWQLXQ6IY5LLG22KTWB6RBR75OWMH5DNS3757LU6PXUPQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.696114725 (104h50m28.655211972s) [noise=true , address=77.90.31.11:4575 , piece_id=ZK3HXXMJV5GCMLJMZFWWHEBZYQXFO5TZEZM65YHXDNLZKD3BRIJA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.700367300 (104h50m28.659464556s) [noise=true , address=104.36.82.39:4741 , piece_id=D4TRFXZM5OWYF5X34ABKLURBLWOK567NCXGDP2MKITUA3VXAVXGA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.702566195 (104h50m28.661663444s) [noise=true , address=77.90.31.16:4746 , piece_id=LOWDSVHZOTDTEU6K5DJ2LSXUBVYMYLNZ7L3GYHTBS2NG5XRRYFRQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.703606734 (104h50m28.662703985s) [noise=true , address=104.36.82.37:4687 , piece_id=FADYVPRMFJSGSI5HYGV6EK7ZG737XAJKPVBEJT5DBR35IDSH2CHQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.717795385 (104h50m28.67689263s) [noise=true , address=104.36.82.46:4504 , piece_id=EOK5SPXMSV2EAWIGYV4KH3FL5UZJ3VAEFM2MTEL7FVQPSEKOLPNA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.724047348 (104h50m28.683144598s) [noise=true , address=104.36.82.12:4157 , piece_id=AQJGWUGUSM7IPZKMW4RCYAKLZCY7LSJXZLLWMFHGLBZKIVSBICVA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.731017629 (104h50m28.690127114s) [noise=true , address=104.36.82.38:4700 , piece_id=ENX2HTWXLE3A3GM6OTEWACNT7PLFR3WQYK65KQJZ2YVCC3QNSVJA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.732145736 (104h50m28.691242982s) [noise=true , address=104.36.82.58:4292 , piece_id=UK7NOKDH2ULHZDP2776XCSHNIXBBNYGERKOGTR3PLV5224SS7R3A, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.735511091 (104h50m28.694608339s) [noise=true , address=104.36.82.61:4401 , piece_id=FKLEGG5I42TBOPL7RPJA7MV6DYNZ4YXASMJKG7MIDBOEIHWD2JKA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.738768168 (104h50m28.697865418s) [noise=true , address=104.36.82.23:4461 , piece_id=GA3GHIUFXXTDES645UAANS4W6MAOVQEAYCEZEQWQ73Y7OA3OUUJQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.738802337 (104h50m28.697899583s) [seg_pos={0 0}, upload=109250]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:16:06.739024852 (104h50m28.698122104s) [noise=true , address=104.36.82.47:4536 , piece_id=V3XXXYJ6ORYMJ4N2X6H5K64Z2S3H4NWMCATRW2CDE3LRUZRICI7A, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WoVNAp5RfVviaxN4RWCUDEhxLKsdGB8bgE6gcUcgZKcM4Cz1s): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739146647 (104h50m28.6982439s) [noise=true , address=104.36.82.5:4864 , piece_id=G5KNNSF57AWYVVXAO7WJKZITPPSYHWUJHLOYF3PVZ3V3MREBSKBQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739340891 (104h50m28.698438141s) [noise=true , address=79.127.201.215:4356 , piece_id=EF5QMTTYUP4QT4B3HMIIZJWC344PGU5CDTECCPN72ZYS2JMOCS5Q, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739449958 (104h50m28.698547204s) [noise=true , address=104.36.82.18:4367 , piece_id=JUHFQFYXSWIAUGCAPQW77F6PLAUDGDKM2IW6PPPAMFU6S4AXD4PA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739471195 (104h50m28.698568447s) [seg_pos={0 0}, upload=109250]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:16:06.739597424 (104h50m28.698694676s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:16:06.739605586 (104h50m28.698702836s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:16:07.666035646 (104h50m29.625132892s) [upload=109250]: Done uploading segments...
Aug 13 02:16:07.666058893 (104h50m29.625156138s) [upload=109250]: Upload finished. err: <nil>
Duration: 2.422781569s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...X.............X..........X.X........................X....] duration:
955.248122ms
FAIL (2025-08-13 02:33:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 955.297075ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X.XX.........X.................X..........................] duration:
2.58328958s
FAIL (2025-08-13 02:33:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 02:16:05.665562614 (104h50m27.62465986s) [upload=109250]: Starting upload
Aug 13 02:16:05.665614724 (104h50m27.624711974s) [upload=109250]: Done starting upload
Aug 13 02:16:05.665776384 (104h50m27.624873617s) [upload=109250]: Uploading segments...
Aug 13 02:16:05.665941794 (104h50m27.625039039s) [upload=109250]: Got next segment. Inline: false
Aug 13 02:16:05.665975454 (104h50m27.625072685s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 02:16:05.665980561 (104h50m27.625077793s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 02:16:05.937782401 (104h50m27.89687967s) [seg_pos={0 0}, upload=109250]: Begin upload segment...
Aug 13 02:16:05.937855917 (104h50m27.896953165s) [seg_pos={0 0}, upload=109250]: Done begin upload segment.
Aug 13 02:16:05.937886110 (104h50m27.89698336s) [noise=true , address=104.36.82.12:4157 , piece_id=AQJGWUGUSM7IPZKMW4RCYAKLZCY7LSJXZLLWMFHGLBZKIVSBICVA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938055665 (104h50m27.897152968s) [noise=true , address=104.36.82.47:4536 , piece_id=V3XXXYJ6ORYMJ4N2X6H5K64Z2S3H4NWMCATRW2CDE3LRUZRICI7A, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938507714 (104h50m27.897604963s) [noise=true , address=77.90.31.11:4575 , piece_id=ZK3HXXMJV5GCMLJMZFWWHEBZYQXFO5TZEZM65YHXDNLZKD3BRIJA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938547940 (104h50m27.897645193s) [noise=true , address=104.36.82.5:4864 , piece_id=G5KNNSF57AWYVVXAO7WJKZITPPSYHWUJHLOYF3PVZ3V3MREBSKBQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.938935910 (104h50m27.898033165s) [noise=true , address=104.36.82.17:4349 , piece_id=Q4GRSQ7JNDNHV63EML3GKK6QG6MRDOFIC5E34WB6KV6IP7SLBCIQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.939008489 (104h50m27.898105744s) [noise=true , address=104.36.82.39:4741 , piece_id=D4TRFXZM5OWYF5X34ABKLURBLWOK567NCXGDP2MKITUA3VXAVXGA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.939363606 (104h50m27.89846084s) [noise=true , address=77.90.31.16:4750 , piece_id=XLBWK2PJ2JP6IUQKXPY7G2G7OH3PT7NEMPHHDQKTHMFDW35B6S3Q, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.939913858 (104h50m27.899011108s) [noise=true , address=104.36.82.61:4401 , piece_id=FKLEGG5I42TBOPL7RPJA7MV6DYNZ4YXASMJKG7MIDBOEIHWD2JKA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.940121742 (104h50m27.899218993s) [noise=true , address=104.36.82.37:4687 , piece_id=FADYVPRMFJSGSI5HYGV6EK7ZG737XAJKPVBEJT5DBR35IDSH2CHQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.940678299 (104h50m27.899775554s) [noise=true , address=104.36.82.58:4292 , piece_id=UK7NOKDH2ULHZDP2776XCSHNIXBBNYGERKOGTR3PLV5224SS7R3A, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.940913486 (104h50m27.900010738s) [noise=true , address=104.36.82.16:4324 , piece_id=6HQBCCGCWQLXQ6IY5LLG22KTWB6RBR75OWMH5DNS3757LU6PXUPQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.942042804 (104h50m27.901140056s) [noise=true , address=79.127.201.215:4356 , piece_id=EF5QMTTYUP4QT4B3HMIIZJWC344PGU5CDTECCPN72ZYS2JMOCS5Q, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.942405947 (104h50m27.901503199s) [noise=true , address=104.36.82.23:4461 , piece_id=GA3GHIUFXXTDES645UAANS4W6MAOVQEAYCEZEQWQ73Y7OA3OUUJQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.943411940 (104h50m27.902509194s) [noise=true , address=104.36.82.22:4525 , piece_id=NI4PNJOABMZECPGJBLMJV3NVBNX66TVSRHW6DP7A62DLKSJZVFXQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.943505406 (104h50m27.902602656s) [noise=true , address=104.36.82.46:4504 , piece_id=EOK5SPXMSV2EAWIGYV4KH3FL5UZJ3VAEFM2MTEL7FVQPSEKOLPNA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.944428440 (104h50m27.903525692s) [noise=true , address=77.90.31.16:4746 , piece_id=LOWDSVHZOTDTEU6K5DJ2LSXUBVYMYLNZ7L3GYHTBS2NG5XRRYFRQ, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.945378524 (104h50m27.904475774s) [noise=true , address=104.36.82.38:4700 , piece_id=ENX2HTWXLE3A3GM6OTEWACNT7PLFR3WQYK65KQJZ2YVCC3QNSVJA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:05.945813962 (104h50m27.904911212s) [noise=true , address=104.36.82.18:4367 , piece_id=JUHFQFYXSWIAUGCAPQW77F6PLAUDGDKM2IW6PPPAMFU6S4AXD4PA, seg_pos={0 0}, upload=109250]: Uploading piece...
Aug 13 02:16:06.501285643 (104h50m28.460382893s) [upload=109250]: Next returned nil segment
Aug 13 02:16:06.501313144 (104h50m28.460410401s) [upload=109250]: Waiting for error group managing segments...
Aug 13 02:16:06.683917297 (104h50m28.643014535s) [noise=true , address=77.90.31.16:4750 , piece_id=XLBWK2PJ2JP6IUQKXPY7G2G7OH3PT7NEMPHHDQKTHMFDW35B6S3Q, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.683955930 (104h50m28.643053178s) [noise=true , address=104.36.82.17:4349 , piece_id=Q4GRSQ7JNDNHV63EML3GKK6QG6MRDOFIC5E34WB6KV6IP7SLBCIQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.690316003 (104h50m28.649413251s) [noise=true , address=104.36.82.22:4525 , piece_id=NI4PNJOABMZECPGJBLMJV3NVBNX66TVSRHW6DP7A62DLKSJZVFXQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.693334272 (104h50m28.652431519s) [noise=true , address=104.36.82.16:4324 , piece_id=6HQBCCGCWQLXQ6IY5LLG22KTWB6RBR75OWMH5DNS3757LU6PXUPQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.696114725 (104h50m28.655211972s) [noise=true , address=77.90.31.11:4575 , piece_id=ZK3HXXMJV5GCMLJMZFWWHEBZYQXFO5TZEZM65YHXDNLZKD3BRIJA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.700367300 (104h50m28.659464556s) [noise=true , address=104.36.82.39:4741 , piece_id=D4TRFXZM5OWYF5X34ABKLURBLWOK567NCXGDP2MKITUA3VXAVXGA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.702566195 (104h50m28.661663444s) [noise=true , address=77.90.31.16:4746 , piece_id=LOWDSVHZOTDTEU6K5DJ2LSXUBVYMYLNZ7L3GYHTBS2NG5XRRYFRQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.703606734 (104h50m28.662703985s) [noise=true , address=104.36.82.37:4687 , piece_id=FADYVPRMFJSGSI5HYGV6EK7ZG737XAJKPVBEJT5DBR35IDSH2CHQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.717795385 (104h50m28.67689263s) [noise=true , address=104.36.82.46:4504 , piece_id=EOK5SPXMSV2EAWIGYV4KH3FL5UZJ3VAEFM2MTEL7FVQPSEKOLPNA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.724047348 (104h50m28.683144598s) [noise=true , address=104.36.82.12:4157 , piece_id=AQJGWUGUSM7IPZKMW4RCYAKLZCY7LSJXZLLWMFHGLBZKIVSBICVA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.731017629 (104h50m28.690127114s) [noise=true , address=104.36.82.38:4700 , piece_id=ENX2HTWXLE3A3GM6OTEWACNT7PLFR3WQYK65KQJZ2YVCC3QNSVJA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.732145736 (104h50m28.691242982s) [noise=true , address=104.36.82.58:4292 , piece_id=UK7NOKDH2ULHZDP2776XCSHNIXBBNYGERKOGTR3PLV5224SS7R3A, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.735511091 (104h50m28.694608339s) [noise=true , address=104.36.82.61:4401 , piece_id=FKLEGG5I42TBOPL7RPJA7MV6DYNZ4YXASMJKG7MIDBOEIHWD2JKA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.738768168 (104h50m28.697865418s) [noise=true , address=104.36.82.23:4461 , piece_id=GA3GHIUFXXTDES645UAANS4W6MAOVQEAYCEZEQWQ73Y7OA3OUUJQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: <nil>
Aug 13 02:16:06.738802337 (104h50m28.697899583s) [seg_pos={0 0}, upload=109250]: Segment reached optimal threshold of 14 pieces.
Aug 13 02:16:06.739024852 (104h50m28.698122104s) [noise=true , address=104.36.82.47:4536 , piece_id=V3XXXYJ6ORYMJ4N2X6H5K64Z2S3H4NWMCATRW2CDE3LRUZRICI7A, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WoVNAp5RfVviaxN4RWCUDEhxLKsdGB8bgE6gcUcgZKcM4Cz1s): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739146647 (104h50m28.6982439s) [noise=true , address=104.36.82.5:4864 , piece_id=G5KNNSF57AWYVVXAO7WJKZITPPSYHWUJHLOYF3PVZ3V3MREBSKBQ, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739340891 (104h50m28.698438141s) [noise=true , address=79.127.201.215:4356 , piece_id=EF5QMTTYUP4QT4B3HMIIZJWC344PGU5CDTECCPN72ZYS2JMOCS5Q, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739449958 (104h50m28.698547204s) [noise=true , address=104.36.82.18:4367 , piece_id=JUHFQFYXSWIAUGCAPQW77F6PLAUDGDKM2IW6PPPAMFU6S4AXD4PA, seg_pos={0 0}, upload=109250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6): protocol: expected piece hash; context canceled; EOF
Aug 13 02:16:06.739471195 (104h50m28.698568447s) [seg_pos={0 0}, upload=109250]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 02:16:06.739597424 (104h50m28.698694676s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 02:16:06.739605586 (104h50m28.698702836s) [upload=109250]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 02:16:07.666035646 (104h50m29.625132892s) [upload=109250]: Done uploading segments...
Aug 13 02:16:07.666058893 (104h50m29.625156138s) [upload=109250]: Upload finished. err: <nil>
Duration: 2.58332125s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [....X.............X..........X.X........................X...] duration:
863.09011ms
FAIL (2025-08-13 02:32:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil>
Duration: 863.171206ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|