Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X.......................................X.X....] duration:
2.969864434s
FAIL (2025-08-17 19:55:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 19:52:01.788726892 (218h26m23.747824146s) [upload=227428]: Starting upload Aug 17 19:52:01.788825720 (218h26m23.747922963s) [upload=227428]: Done starting upload Aug 17 19:52:01.788978470 (218h26m23.748075708s) [upload=227428]: Uploading segments... Aug 17 19:52:01.789370916 (218h26m23.748468172s) [upload=227428]: Got next segment. Inline: false Aug 17 19:52:01.789473647 (218h26m23.748570901s) [upload=227428]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 19:52:01.789482677 (218h26m23.748579931s) [upload=227428]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 19:52:01.879572257 (218h26m23.838669516s) [upload=227428]: Next segment err: metaclient: Too Many Requests Aug 17 19:52:01.879622017 (218h26m23.838719266s) [upload=227428]: Done uploading segments... Aug 17 19:52:01.879643639 (218h26m23.838740888s) [upload=227428]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.969898767s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X..............................................X.......] duration:
832.58961ms
FAIL (2025-08-17 19:54:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 19:49:00.294569790 (218h23m22.253667035s) [upload=227375]: Starting upload Aug 17 19:49:00.294632507 (218h23m22.253729755s) [upload=227375]: Done starting upload Aug 17 19:49:00.294721802 (218h23m22.253819034s) [upload=227375]: Uploading segments... Aug 17 19:49:00.294772600 (218h23m22.253869855s) [upload=227375]: Got next segment. Inline: true Aug 17 19:49:00.294777950 (218h23m22.253875195s) [upload=227375]: Waiting for error group managing segments... Aug 17 19:49:00.294827001 (218h23m22.253924246s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 19:49:00.294832173 (218h23m22.253929417s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 19:49:00.294834865 (218h23m22.253932111s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 19:49:00.464914020 (218h23m22.424011265s) [upload=227375]: Done uploading segments... Aug 17 19:49:00.464933629 (218h23m22.424030874s) [upload=227375]: Upload finished. err: metaclient: Too Many Requests
Duration: 832.621229ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X.......................................X.X...] duration:
2.56554021s
FAIL (2025-08-17 19:54:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 19:52:01.788726892 (218h26m23.747824146s) [upload=227428]: Starting upload Aug 17 19:52:01.788825720 (218h26m23.747922963s) [upload=227428]: Done starting upload Aug 17 19:52:01.788978470 (218h26m23.748075708s) [upload=227428]: Uploading segments... Aug 17 19:52:01.789370916 (218h26m23.748468172s) [upload=227428]: Got next segment. Inline: false Aug 17 19:52:01.789473647 (218h26m23.748570901s) [upload=227428]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 19:52:01.789482677 (218h26m23.748579931s) [upload=227428]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 19:52:01.879572257 (218h26m23.838669516s) [upload=227428]: Next segment err: metaclient: Too Many Requests Aug 17 19:52:01.879622017 (218h26m23.838719266s) [upload=227428]: Done uploading segments... Aug 17 19:52:01.879643639 (218h26m23.838740888s) [upload=227428]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.565574287s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
1.572886683s
FAIL (2025-08-17 19:54:10 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.572917377s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X..............................................X......] duration:
1.13627874s
FAIL (2025-08-17 19:53:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 19:49:00.294569790 (218h23m22.253667035s) [upload=227375]: Starting upload Aug 17 19:49:00.294632507 (218h23m22.253729755s) [upload=227375]: Done starting upload Aug 17 19:49:00.294721802 (218h23m22.253819034s) [upload=227375]: Uploading segments... Aug 17 19:49:00.294772600 (218h23m22.253869855s) [upload=227375]: Got next segment. Inline: true Aug 17 19:49:00.294777950 (218h23m22.253875195s) [upload=227375]: Waiting for error group managing segments... Aug 17 19:49:00.294827001 (218h23m22.253924246s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 19:49:00.294832173 (218h23m22.253929417s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 19:49:00.294834865 (218h23m22.253932111s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 19:49:00.464914020 (218h23m22.424011265s) [upload=227375]: Done uploading segments... Aug 17 19:49:00.464933629 (218h23m22.424030874s) [upload=227375]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.136328924s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X.......................................X.X..] duration:
2.514892273s
FAIL (2025-08-17 19:53:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 19:52:01.788726892 (218h26m23.747824146s) [upload=227428]: Starting upload Aug 17 19:52:01.788825720 (218h26m23.747922963s) [upload=227428]: Done starting upload Aug 17 19:52:01.788978470 (218h26m23.748075708s) [upload=227428]: Uploading segments... Aug 17 19:52:01.789370916 (218h26m23.748468172s) [upload=227428]: Got next segment. Inline: false Aug 17 19:52:01.789473647 (218h26m23.748570901s) [upload=227428]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 19:52:01.789482677 (218h26m23.748579931s) [upload=227428]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 19:52:01.879572257 (218h26m23.838669516s) [upload=227428]: Next segment err: metaclient: Too Many Requests Aug 17 19:52:01.879622017 (218h26m23.838719266s) [upload=227428]: Done uploading segments... Aug 17 19:52:01.879643639 (218h26m23.838740888s) [upload=227428]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.514950945s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
1.534804628s
FAIL (2025-08-17 19:53:07 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.53485265s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
1.545628757s
FAIL (2025-08-17 19:52:47 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.5456785s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X..............................................X.....] duration:
929.634295ms
FAIL (2025-08-17 19:52:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 19:49:00.294569790 (218h23m22.253667035s) [upload=227375]: Starting upload Aug 17 19:49:00.294632507 (218h23m22.253729755s) [upload=227375]: Done starting upload Aug 17 19:49:00.294721802 (218h23m22.253819034s) [upload=227375]: Uploading segments... Aug 17 19:49:00.294772600 (218h23m22.253869855s) [upload=227375]: Got next segment. Inline: true Aug 17 19:49:00.294777950 (218h23m22.253875195s) [upload=227375]: Waiting for error group managing segments... Aug 17 19:49:00.294827001 (218h23m22.253924246s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 19:49:00.294832173 (218h23m22.253929417s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 19:49:00.294834865 (218h23m22.253932111s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 19:49:00.464914020 (218h23m22.424011265s) [upload=227375]: Done uploading segments... Aug 17 19:49:00.464933629 (218h23m22.424030874s) [upload=227375]: Upload finished. err: metaclient: Too Many Requests
Duration: 929.670174ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X.......................................X.X.] duration:
2.522709189s
FAIL (2025-08-17 19:52:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 19:52:01.788726892 (218h26m23.747824146s) [upload=227428]: Starting upload Aug 17 19:52:01.788825720 (218h26m23.747922963s) [upload=227428]: Done starting upload Aug 17 19:52:01.788978470 (218h26m23.748075708s) [upload=227428]: Uploading segments... Aug 17 19:52:01.789370916 (218h26m23.748468172s) [upload=227428]: Got next segment. Inline: false Aug 17 19:52:01.789473647 (218h26m23.748570901s) [upload=227428]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 19:52:01.789482677 (218h26m23.748579931s) [upload=227428]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 19:52:01.879572257 (218h26m23.838669516s) [upload=227428]: Next segment err: metaclient: Too Many Requests Aug 17 19:52:01.879622017 (218h26m23.838719266s) [upload=227428]: Done uploading segments... Aug 17 19:52:01.879643639 (218h26m23.838740888s) [upload=227428]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.52274561s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X.......................................X.X] duration:
365.943501ms
FAIL (2025-08-17 19:52:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 19:52:01.788726892 (218h26m23.747824146s) [upload=227428]: Starting upload Aug 17 19:52:01.788825720 (218h26m23.747922963s) [upload=227428]: Done starting upload Aug 17 19:52:01.788978470 (218h26m23.748075708s) [upload=227428]: Uploading segments... Aug 17 19:52:01.789370916 (218h26m23.748468172s) [upload=227428]: Got next segment. Inline: false Aug 17 19:52:01.789473647 (218h26m23.748570901s) [upload=227428]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 19:52:01.789482677 (218h26m23.748579931s) [upload=227428]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 19:52:01.879572257 (218h26m23.838669516s) [upload=227428]: Next segment err: metaclient: Too Many Requests Aug 17 19:52:01.879622017 (218h26m23.838719266s) [upload=227428]: Done uploading segments... Aug 17 19:52:01.879643639 (218h26m23.838740888s) [upload=227428]: Upload finished. err: metaclient: Too Many Requests
Duration: 366.035824ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
1.520034575s
FAIL (2025-08-17 19:51:39 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.52007196s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X..............................................X....] duration:
945.332347ms
FAIL (2025-08-17 19:51:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 19:49:00.294569790 (218h23m22.253667035s) [upload=227375]: Starting upload Aug 17 19:49:00.294632507 (218h23m22.253729755s) [upload=227375]: Done starting upload Aug 17 19:49:00.294721802 (218h23m22.253819034s) [upload=227375]: Uploading segments... Aug 17 19:49:00.294772600 (218h23m22.253869855s) [upload=227375]: Got next segment. Inline: true Aug 17 19:49:00.294777950 (218h23m22.253875195s) [upload=227375]: Waiting for error group managing segments... Aug 17 19:49:00.294827001 (218h23m22.253924246s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 19:49:00.294832173 (218h23m22.253929417s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 19:49:00.294834865 (218h23m22.253932111s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 19:49:00.464914020 (218h23m22.424011265s) [upload=227375]: Done uploading segments... Aug 17 19:49:00.464933629 (218h23m22.424030874s) [upload=227375]: Upload finished. err: metaclient: Too Many Requests
Duration: 945.438991ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X..............................................X...] duration:
854.50792ms
FAIL (2025-08-17 19:50:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 19:49:00.294569790 (218h23m22.253667035s) [upload=227375]: Starting upload Aug 17 19:49:00.294632507 (218h23m22.253729755s) [upload=227375]: Done starting upload Aug 17 19:49:00.294721802 (218h23m22.253819034s) [upload=227375]: Uploading segments... Aug 17 19:49:00.294772600 (218h23m22.253869855s) [upload=227375]: Got next segment. Inline: true Aug 17 19:49:00.294777950 (218h23m22.253875195s) [upload=227375]: Waiting for error group managing segments... Aug 17 19:49:00.294827001 (218h23m22.253924246s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 19:49:00.294832173 (218h23m22.253929417s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 19:49:00.294834865 (218h23m22.253932111s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 19:49:00.464914020 (218h23m22.424011265s) [upload=227375]: Done uploading segments... Aug 17 19:49:00.464933629 (218h23m22.424030874s) [upload=227375]: Upload finished. err: metaclient: Too Many Requests
Duration: 854.542192ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X.......................................X.] duration:
2.458612752s
FAIL (2025-08-17 19:50:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 19:50:12.612618076 (218h24m34.571715312s) [upload=227397]: Starting upload
Aug 17 19:50:12.612674569 (218h24m34.571771815s) [upload=227397]: Done starting upload
Aug 17 19:50:12.612803980 (218h24m34.571901249s) [upload=227397]: Uploading segments...
Aug 17 19:50:12.612924170 (218h24m34.572021418s) [upload=227397]: Got next segment. Inline: false
Aug 17 19:50:12.612972193 (218h24m34.572069438s) [upload=227397]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:50:12.612978018 (218h24m34.572075262s) [upload=227397]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:50:12.827417825 (218h24m34.786515069s) [seg_pos={0 0}, upload=227397]: Begin upload segment...
Aug 17 19:50:12.827503787 (218h24m34.786601039s) [seg_pos={0 0}, upload=227397]: Done begin upload segment.
Aug 17 19:50:12.827713940 (218h24m34.786811189s) [noise=true , address=77.90.31.13:4638 , piece_id=EMY535EREIZGRNPSOU2ME2UZYSE4OES2CICC7JFITZHKAHRKHMTA, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.827783261 (218h24m34.78688051s) [noise=true , address=45.91.116.11:4125 , piece_id=HEBWSJV2VJ6SO72ZZ6CIMV46AOC7UPOUH7G3GQYLQSTLIQTIAMWQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.828518434 (218h24m34.787615694s) [noise=true , address=104.36.82.7:4921 , piece_id=MFK4Y4LYW3RZ7VEODQTSKJM5DDW6ZBUS2F6TA6M7J56X5NAAJEBA, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.829630373 (218h24m34.788727628s) [noise=true , address=77.90.31.21:4905 , piece_id=FQF2JSEXLKULOS7YIELXT26QP6JZXY27J3RDLYWGW4DI64S7HLOQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.830454961 (218h24m34.789552211s) [noise=true , address=77.90.31.16:4755 , piece_id=IWOX3KVMDJ7L3HTWPQUH6KW6INNYG64WP5BG5ADFJREJDIHV5TCQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.830538212 (218h24m34.789635458s) [noise=true , address=77.90.31.11:4563 , piece_id=VSE6CYAVSSSMEPQZ5UKRCSG7S47PDUBEPKCVEBXPYTZJ62IWITUQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.830872767 (218h24m34.789970015s) [noise=true , address=45.91.116.5:4306 , piece_id=42VJEYVCAQUZKWAIH3AEND2QGWPC7R7F3EQ6R2AHVCMNOKRSCLYQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.831171918 (218h24m34.790269171s) [noise=true , address=104.36.82.59:4333 , piece_id=64FAWHVTSVN2TLDB4FD2OGSZSRWQKTXF3ZVY6JI46U3FEAEVO7EQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.831491538 (218h24m34.790588789s) [noise=true , address=104.36.82.9:4025 , piece_id=7A7KH4AWRA4KELPVMKFCK45KV57UHQKWBYZ4ATOHD63EAOMS35FA, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.831673722 (218h24m34.790770972s) [noise=true , address=104.36.82.44:4903 , piece_id=V727FJGCZNDWOXEWG2ZHAPB2HZODFKE52GGYBFBPNA5COXOBLAZQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.832042665 (218h24m34.791139912s) [noise=true , address=77.90.31.13:4633 , piece_id=LXIITFV7NTBXHFQXXK5AOL6JJWWID645ZPHZZTQCOPK6IWEQBAOQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.832635149 (218h24m34.791732404s) [noise=true , address=45.91.116.12:4256 , piece_id=2N4QPWNECS6MQEHAXYAT5VAGC3MGDNMKW5EGU4B5IKNX2HASCASQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.834785917 (218h24m34.793883163s) [noise=true , address=45.91.116.6:4999 , piece_id=XQOFDJHH7BNT26LVZ2CGRYV42OLXBDOTRMZYZL2YWUYEDPIUWJ2Q, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.836768362 (218h24m34.795865616s) [noise=true , address=77.90.31.10:4533 , piece_id=MH6Q7U3DKFVADFB7ZKVOF5F2W4QID36GFIK3PKSKWOVREX64RZ4Q, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.837705930 (218h24m34.796803185s) [noise=true , address=77.90.31.18:4831 , piece_id=DFXARU2E2RBALEWOS6THGGJGQB7KNAXAT7Z4OHF7YKFB5PNWO3EQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.837835273 (218h24m34.796932524s) [noise=true , address=104.36.82.14:4252 , piece_id=7F5QX4SPB3QZECS7OS6MBX74NGJPUK7JKHOM5HNMQWUDT2GEQIEQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.838851357 (218h24m34.797948612s) [noise=true , address=104.36.82.16:4300 , piece_id=BRJMY76HFBKSIDTSXWNVKFXSSFIE5QYT4YUXJJCDXFWCDUI4JQXQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.839569766 (218h24m34.79866702s) [noise=true , address=104.36.82.60:4367 , piece_id=SW45NMHQ7UR7KVBUKTF22WLZHHHGBAF4B26VNSOUQQPUWNF6LCUQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:13.390182165 (218h24m35.3492794s) [upload=227397]: Next returned nil segment
Aug 17 19:50:13.390203324 (218h24m35.349300578s) [upload=227397]: Waiting for error group managing segments...
Aug 17 19:50:13.569586787 (218h24m35.528684026s) [noise=true , address=77.90.31.13:4638 , piece_id=EMY535EREIZGRNPSOU2ME2UZYSE4OES2CICC7JFITZHKAHRKHMTA, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.578996050 (218h24m35.538093297s) [noise=true , address=104.36.82.44:4903 , piece_id=V727FJGCZNDWOXEWG2ZHAPB2HZODFKE52GGYBFBPNA5COXOBLAZQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.583065963 (218h24m35.5421632s) [noise=true , address=77.90.31.10:4533 , piece_id=MH6Q7U3DKFVADFB7ZKVOF5F2W4QID36GFIK3PKSKWOVREX64RZ4Q, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.607112471 (218h24m35.566209708s) [noise=true , address=45.91.116.11:4125 , piece_id=HEBWSJV2VJ6SO72ZZ6CIMV46AOC7UPOUH7G3GQYLQSTLIQTIAMWQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.611915193 (218h24m35.571012431s) [noise=true , address=104.36.82.60:4367 , piece_id=SW45NMHQ7UR7KVBUKTF22WLZHHHGBAF4B26VNSOUQQPUWNF6LCUQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.613600752 (218h24m35.572697998s) [noise=true , address=77.90.31.18:4831 , piece_id=DFXARU2E2RBALEWOS6THGGJGQB7KNAXAT7Z4OHF7YKFB5PNWO3EQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.617192870 (218h24m35.576290101s) [noise=true , address=45.91.116.6:4999 , piece_id=XQOFDJHH7BNT26LVZ2CGRYV42OLXBDOTRMZYZL2YWUYEDPIUWJ2Q, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.618287229 (218h24m35.57738447s) [noise=true , address=104.36.82.16:4300 , piece_id=BRJMY76HFBKSIDTSXWNVKFXSSFIE5QYT4YUXJJCDXFWCDUI4JQXQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.620936724 (218h24m35.580033969s) [noise=true , address=104.36.82.9:4025 , piece_id=7A7KH4AWRA4KELPVMKFCK45KV57UHQKWBYZ4ATOHD63EAOMS35FA, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.631474282 (218h24m35.590571513s) [noise=true , address=77.90.31.11:4563 , piece_id=VSE6CYAVSSSMEPQZ5UKRCSG7S47PDUBEPKCVEBXPYTZJ62IWITUQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.640432367 (218h24m35.599529604s) [noise=true , address=45.91.116.5:4306 , piece_id=42VJEYVCAQUZKWAIH3AEND2QGWPC7R7F3EQ6R2AHVCMNOKRSCLYQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.667482012 (218h24m35.626579243s) [noise=true , address=104.36.82.14:4252 , piece_id=7F5QX4SPB3QZECS7OS6MBX74NGJPUK7JKHOM5HNMQWUDT2GEQIEQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.674486247 (218h24m35.633583486s) [noise=true , address=104.36.82.59:4333 , piece_id=64FAWHVTSVN2TLDB4FD2OGSZSRWQKTXF3ZVY6JI46U3FEAEVO7EQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.728433387 (218h24m35.687530634s) [noise=true , address=77.90.31.13:4633 , piece_id=LXIITFV7NTBXHFQXXK5AOL6JJWWID645ZPHZZTQCOPK6IWEQBAOQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.728468988 (218h24m35.687566237s) [seg_pos={0 0}, upload=227397]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:50:13.728754498 (218h24m35.687851747s) [noise=true , address=77.90.31.16:4755 , piece_id=IWOX3KVMDJ7L3HTWPQUH6KW6INNYG64WP5BG5ADFJREJDIHV5TCQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 17 19:50:13.728877282 (218h24m35.687974518s) [noise=true , address=104.36.82.7:4921 , piece_id=MFK4Y4LYW3RZ7VEODQTSKJM5DDW6ZBUS2F6TA6M7J56X5NAAJEBA, seg_pos={0 0}, upload=227397]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QKJQDHC2wE9GjN8T92Ah33d6dyA2z3tqM1jg8tUp3J7B8cHww): protocol: expected piece hash; context canceled; EOF
Aug 17 19:50:13.729114565 (218h24m35.688211812s) [noise=true , address=77.90.31.21:4905 , piece_id=FQF2JSEXLKULOS7YIELXT26QP6JZXY27J3RDLYWGW4DI64S7HLOQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1X5A7bLqMEQuaMbf9xZ7PDUD4161sz2QqdM9r59y3bsyPBJhaK): protocol: write tcp 139.59.144.22:53812->77.90.31.21:4905: use of closed network connection; write tcp 139.59.144.22:53812->77.90.31.21:4905: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53812->77.90.31.21:4905: use of closed network connection
Aug 17 19:50:13.729241296 (218h24m35.688338542s) [noise=true , address=45.91.116.12:4256 , piece_id=2N4QPWNECS6MQEHAXYAT5VAGC3MGDNMKW5EGU4B5IKNX2HASCASQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME): protocol: expected piece hash; context canceled; EOF
Aug 17 19:50:13.729268452 (218h24m35.688365705s) [seg_pos={0 0}, upload=227397]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:50:13.729374553 (218h24m35.688471802s) [upload=227397]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:50:13.729380754 (218h24m35.688478003s) [upload=227397]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:50:13.915482339 (218h24m35.874579579s) [upload=227397]: Done uploading segments...
Aug 17 19:50:13.915507370 (218h24m35.874604602s) [upload=227397]: Upload finished. err: <nil>
Duration: 2.458688134s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
1.566864447s
FAIL (2025-08-17 19:50:32 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.566895363s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X..............................................X..] duration:
839.607316ms
FAIL (2025-08-17 19:50:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 19:49:00.294569790 (218h23m22.253667035s) [upload=227375]: Starting upload Aug 17 19:49:00.294632507 (218h23m22.253729755s) [upload=227375]: Done starting upload Aug 17 19:49:00.294721802 (218h23m22.253819034s) [upload=227375]: Uploading segments... Aug 17 19:49:00.294772600 (218h23m22.253869855s) [upload=227375]: Got next segment. Inline: true Aug 17 19:49:00.294777950 (218h23m22.253875195s) [upload=227375]: Waiting for error group managing segments... Aug 17 19:49:00.294827001 (218h23m22.253924246s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 19:49:00.294832173 (218h23m22.253929417s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 19:49:00.294834865 (218h23m22.253932111s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 19:49:00.464914020 (218h23m22.424011265s) [upload=227375]: Done uploading segments... Aug 17 19:49:00.464933629 (218h23m22.424030874s) [upload=227375]: Upload finished. err: metaclient: Too Many Requests
Duration: 839.641531ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X.......................................X] duration:
1.881410983s
FAIL (2025-08-17 19:50:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 19:50:12.612618076 (218h24m34.571715312s) [upload=227397]: Starting upload
Aug 17 19:50:12.612674569 (218h24m34.571771815s) [upload=227397]: Done starting upload
Aug 17 19:50:12.612803980 (218h24m34.571901249s) [upload=227397]: Uploading segments...
Aug 17 19:50:12.612924170 (218h24m34.572021418s) [upload=227397]: Got next segment. Inline: false
Aug 17 19:50:12.612972193 (218h24m34.572069438s) [upload=227397]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:50:12.612978018 (218h24m34.572075262s) [upload=227397]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:50:12.827417825 (218h24m34.786515069s) [seg_pos={0 0}, upload=227397]: Begin upload segment...
Aug 17 19:50:12.827503787 (218h24m34.786601039s) [seg_pos={0 0}, upload=227397]: Done begin upload segment.
Aug 17 19:50:12.827713940 (218h24m34.786811189s) [noise=true , address=77.90.31.13:4638 , piece_id=EMY535EREIZGRNPSOU2ME2UZYSE4OES2CICC7JFITZHKAHRKHMTA, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.827783261 (218h24m34.78688051s) [noise=true , address=45.91.116.11:4125 , piece_id=HEBWSJV2VJ6SO72ZZ6CIMV46AOC7UPOUH7G3GQYLQSTLIQTIAMWQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.828518434 (218h24m34.787615694s) [noise=true , address=104.36.82.7:4921 , piece_id=MFK4Y4LYW3RZ7VEODQTSKJM5DDW6ZBUS2F6TA6M7J56X5NAAJEBA, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.829630373 (218h24m34.788727628s) [noise=true , address=77.90.31.21:4905 , piece_id=FQF2JSEXLKULOS7YIELXT26QP6JZXY27J3RDLYWGW4DI64S7HLOQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.830454961 (218h24m34.789552211s) [noise=true , address=77.90.31.16:4755 , piece_id=IWOX3KVMDJ7L3HTWPQUH6KW6INNYG64WP5BG5ADFJREJDIHV5TCQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.830538212 (218h24m34.789635458s) [noise=true , address=77.90.31.11:4563 , piece_id=VSE6CYAVSSSMEPQZ5UKRCSG7S47PDUBEPKCVEBXPYTZJ62IWITUQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.830872767 (218h24m34.789970015s) [noise=true , address=45.91.116.5:4306 , piece_id=42VJEYVCAQUZKWAIH3AEND2QGWPC7R7F3EQ6R2AHVCMNOKRSCLYQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.831171918 (218h24m34.790269171s) [noise=true , address=104.36.82.59:4333 , piece_id=64FAWHVTSVN2TLDB4FD2OGSZSRWQKTXF3ZVY6JI46U3FEAEVO7EQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.831491538 (218h24m34.790588789s) [noise=true , address=104.36.82.9:4025 , piece_id=7A7KH4AWRA4KELPVMKFCK45KV57UHQKWBYZ4ATOHD63EAOMS35FA, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.831673722 (218h24m34.790770972s) [noise=true , address=104.36.82.44:4903 , piece_id=V727FJGCZNDWOXEWG2ZHAPB2HZODFKE52GGYBFBPNA5COXOBLAZQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.832042665 (218h24m34.791139912s) [noise=true , address=77.90.31.13:4633 , piece_id=LXIITFV7NTBXHFQXXK5AOL6JJWWID645ZPHZZTQCOPK6IWEQBAOQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.832635149 (218h24m34.791732404s) [noise=true , address=45.91.116.12:4256 , piece_id=2N4QPWNECS6MQEHAXYAT5VAGC3MGDNMKW5EGU4B5IKNX2HASCASQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.834785917 (218h24m34.793883163s) [noise=true , address=45.91.116.6:4999 , piece_id=XQOFDJHH7BNT26LVZ2CGRYV42OLXBDOTRMZYZL2YWUYEDPIUWJ2Q, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.836768362 (218h24m34.795865616s) [noise=true , address=77.90.31.10:4533 , piece_id=MH6Q7U3DKFVADFB7ZKVOF5F2W4QID36GFIK3PKSKWOVREX64RZ4Q, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.837705930 (218h24m34.796803185s) [noise=true , address=77.90.31.18:4831 , piece_id=DFXARU2E2RBALEWOS6THGGJGQB7KNAXAT7Z4OHF7YKFB5PNWO3EQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.837835273 (218h24m34.796932524s) [noise=true , address=104.36.82.14:4252 , piece_id=7F5QX4SPB3QZECS7OS6MBX74NGJPUK7JKHOM5HNMQWUDT2GEQIEQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.838851357 (218h24m34.797948612s) [noise=true , address=104.36.82.16:4300 , piece_id=BRJMY76HFBKSIDTSXWNVKFXSSFIE5QYT4YUXJJCDXFWCDUI4JQXQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:12.839569766 (218h24m34.79866702s) [noise=true , address=104.36.82.60:4367 , piece_id=SW45NMHQ7UR7KVBUKTF22WLZHHHGBAF4B26VNSOUQQPUWNF6LCUQ, seg_pos={0 0}, upload=227397]: Uploading piece...
Aug 17 19:50:13.390182165 (218h24m35.3492794s) [upload=227397]: Next returned nil segment
Aug 17 19:50:13.390203324 (218h24m35.349300578s) [upload=227397]: Waiting for error group managing segments...
Aug 17 19:50:13.569586787 (218h24m35.528684026s) [noise=true , address=77.90.31.13:4638 , piece_id=EMY535EREIZGRNPSOU2ME2UZYSE4OES2CICC7JFITZHKAHRKHMTA, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.578996050 (218h24m35.538093297s) [noise=true , address=104.36.82.44:4903 , piece_id=V727FJGCZNDWOXEWG2ZHAPB2HZODFKE52GGYBFBPNA5COXOBLAZQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.583065963 (218h24m35.5421632s) [noise=true , address=77.90.31.10:4533 , piece_id=MH6Q7U3DKFVADFB7ZKVOF5F2W4QID36GFIK3PKSKWOVREX64RZ4Q, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.607112471 (218h24m35.566209708s) [noise=true , address=45.91.116.11:4125 , piece_id=HEBWSJV2VJ6SO72ZZ6CIMV46AOC7UPOUH7G3GQYLQSTLIQTIAMWQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.611915193 (218h24m35.571012431s) [noise=true , address=104.36.82.60:4367 , piece_id=SW45NMHQ7UR7KVBUKTF22WLZHHHGBAF4B26VNSOUQQPUWNF6LCUQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.613600752 (218h24m35.572697998s) [noise=true , address=77.90.31.18:4831 , piece_id=DFXARU2E2RBALEWOS6THGGJGQB7KNAXAT7Z4OHF7YKFB5PNWO3EQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.617192870 (218h24m35.576290101s) [noise=true , address=45.91.116.6:4999 , piece_id=XQOFDJHH7BNT26LVZ2CGRYV42OLXBDOTRMZYZL2YWUYEDPIUWJ2Q, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.618287229 (218h24m35.57738447s) [noise=true , address=104.36.82.16:4300 , piece_id=BRJMY76HFBKSIDTSXWNVKFXSSFIE5QYT4YUXJJCDXFWCDUI4JQXQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.620936724 (218h24m35.580033969s) [noise=true , address=104.36.82.9:4025 , piece_id=7A7KH4AWRA4KELPVMKFCK45KV57UHQKWBYZ4ATOHD63EAOMS35FA, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.631474282 (218h24m35.590571513s) [noise=true , address=77.90.31.11:4563 , piece_id=VSE6CYAVSSSMEPQZ5UKRCSG7S47PDUBEPKCVEBXPYTZJ62IWITUQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.640432367 (218h24m35.599529604s) [noise=true , address=45.91.116.5:4306 , piece_id=42VJEYVCAQUZKWAIH3AEND2QGWPC7R7F3EQ6R2AHVCMNOKRSCLYQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.667482012 (218h24m35.626579243s) [noise=true , address=104.36.82.14:4252 , piece_id=7F5QX4SPB3QZECS7OS6MBX74NGJPUK7JKHOM5HNMQWUDT2GEQIEQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.674486247 (218h24m35.633583486s) [noise=true , address=104.36.82.59:4333 , piece_id=64FAWHVTSVN2TLDB4FD2OGSZSRWQKTXF3ZVY6JI46U3FEAEVO7EQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.728433387 (218h24m35.687530634s) [noise=true , address=77.90.31.13:4633 , piece_id=LXIITFV7NTBXHFQXXK5AOL6JJWWID645ZPHZZTQCOPK6IWEQBAOQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: <nil>
Aug 17 19:50:13.728468988 (218h24m35.687566237s) [seg_pos={0 0}, upload=227397]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:50:13.728754498 (218h24m35.687851747s) [noise=true , address=77.90.31.16:4755 , piece_id=IWOX3KVMDJ7L3HTWPQUH6KW6INNYG64WP5BG5ADFJREJDIHV5TCQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 17 19:50:13.728877282 (218h24m35.687974518s) [noise=true , address=104.36.82.7:4921 , piece_id=MFK4Y4LYW3RZ7VEODQTSKJM5DDW6ZBUS2F6TA6M7J56X5NAAJEBA, seg_pos={0 0}, upload=227397]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QKJQDHC2wE9GjN8T92Ah33d6dyA2z3tqM1jg8tUp3J7B8cHww): protocol: expected piece hash; context canceled; EOF
Aug 17 19:50:13.729114565 (218h24m35.688211812s) [noise=true , address=77.90.31.21:4905 , piece_id=FQF2JSEXLKULOS7YIELXT26QP6JZXY27J3RDLYWGW4DI64S7HLOQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1X5A7bLqMEQuaMbf9xZ7PDUD4161sz2QqdM9r59y3bsyPBJhaK): protocol: write tcp 139.59.144.22:53812->77.90.31.21:4905: use of closed network connection; write tcp 139.59.144.22:53812->77.90.31.21:4905: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53812->77.90.31.21:4905: use of closed network connection
Aug 17 19:50:13.729241296 (218h24m35.688338542s) [noise=true , address=45.91.116.12:4256 , piece_id=2N4QPWNECS6MQEHAXYAT5VAGC3MGDNMKW5EGU4B5IKNX2HASCASQ, seg_pos={0 0}, upload=227397]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V53FpFLqgnXXEZSaUboULEwVpygzejqxEWdLgATj9MJVzacME): protocol: expected piece hash; context canceled; EOF
Aug 17 19:50:13.729268452 (218h24m35.688365705s) [seg_pos={0 0}, upload=227397]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:50:13.729374553 (218h24m35.688471802s) [upload=227397]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:50:13.729380754 (218h24m35.688478003s) [upload=227397]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:50:13.915482339 (218h24m35.874579579s) [upload=227397]: Done uploading segments...
Aug 17 19:50:13.915507370 (218h24m35.874604602s) [upload=227397]: Upload finished. err: <nil>
Duration: 1.881439364s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
1.610713961s
FAIL (2025-08-17 19:50:06 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.610815288s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.620592529s
FAIL (2025-08-17 19:49:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.620617861s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X..............................................X.] duration:
966.618101ms
FAIL (2025-08-17 19:49:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 19:49:00.294569790 (218h23m22.253667035s) [upload=227375]: Starting upload Aug 17 19:49:00.294632507 (218h23m22.253729755s) [upload=227375]: Done starting upload Aug 17 19:49:00.294721802 (218h23m22.253819034s) [upload=227375]: Uploading segments... Aug 17 19:49:00.294772600 (218h23m22.253869855s) [upload=227375]: Got next segment. Inline: true Aug 17 19:49:00.294777950 (218h23m22.253875195s) [upload=227375]: Waiting for error group managing segments... Aug 17 19:49:00.294827001 (218h23m22.253924246s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 19:49:00.294832173 (218h23m22.253929417s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 19:49:00.294834865 (218h23m22.253932111s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 19:49:00.464914020 (218h23m22.424011265s) [upload=227375]: Done uploading segments... Aug 17 19:49:00.464933629 (218h23m22.424030874s) [upload=227375]: Upload finished. err: metaclient: Too Many Requests
Duration: 966.660527ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
1.5054615s
FAIL (2025-08-17 19:49:08 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.505504439s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X..............................................X] duration:
451.369732ms
FAIL (2025-08-17 19:49:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 19:49:00.294569790 (218h23m22.253667035s) [upload=227375]: Starting upload Aug 17 19:49:00.294632507 (218h23m22.253729755s) [upload=227375]: Done starting upload Aug 17 19:49:00.294721802 (218h23m22.253819034s) [upload=227375]: Uploading segments... Aug 17 19:49:00.294772600 (218h23m22.253869855s) [upload=227375]: Got next segment. Inline: true Aug 17 19:49:00.294777950 (218h23m22.253875195s) [upload=227375]: Waiting for error group managing segments... Aug 17 19:49:00.294827001 (218h23m22.253924246s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 19:49:00.294832173 (218h23m22.253929417s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 19:49:00.294834865 (218h23m22.253932111s) [upload=227375]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 19:49:00.464914020 (218h23m22.424011265s) [upload=227375]: Done uploading segments... Aug 17 19:49:00.464933629 (218h23m22.424030874s) [upload=227375]: Upload finished. err: metaclient: Too Many Requests
Duration: 451.457273ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.559521911s
FAIL (2025-08-17 19:48:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.559575442s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
902.24013ms
FAIL (2025-08-17 19:48:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 902.298163ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
1.493955806s
FAIL (2025-08-17 19:48:23 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.493994861s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.652046864s
FAIL (2025-08-17 19:48:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.652079023s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
938.288856ms
FAIL (2025-08-17 19:47:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 938.321005ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.697452382s
FAIL (2025-08-17 19:47:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.69749344s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
1.57022485s
FAIL (2025-08-17 19:47:18 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.570255045s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.743142331s
FAIL (2025-08-17 19:47:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.743177968s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
1.030251318s
FAIL (2025-08-17 19:46:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 1.030282819s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
1.513159611s
FAIL (2025-08-17 19:46:29 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.51319016s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
895.561086ms
FAIL (2025-08-17 19:46:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 895.611742ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.827410036s
FAIL (2025-08-17 19:46:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.827468726s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
1.514210346s
FAIL (2025-08-17 19:46:13 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.514234053s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.598615753s
FAIL (2025-08-17 19:46:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.598654422s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
1.495682106s
FAIL (2025-08-17 19:45:26 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.495713761s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.730685129s
FAIL (2025-08-17 19:45:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.730735581s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
938.159238ms
FAIL (2025-08-17 19:45:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 938.190084ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
1.50905786s
FAIL (2025-08-17 19:44:21 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.50909656s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.915468118s
FAIL (2025-08-17 19:44:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.915516465s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
1.403541607s
FAIL (2025-08-17 19:44:06 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 1.40358036s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
1.265089553s
FAIL (2025-08-17 19:43:44 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 1.265122s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
1.494657941s
FAIL (2025-08-17 19:43:16 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.494703782s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.967077289s
FAIL (2025-08-17 19:43:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.967111272s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
1.01448571s
FAIL (2025-08-17 19:42:51 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 1.014519983s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
996.533692ms
FAIL (2025-08-17 19:42:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 996.62998ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
1.548890742s
FAIL (2025-08-17 19:42:23 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.548920704s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
3.090096472s
FAIL (2025-08-17 19:41:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 3.090126151s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|