Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
16 out of 60 is failed (threshold=3) [............................................XXXXXXXXXXXXXXXX] duration:
139.189378ms trace:
https://jaeger.dev.storj.io/trace/12246c64d00acf4
FAIL (2026-03-10 14:35:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:35:11.307913613 (10m55.816024399s) [upload=175]: Starting upload Mar 10 14:35:11.307968631 (10m55.816079456s) [upload=175]: Done starting upload Mar 10 14:35:11.308433680 (10m55.816544472s) [upload=175]: Uploading segments... Mar 10 14:35:11.308518710 (10m55.816629506s) [upload=175]: Got next segment. Inline: false Mar 10 14:35:11.308555785 (10m55.816666558s) [upload=175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:35:11.308560872 (10m55.816671658s) [upload=175]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:35:11.370641042 (10m55.878751837s) [upload=175]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:35:11.370666360 (10m55.878777157s) [upload=175]: Done uploading segments... Mar 10 14:35:11.370734345 (10m55.878845117s) [upload=175]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 139.21562ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
15 out of 60 is failed (threshold=3) [.............................................XXXXXXXXXXXXXXX] duration:
108.449318ms trace:
https://jaeger.dev.storj.io/trace/1ec0a40cf931eca1
FAIL (2026-03-10 14:34:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:34:23.285433167 (10m7.793543952s) [upload=163]: Starting upload Mar 10 14:34:23.285480469 (10m7.793591262s) [upload=163]: Done starting upload Mar 10 14:34:23.285630071 (10m7.793740846s) [upload=163]: Uploading segments... Mar 10 14:34:23.285775344 (10m7.793886118s) [upload=163]: Got next segment. Inline: false Mar 10 14:34:23.285819345 (10m7.79393013s) [upload=163]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:34:23.285824572 (10m7.793935358s) [upload=163]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:34:23.339485235 (10m7.847596046s) [upload=163]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:34:23.339528379 (10m7.847639151s) [upload=163]: Done uploading segments... Mar 10 14:34:23.339601210 (10m7.847711996s) [upload=163]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 108.474128ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
14 out of 60 is failed (threshold=3) [..............................................XXXXXXXXXXXXXX] duration:
126.755965ms trace:
https://jaeger.dev.storj.io/trace/27da38c39d4b9121
FAIL (2026-03-10 14:33:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:33:33.119123684 (9m17.62723448s) [upload=148]: Starting upload Mar 10 14:33:33.119175995 (9m17.627286783s) [upload=148]: Done starting upload Mar 10 14:33:33.119289420 (9m17.627400204s) [upload=148]: Uploading segments... Mar 10 14:33:33.119596790 (9m17.627707579s) [upload=148]: Got next segment. Inline: false Mar 10 14:33:33.119674295 (9m17.627785088s) [upload=148]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:33:33.119681349 (9m17.627792136s) [upload=148]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:33:33.177030623 (9m17.685141411s) [upload=148]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:33:33.177054463 (9m17.685165248s) [upload=148]: Done uploading segments... Mar 10 14:33:33.177099910 (9m17.685210695s) [upload=148]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 126.776147ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
13 out of 60 is failed (threshold=3) [...............................................XXXXXXXXXXXXX] duration:
137.535485ms trace:
https://jaeger.dev.storj.io/trace/1205cdbda81944cc
FAIL (2026-03-10 14:32:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:32:29.481382103 (8m13.989492889s) [upload=129]: Starting upload Mar 10 14:32:29.481425697 (8m13.989536482s) [upload=129]: Done starting upload Mar 10 14:32:29.481539141 (8m13.989649917s) [upload=129]: Uploading segments... Mar 10 14:32:29.481690059 (8m13.989800844s) [upload=129]: Got next segment. Inline: false Mar 10 14:32:29.481729911 (8m13.989840696s) [upload=129]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:32:29.481734995 (8m13.98984578s) [upload=129]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:32:29.549636019 (8m14.057746805s) [upload=129]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:32:29.549656929 (8m14.05776773s) [upload=129]: Done uploading segments... Mar 10 14:32:29.549719917 (8m14.057830691s) [upload=129]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 137.564269ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
12 out of 60 is failed (threshold=3) [................................................XXXXXXXXXXXX] duration:
120.245774ms trace:
https://jaeger.dev.storj.io/trace/1cd37ee5feaffc8d
FAIL (2026-03-10 14:31:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:31:58.720431807 (7m43.228542592s) [upload=122]: Starting upload Mar 10 14:31:58.720624978 (7m43.228735763s) [upload=122]: Done starting upload Mar 10 14:31:58.720670414 (7m43.228781199s) [upload=122]: Uploading segments... Mar 10 14:31:58.721051891 (7m43.229162676s) [upload=122]: Got next segment. Inline: false Mar 10 14:31:58.721083969 (7m43.229194757s) [upload=122]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:31:58.721088409 (7m43.22919918s) [upload=122]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:31:58.781464782 (7m43.289575584s) [upload=122]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:31:58.781484593 (7m43.289595387s) [upload=122]: Done uploading segments... Mar 10 14:31:58.781515299 (7m43.289626083s) [upload=122]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 120.266576ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
11 out of 60 is failed (threshold=3) [.................................................XXXXXXXXXXX] duration:
128.111228ms trace:
https://jaeger.dev.storj.io/trace/7366fdeace85632c
FAIL (2026-03-10 14:31:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:31:30.662580762 (7m15.170691548s) [upload=115]: Starting upload Mar 10 14:31:30.662645913 (7m15.170756692s) [upload=115]: Done starting upload Mar 10 14:31:30.662718298 (7m15.170829084s) [upload=115]: Uploading segments... Mar 10 14:31:30.663129897 (7m15.171240682s) [upload=115]: Got next segment. Inline: false Mar 10 14:31:30.663216213 (7m15.171326999s) [upload=115]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:31:30.663222381 (7m15.171333156s) [upload=115]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:31:30.733694455 (7m15.241805247s) [upload=115]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:31:30.733724041 (7m15.241834829s) [upload=115]: Done uploading segments... Mar 10 14:31:30.733768155 (7m15.241878929s) [upload=115]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 128.136834ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
10 out of 60 is failed (threshold=3) [..................................................XXXXXXXXXX] duration:
116.502962ms trace:
https://jaeger.dev.storj.io/trace/62dbb37cd4e41505
FAIL (2026-03-10 14:30:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:30:35.225426114 (6m19.733536902s) [upload=99]: Starting upload Mar 10 14:30:35.225475416 (6m19.733586193s) [upload=99]: Done starting upload Mar 10 14:30:35.225793334 (6m19.733904111s) [upload=99]: Uploading segments... Mar 10 14:30:35.225852328 (6m19.733963122s) [upload=99]: Got next segment. Inline: false Mar 10 14:30:35.225889721 (6m19.734000511s) [upload=99]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:30:35.225895097 (6m19.734005887s) [upload=99]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:30:35.273953865 (6m19.782064658s) [upload=99]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:30:35.273972255 (6m19.782083045s) [upload=99]: Done uploading segments... Mar 10 14:30:35.274039408 (6m19.782150194s) [upload=99]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 116.523858ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
9 out of 60 is failed (threshold=3) [...................................................XXXXXXXXX] duration:
111.171988ms trace:
https://jaeger.dev.storj.io/trace/610a4da02bb113d2
FAIL (2026-03-10 14:29:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:29:40.534056999 (5m25.042167796s) [upload=84]: Starting upload Mar 10 14:29:40.534122823 (5m25.042233608s) [upload=84]: Done starting upload Mar 10 14:29:40.534226419 (5m25.042337197s) [upload=84]: Uploading segments... Mar 10 14:29:40.534489612 (5m25.042600388s) [upload=84]: Got next segment. Inline: false Mar 10 14:29:40.534544111 (5m25.042654905s) [upload=84]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:29:40.534550726 (5m25.04266152s) [upload=84]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:29:40.590920693 (5m25.099031478s) [upload=84]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:29:40.590939727 (5m25.099050505s) [upload=84]: Done uploading segments... Mar 10 14:29:40.590989268 (5m25.099100054s) [upload=84]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 111.192554ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
8 out of 60 is failed (threshold=3) [....................................................XXXXXXXX] duration:
194.928597ms trace:
https://jaeger.dev.storj.io/trace/40d4aac696560ce2
FAIL (2026-03-10 14:28:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:28:52.760122771 (4m37.268233556s) [upload=71]: Starting upload Mar 10 14:28:52.760178894 (4m37.268289685s) [upload=71]: Done starting upload Mar 10 14:28:52.760313947 (4m37.268424734s) [upload=71]: Uploading segments... Mar 10 14:28:52.760468862 (4m37.268579633s) [upload=71]: Got next segment. Inline: false Mar 10 14:28:52.760647809 (4m37.268758594s) [upload=71]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:28:52.760667514 (4m37.268778298s) [upload=71]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:28:52.878678543 (4m37.386789338s) [upload=71]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:28:52.878700119 (4m37.386810914s) [upload=71]: Done uploading segments... Mar 10 14:28:52.878746706 (4m37.386857494s) [upload=71]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 194.955879ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
7 out of 60 is failed (threshold=3) [.....................................................XXXXXXX] duration:
117.39819ms trace:
https://jaeger.dev.storj.io/trace/24674c8e79cd5148
FAIL (2026-03-10 14:28:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:28:36.419312243 (4m20.927423038s) [upload=68]: Starting upload Mar 10 14:28:36.419415552 (4m20.927526334s) [upload=68]: Done starting upload Mar 10 14:28:36.419596080 (4m20.927706876s) [upload=68]: Uploading segments... Mar 10 14:28:36.419860059 (4m20.927970843s) [upload=68]: Got next segment. Inline: false Mar 10 14:28:36.419931303 (4m20.928042097s) [upload=68]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:28:36.419943551 (4m20.928054344s) [upload=68]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:28:36.466975596 (4m20.975086412s) [upload=68]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:28:36.467018094 (4m20.975128885s) [upload=68]: Done uploading segments... Mar 10 14:28:36.467068420 (4m20.975179201s) [upload=68]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 117.41548ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
6 out of 60 is failed (threshold=3) [......................................................XXXXXX] duration:
114.821747ms trace:
https://jaeger.dev.storj.io/trace/49fce432b5caa85b
FAIL (2026-03-10 14:28:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:28:04.417107609 (3m48.925218394s) [upload=59]: Starting upload Mar 10 14:28:04.417164472 (3m48.925275263s) [upload=59]: Done starting upload Mar 10 14:28:04.417268001 (3m48.925378786s) [upload=59]: Uploading segments... Mar 10 14:28:04.417453788 (3m48.925564573s) [upload=59]: Got next segment. Inline: false Mar 10 14:28:04.417515992 (3m48.925626778s) [upload=59]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:28:04.417521791 (3m48.925632577s) [upload=59]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:28:04.475830385 (3m48.98394117s) [upload=59]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:28:04.475852732 (3m48.983963516s) [upload=59]: Done uploading segments... Mar 10 14:28:04.475897409 (3m48.984008194s) [upload=59]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 114.845271ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
5 out of 60 is failed (threshold=3) [.......................................................XXXXX] duration:
131.879722ms trace:
https://jaeger.dev.storj.io/trace/39d9a4dbc10d1a15
FAIL (2026-03-10 14:27:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:27:46.425312505 (3m30.933423293s) [upload=51]: Starting upload Mar 10 14:27:46.425356488 (3m30.933467282s) [upload=51]: Done starting upload Mar 10 14:27:46.425681655 (3m30.93379243s) [upload=51]: Uploading segments... Mar 10 14:27:46.425746370 (3m30.933857164s) [upload=51]: Got next segment. Inline: false Mar 10 14:27:46.425885135 (3m30.933995925s) [upload=51]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:27:46.425892531 (3m30.934003319s) [upload=51]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:27:46.474752943 (3m30.982863716s) [upload=51]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:27:46.474782626 (3m30.982893411s) [upload=51]: Done uploading segments... Mar 10 14:27:46.474820066 (3m30.982930837s) [upload=51]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 131.908142ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [........................................................XXXX] duration:
120.85231ms trace:
https://jaeger.dev.storj.io/trace/3bef572c2cc9513a
FAIL (2026-03-10 14:26:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:26:33.567486500 (2m18.075597285s) [upload=36]: Starting upload Mar 10 14:26:33.567541409 (2m18.075652195s) [upload=36]: Done starting upload Mar 10 14:26:33.567633145 (2m18.075743921s) [upload=36]: Uploading segments... Mar 10 14:26:33.567860287 (2m18.075971072s) [upload=36]: Got next segment. Inline: false Mar 10 14:26:33.567909291 (2m18.076020076s) [upload=36]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:26:33.567926709 (2m18.076037494s) [upload=36]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:26:33.630579195 (2m18.138689971s) [upload=36]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:26:33.630597850 (2m18.138708638s) [upload=36]: Done uploading segments... Mar 10 14:26:33.630650233 (2m18.138761009s) [upload=36]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 120.931583ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX] duration:
154.90524ms trace:
https://jaeger.dev.storj.io/trace/2363f5e54047711f
FAIL (2026-03-10 14:26:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:26:11.953542488 (1m56.461653281s) [upload=28]: Starting upload Mar 10 14:26:11.953630032 (1m56.461740821s) [upload=28]: Done starting upload Mar 10 14:26:11.953736545 (1m56.46184732s) [upload=28]: Uploading segments... Mar 10 14:26:11.954101423 (1m56.462212218s) [upload=28]: Got next segment. Inline: false Mar 10 14:26:11.954206145 (1m56.462316939s) [upload=28]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:26:11.954213546 (1m56.462324335s) [upload=28]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:26:12.028218858 (1m56.536329653s) [upload=28]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:26:12.028244371 (1m56.536355166s) [upload=28]: Done uploading segments... Mar 10 14:26:12.028290711 (1m56.536401497s) [upload=28]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 154.993139ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
166.719887ms trace:
https://jaeger.dev.storj.io/trace/2b086f3dd0da1b89
FAIL (2026-03-10 14:25:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:25:29.126340002 (1m13.634450787s) [upload=17]: Starting upload Mar 10 14:25:29.126394976 (1m13.63450577s) [upload=17]: Done starting upload Mar 10 14:25:29.126542969 (1m13.634653756s) [upload=17]: Uploading segments... Mar 10 14:25:29.127529040 (1m13.635639829s) [upload=17]: Got next segment. Inline: false Mar 10 14:25:29.127604901 (1m13.635715691s) [upload=17]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:25:29.127612059 (1m13.635722856s) [upload=17]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:25:29.239589511 (1m13.747700296s) [upload=17]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:25:29.239617293 (1m13.747728078s) [upload=17]: Done uploading segments... Mar 10 14:25:29.239697001 (1m13.747807775s) [upload=17]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 166.767719ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
143.019712ms trace:
https://jaeger.dev.storj.io/trace/2018596e9ea518fc
FAIL (2026-03-10 14:25:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:25:04.391190882 (48.899301668s) [upload=10]: Starting upload Mar 10 14:25:04.391240404 (48.899351198s) [upload=10]: Done starting upload Mar 10 14:25:04.391335544 (48.899446319s) [upload=10]: Uploading segments... Mar 10 14:25:04.391588060 (48.899698847s) [upload=10]: Got next segment. Inline: false Mar 10 14:25:04.391658435 (48.899769221s) [upload=10]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:25:04.391665429 (48.899776214s) [upload=10]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:25:04.470070819 (48.978181609s) [upload=10]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:25:04.470108174 (48.978218969s) [upload=10]: Done uploading segments... Mar 10 14:25:04.470154163 (48.97826495s) [upload=10]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 143.049518ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................] duration:
1.778016722s trace:
https://jaeger.dev.storj.io/trace/25521f98cb0a0056
FAIL (2026-03-10 14:24:01 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.778043168s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................] duration:
1.69735576s trace:
https://jaeger.dev.storj.io/trace/25521f98cb0a0056
FAIL (2026-03-10 14:23:37 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.697379364s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
22 out of 60 is failed (threshold=3) [......................................XXXXXXXXXXXXXXXXXXXXXX] duration:
106.71715ms trace:
https://jaeger.dev.storj.io/trace/2da1340e3145fbb4
FAIL (2026-03-10 14:23:36 UTC)
operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:23:36.513558782 (99h22m56.326050729s) [upload=95335]: Starting upload Mar 10 14:23:36.513637731 (99h22m56.326129681s) [upload=95335]: Done starting upload Mar 10 14:23:36.513738114 (99h22m56.326230058s) [upload=95335]: Uploading segments... Mar 10 14:23:36.513973591 (99h22m56.326465525s) [upload=95335]: Got next segment. Inline: false Mar 10 14:23:36.514018076 (99h22m56.32651002s) [upload=95335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:23:36.514024027 (99h22m56.326515971s) [upload=95335]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:23:36.554911337 (99h22m56.367403291s) [upload=95335]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:23:36.554952440 (99h22m56.367444391s) [upload=95335]: Done uploading segments... Mar 10 14:23:36.554999283 (99h22m56.36749122s) [upload=95335]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 106.737263ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
21 out of 60 is failed (threshold=3) [.......................................XXXXXXXXXXXXXXXXXXXXX] duration:
155.220738ms trace:
https://jaeger.dev.storj.io/trace/563187913baddbdf
FAIL (2026-03-10 14:22:28 UTC)
operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:22:28.573363801 (99h21m48.385855749s) [upload=95316]: Starting upload Mar 10 14:22:28.573438020 (99h21m48.385929966s) [upload=95316]: Done starting upload Mar 10 14:22:28.573537970 (99h21m48.386029905s) [upload=95316]: Uploading segments... Mar 10 14:22:28.573850069 (99h21m48.386342019s) [upload=95316]: Got next segment. Inline: false Mar 10 14:22:28.573952944 (99h21m48.386444888s) [upload=95316]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:22:28.573960831 (99h21m48.386452812s) [upload=95316]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:22:28.637280045 (99h21m48.449771991s) [upload=95316]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:22:28.637301923 (99h21m48.449793872s) [upload=95316]: Done uploading segments... Mar 10 14:22:28.637341353 (99h21m48.449833288s) [upload=95316]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 155.257487ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................] duration:
1.716100849s trace:
https://jaeger.dev.storj.io/trace/25521f98cb0a0056
FAIL (2026-03-10 14:22:25 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.716125557s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......X.....................................................] duration:
1.563269507s trace:
https://jaeger.dev.storj.io/trace/25521f98cb0a0056
FAIL (2026-03-10 14:21:55 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.563291407s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
20 out of 60 is failed (threshold=3) [........................................XXXXXXXXXXXXXXXXXXXX] duration:
101.04447ms trace:
https://jaeger.dev.storj.io/trace/5d3caf5376c7d07c
FAIL (2026-03-10 14:21:30 UTC)
operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:21:30.477330790 (99h20m50.289822748s) [upload=95301]: Starting upload Mar 10 14:21:30.477466832 (99h20m50.289958809s) [upload=95301]: Done starting upload Mar 10 14:21:30.478095285 (99h20m50.290587232s) [upload=95301]: Uploading segments... Mar 10 14:21:30.478670971 (99h20m50.291162928s) [upload=95301]: Got next segment. Inline: false Mar 10 14:21:30.478745021 (99h20m50.291236979s) [upload=95301]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:21:30.478752962 (99h20m50.29124491s) [upload=95301]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:21:30.517351732 (99h20m50.329843696s) [upload=95301]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:21:30.517378918 (99h20m50.329871064s) [upload=95301]: Done uploading segments... Mar 10 14:21:30.517426795 (99h20m50.32991874s) [upload=95301]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 101.1444ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................] duration:
2.090697646s trace:
https://jaeger.dev.storj.io/trace/25521f98cb0a0056
FAIL (2026-03-10 14:21:28 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.090745647s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
19 out of 60 is failed (threshold=3) [.........................................XXXXXXXXXXXXXXXXXXX] duration:
109.253492ms trace:
https://jaeger.dev.storj.io/trace/156878e85b2b92d0
FAIL (2026-03-10 14:20:49 UTC)
operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:20:49.443916528 (99h20m9.256408473s) [upload=95292]: Starting upload Mar 10 14:20:49.443973798 (99h20m9.256465743s) [upload=95292]: Done starting upload Mar 10 14:20:49.444130733 (99h20m9.256622687s) [upload=95292]: Uploading segments... Mar 10 14:20:49.444357994 (99h20m9.256849928s) [upload=95292]: Got next segment. Inline: false Mar 10 14:20:49.444430153 (99h20m9.256922109s) [upload=95292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:20:49.444437061 (99h20m9.256929015s) [upload=95292]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:20:49.493678770 (99h20m9.306170717s) [upload=95292]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:20:49.493701172 (99h20m9.306193117s) [upload=95292]: Done uploading segments... Mar 10 14:20:49.493750008 (99h20m9.306241951s) [upload=95292]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 109.278094ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
18 out of 60 is failed (threshold=3) [..........................................XXXXXXXXXXXXXXXXXX] duration:
118.241645ms trace:
https://jaeger.dev.storj.io/trace/323737e63953fd91
FAIL (2026-03-10 14:20:33 UTC)
operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:20:32.987555393 (99h19m52.80004735s) [upload=95289]: Starting upload Mar 10 14:20:32.987662875 (99h19m52.800154827s) [upload=95289]: Done starting upload Mar 10 14:20:32.987738329 (99h19m52.800230267s) [upload=95289]: Uploading segments... Mar 10 14:20:32.988148246 (99h19m52.800640189s) [upload=95289]: Got next segment. Inline: false Mar 10 14:20:32.988219490 (99h19m52.800711434s) [upload=95289]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:20:32.988225692 (99h19m52.800717636s) [upload=95289]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:20:33.043794756 (99h19m52.85628671s) [upload=95289]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:20:33.043820175 (99h19m52.856312121s) [upload=95289]: Done uploading segments... Mar 10 14:20:33.043863467 (99h19m52.856355414s) [upload=95289]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 118.262895ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................] duration:
1.625284231s trace:
https://jaeger.dev.storj.io/trace/25521f98cb0a0056
FAIL (2026-03-10 14:20:30 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.625309259s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
17 out of 60 is failed (threshold=3) [...........................................XXXXXXXXXXXXXXXXX] duration:
131.933067ms trace:
https://jaeger.dev.storj.io/trace/31efe15ad8d44f83
FAIL (2026-03-10 14:19:38 UTC)
operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:19:38.299871443 (99h18m58.112363386s) [upload=95273]: Starting upload Mar 10 14:19:38.299915337 (99h18m58.112407285s) [upload=95273]: Done starting upload Mar 10 14:19:38.299962218 (99h18m58.112454164s) [upload=95273]: Uploading segments... Mar 10 14:19:38.300188254 (99h18m58.112680216s) [upload=95273]: Got next segment. Inline: false Mar 10 14:19:38.300254951 (99h18m58.112746902s) [upload=95273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:19:38.300262637 (99h18m58.112754591s) [upload=95273]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:19:38.380164577 (99h18m58.192656527s) [upload=95273]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:19:38.380199640 (99h18m58.192691592s) [upload=95273]: Done uploading segments... Mar 10 14:19:38.380267316 (99h18m58.192759259s) [upload=95273]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 131.964729ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........X..................................................] duration:
1.603226866s trace:
https://jaeger.dev.storj.io/trace/25521f98cb0a0056
FAIL (2026-03-10 14:19:31 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.603250467s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
16 out of 60 is failed (threshold=3) [............................................XXXXXXXXXXXXXXXX] duration:
109.648724ms trace:
https://jaeger.dev.storj.io/trace/52ecd8888227d1d4
FAIL (2026-03-10 14:19:07 UTC)
operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:19:07.404108614 (99h18m27.216600557s) [upload=95264]: Starting upload Mar 10 14:19:07.404153977 (99h18m27.216645914s) [upload=95264]: Done starting upload Mar 10 14:19:07.404417621 (99h18m27.216909558s) [upload=95264]: Uploading segments... Mar 10 14:19:07.404472934 (99h18m27.216964882s) [upload=95264]: Got next segment. Inline: false Mar 10 14:19:07.404592229 (99h18m27.217084181s) [upload=95264]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:19:07.404600537 (99h18m27.217092486s) [upload=95264]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:19:07.457214885 (99h18m27.269706838s) [upload=95264]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:19:07.457242053 (99h18m27.269734006s) [upload=95264]: Done uploading segments... Mar 10 14:19:07.457291836 (99h18m27.269783771s) [upload=95264]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 109.673846ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
15 out of 60 is failed (threshold=3) [.............................................XXXXXXXXXXXXXXX] duration:
150.552499ms trace:
https://jaeger.dev.storj.io/trace/61abc8699b06fcf3
FAIL (2026-03-10 14:18:41 UTC)
operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:18:41.865174746 (99h18m1.677666689s) [upload=95259]: Starting upload Mar 10 14:18:41.865251642 (99h18m1.677743596s) [upload=95259]: Done starting upload Mar 10 14:18:41.865493539 (99h18m1.677985474s) [upload=95259]: Uploading segments... Mar 10 14:18:41.865638050 (99h18m1.678129993s) [upload=95259]: Got next segment. Inline: false Mar 10 14:18:41.865735090 (99h18m1.678227033s) [upload=95259]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:18:41.865742065 (99h18m1.678234009s) [upload=95259]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:18:41.930977472 (99h18m1.743469418s) [upload=95259]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:18:41.930997358 (99h18m1.743489304s) [upload=95259]: Done uploading segments... Mar 10 14:18:41.931051341 (99h18m1.743543276s) [upload=95259]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 150.570783ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........X.................................................] duration:
1.554530811s trace:
https://jaeger.dev.storj.io/trace/25521f98cb0a0056
FAIL (2026-03-10 14:18:29 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.554640543s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........X................................................] duration:
1.598845977s trace:
https://jaeger.dev.storj.io/trace/25521f98cb0a0056
FAIL (2026-03-10 14:17:46 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.598883344s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
14 out of 60 is failed (threshold=3) [..............................................XXXXXXXXXXXXXX] duration:
121.856482ms trace:
https://jaeger.dev.storj.io/trace/5230c326c0085074
FAIL (2026-03-10 14:17:37 UTC)
operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:17:37.686443804 (99h16m57.498935747s) [upload=95238]: Starting upload Mar 10 14:17:37.686487761 (99h16m57.498979706s) [upload=95238]: Done starting upload Mar 10 14:17:37.686792678 (99h16m57.499284625s) [upload=95238]: Uploading segments... Mar 10 14:17:37.686856260 (99h16m57.499348212s) [upload=95238]: Got next segment. Inline: false Mar 10 14:17:37.686892785 (99h16m57.499384737s) [upload=95238]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:17:37.686898520 (99h16m57.499390463s) [upload=95238]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:17:37.748800547 (99h16m57.561292481s) [upload=95238]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:17:37.748824407 (99h16m57.561316355s) [upload=95238]: Done uploading segments... Mar 10 14:17:37.748881269 (99h16m57.561373212s) [upload=95238]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 121.884864ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............X...............................................] duration:
1.65125029s trace:
https://jaeger.dev.storj.io/trace/25521f98cb0a0056
FAIL (2026-03-10 14:16:53 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.651275943s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
13 out of 60 is failed (threshold=3) [...............................................XXXXXXXXXXXXX] duration:
105.307794ms trace:
https://jaeger.dev.storj.io/trace/49dad3e67f832159
FAIL (2026-03-10 14:16:49 UTC)
operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:16:49.605889719 (99h16m9.418381668s) [upload=95225]: Starting upload Mar 10 14:16:49.605972492 (99h16m9.418464443s) [upload=95225]: Done starting upload Mar 10 14:16:49.606013208 (99h16m9.418505151s) [upload=95225]: Uploading segments... Mar 10 14:16:49.606287845 (99h16m9.418779783s) [upload=95225]: Got next segment. Inline: false Mar 10 14:16:49.606361023 (99h16m9.418852967s) [upload=95225]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:16:49.606367291 (99h16m9.418859234s) [upload=95225]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:16:49.653181683 (99h16m9.465673636s) [upload=95225]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:16:49.653224076 (99h16m9.465716035s) [upload=95225]: Done uploading segments... Mar 10 14:16:49.653269921 (99h16m9.465761857s) [upload=95225]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 105.332982ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
12 out of 60 is failed (threshold=3) [................................................XXXXXXXXXXXX] duration:
123.476503ms trace:
https://jaeger.dev.storj.io/trace/361e1f47cb321a84
FAIL (2026-03-10 14:16:26 UTC)
operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:16:26.366279625 (99h15m46.17877157s) [upload=95222]: Starting upload Mar 10 14:16:26.366335141 (99h15m46.178827077s) [upload=95222]: Done starting upload Mar 10 14:16:26.366564380 (99h15m46.179056318s) [upload=95222]: Uploading segments... Mar 10 14:16:26.366647254 (99h15m46.179139201s) [upload=95222]: Got next segment. Inline: false Mar 10 14:16:26.366690668 (99h15m46.1791826s) [upload=95222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:16:26.366696945 (99h15m46.179188889s) [upload=95222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:16:26.432953400 (99h15m46.245445344s) [upload=95222]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:16:26.432973712 (99h15m46.245465661s) [upload=95222]: Done uploading segments... Mar 10 14:16:26.433020963 (99h15m46.245512907s) [upload=95222]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 123.497238ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............X..............................................] duration:
1.632675528s trace:
https://jaeger.dev.storj.io/trace/25521f98cb0a0056
FAIL (2026-03-10 14:15:54 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.632698042s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
11 out of 60 is failed (threshold=3) [.................................................XXXXXXXXXXX] duration:
131.132817ms trace:
https://jaeger.dev.storj.io/trace/641a7afca40d5d21
FAIL (2026-03-10 14:15:52 UTC)
operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:15:52.717264384 (99h15m12.529756313s) [upload=95212]: Starting upload Mar 10 14:15:52.717307174 (99h15m12.529799103s) [upload=95212]: Done starting upload Mar 10 14:15:52.717591701 (99h15m12.530083631s) [upload=95212]: Uploading segments... Mar 10 14:15:52.717635612 (99h15m12.530127618s) [upload=95212]: Got next segment. Inline: false Mar 10 14:15:52.717676458 (99h15m12.530168401s) [upload=95212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:15:52.717683034 (99h15m12.53017498s) [upload=95212]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:15:52.785252317 (99h15m12.59774426s) [upload=95212]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:15:52.785270801 (99h15m12.597762745s) [upload=95212]: Done uploading segments... Mar 10 14:15:52.785315339 (99h15m12.597807276s) [upload=95212]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 131.1549ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............X.............................................] duration:
1.600579712s trace:
https://jaeger.dev.storj.io/trace/25521f98cb0a0056
FAIL (2026-03-10 14:15:30 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.600603965s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............X............................................] duration:
1.623972415s trace:
https://jaeger.dev.storj.io/trace/25521f98cb0a0056
FAIL (2026-03-10 14:14:54 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.624027709s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
10 out of 60 is failed (threshold=3) [..................................................XXXXXXXXXX] duration:
114.125423ms trace:
https://jaeger.dev.storj.io/trace/22f69de4affdccd2
FAIL (2026-03-10 14:14:38 UTC)
operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:14:38.063290704 (99h13m57.875782649s) [upload=95191]: Starting upload Mar 10 14:14:38.063335188 (99h13m57.875827125s) [upload=95191]: Done starting upload Mar 10 14:14:38.063592094 (99h13m57.876084037s) [upload=95191]: Uploading segments... Mar 10 14:14:38.063638542 (99h13m57.876130485s) [upload=95191]: Got next segment. Inline: false Mar 10 14:14:38.063670443 (99h13m57.876162385s) [upload=95191]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:14:38.063675532 (99h13m57.876167476s) [upload=95191]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:14:38.112937551 (99h13m57.925429498s) [upload=95191]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:14:38.112958979 (99h13m57.925450924s) [upload=95191]: Done uploading segments... Mar 10 14:14:38.113014418 (99h13m57.925506355s) [upload=95191]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 114.163175ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................X...........................................] duration:
2.097555956s trace:
https://jaeger.dev.storj.io/trace/25521f98cb0a0056
FAIL (2026-03-10 14:13:56 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.097580319s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
9 out of 60 is failed (threshold=3) [...................................................XXXXXXXXX] duration:
313.163083ms trace:
https://jaeger.dev.storj.io/trace/47a013598839f39f
FAIL (2026-03-10 14:13:28 UTC)
operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:13:28.176044568 (99h12m47.988536502s) [upload=95175]: Starting upload Mar 10 14:13:28.176122455 (99h12m47.9886144s) [upload=95175]: Done starting upload Mar 10 14:13:28.176184931 (99h12m47.988676867s) [upload=95175]: Uploading segments... Mar 10 14:13:28.176734748 (99h12m47.989226695s) [upload=95175]: Got next segment. Inline: false Mar 10 14:13:28.176817900 (99h12m47.989309846s) [upload=95175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:13:28.176822970 (99h12m47.989314913s) [upload=95175]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:13:28.326046087 (99h12m48.138538033s) [upload=95175]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:13:28.326209121 (99h12m48.138701065s) [upload=95175]: Done uploading segments... Mar 10 14:13:28.326302525 (99h12m48.138794469s) [upload=95175]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 313.188068ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................] duration:
2.07384775s trace:
https://jaeger.dev.storj.io/trace/25521f98cb0a0056
FAIL (2026-03-10 14:13:11 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 2.073875566s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................] duration:
1.588203479s trace:
https://jaeger.dev.storj.io/trace/25521f98cb0a0056
FAIL (2026-03-10 14:12:49 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.588224593s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
8 out of 60 is failed (threshold=3) [....................................................XXXXXXXX] duration:
131.763262ms trace:
https://jaeger.dev.storj.io/trace/295fa0ac770acc20
FAIL (2026-03-10 14:12:45 UTC)
operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:12:45.846202834 (99h12m5.658694784s) [upload=95163]: Starting upload Mar 10 14:12:45.846390324 (99h12m5.658882269s) [upload=95163]: Done starting upload Mar 10 14:12:45.846468714 (99h12m5.658960659s) [upload=95163]: Uploading segments... Mar 10 14:12:45.847094094 (99h12m5.659586042s) [upload=95163]: Got next segment. Inline: false Mar 10 14:12:45.847154153 (99h12m5.659646106s) [upload=95163]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:12:45.847176225 (99h12m5.659668172s) [upload=95163]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:12:45.911645901 (99h12m5.724137946s) [upload=95163]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:12:45.911676532 (99h12m5.724168485s) [upload=95163]: Done uploading segments... Mar 10 14:12:45.911729161 (99h12m5.724221113s) [upload=95163]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 131.792907ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
7 out of 60 is failed (threshold=3) [.....................................................XXXXXXX] duration:
156.451228ms trace:
https://jaeger.dev.storj.io/trace/3d9e10a3116af2e6
FAIL (2026-03-10 14:11:57 UTC)
operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 14:11:57.662894070 (99h11m17.475386014s) [upload=95150]: Starting upload Mar 10 14:11:57.662940009 (99h11m17.475431959s) [upload=95150]: Done starting upload Mar 10 14:11:57.663053666 (99h11m17.475545603s) [upload=95150]: Uploading segments... Mar 10 14:11:57.663203043 (99h11m17.475694977s) [upload=95150]: Got next segment. Inline: false Mar 10 14:11:57.663241165 (99h11m17.475733099s) [upload=95150]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 14:11:57.663246630 (99h11m17.475738562s) [upload=95150]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 14:11:57.737533311 (99h11m17.550025254s) [upload=95150]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 14:11:57.737552886 (99h11m17.55004483s) [upload=95150]: Done uploading segments... Mar 10 14:11:57.737606626 (99h11m17.550098559s) [upload=95150]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 156.477219ms
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................] duration:
1.586641156s trace:
https://jaeger.dev.storj.io/trace/25521f98cb0a0056
FAIL (2026-03-10 14:11:53 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.586665709s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................X.......................................] duration:
1.578254714s trace:
https://jaeger.dev.storj.io/trace/25521f98cb0a0056
FAIL (2026-03-10 14:11:18 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.578295238s
core
uplink
us-select-1
us1-placement-20
|