Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.539014883s
FAIL (2025-08-08 02:14:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.539044625s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X........................X..................] duration:
962.76688ms
FAIL (2025-08-08 02:14:17 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 6751]: Done uploading segments... Aug 8 01:54:07.115487086 (16h14m28.859543939s) [upload=16751]: Upload finished. err: <nil> Aug 8 01:55:10.779008362 (16h15m32.523065211s) [upload=16769]: Starting upload Aug 8 01:55:10.779096198 (16h15m32.523153061s) [upload=16769]: Done starting upload Aug 8 01:55:10.779193425 (16h15m32.523250289s) [upload=16769]: Uploading segments... Aug 8 01:55:10.779250013 (16h15m32.523306883s) [upload=16769]: Got next segment. Inline: true Aug 8 01:55:10.779256039 (16h15m32.5233129s) [upload=16769]: Waiting for error group managing segments... Aug 8 01:55:10.779303624 (16h15m32.523360486s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:55:10.779312117 (16h15m32.523368978s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:55:10.779317881 (16h15m32.523374742s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:55:10.929585505 (16h15m32.673642367s) [upload=16769]: Done uploading segments... Aug 8 01:55:10.929610338 (16h15m32.673667199s) [upload=16769]: Upload finished. err: <nil> Aug 8 01:56:06.435484091 (16h16m28.179540953s) [upload=16784]: Starting upload Aug 8 01:56:06.435552910 (16h16m28.179609773s) [upload=16784]: Done starting upload Aug 8 01:56:06.435619333 (16h16m28.179676183s) [upload=16784]: Uploading segments... Aug 8 01:56:06.435665009 (16h16m28.179721877s) [upload=16784]: Got next segment. Inline: true Aug 8 01:56:06.435670176 (16h16m28.179727036s) [upload=16784]: Waiting for error group managing segments... Aug 8 01:56:06.435712868 (16h16m28.179769728s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:06.435718361 (16h16m28.179775225s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:06.435722349 (16h16m28.179779209s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:06.594737382 (16h16m28.33879423s) [upload=16784]: Done uploading segments... Aug 8 01:56:06.594776360 (16h16m28.338833223s) [upload=16784]: Upload finished. err: <nil> Aug 8 01:56:51.181730272 (16h17m12.925787122s) [upload=16797]: Starting upload Aug 8 01:56:51.181780502 (16h17m12.925837362s) [upload=16797]: Done starting upload Aug 8 01:56:51.181842082 (16h17m12.925898932s) [upload=16797]: Uploading segments... Aug 8 01:56:51.181882111 (16h17m12.925938981s) [upload=16797]: Got next segment. Inline: true Aug 8 01:56:51.181887528 (16h17m12.925944389s) [upload=16797]: Waiting for error group managing segments... Aug 8 01:56:51.181955795 (16h17m12.926012645s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:51.181963090 (16h17m12.926019943s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:51.181966550 (16h17m12.926023404s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:51.374537795 (16h17m13.118594648s) [upload=16797]: Done uploading segments... Aug 8 01:56:51.374553785 (16h17m13.11861064s) [upload=16797]: Upload finished. err: <nil> Aug 8 01:57:56.375733570 (16h18m18.119790416s) [upload=16812]: Starting upload Aug 8 01:57:56.375809631 (16h18m18.119866491s) [upload=16812]: Done starting upload Aug 8 01:57:56.375898814 (16h18m18.119955664s) [upload=16812]: Uploading segments... Aug 8 01:57:56.375972719 (16h18m18.120029579s) [upload=16812]: Got next segment. Inline: true Aug 8 01:57:56.375979950 (16h18m18.120036811s) [upload=16812]: Waiting for error group managing segments... Aug 8 01:57:56.376023911 (16h18m18.120080771s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:57:56.376029224 (16h18m18.120086085s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:57:56.376032588 (16h18m18.120089451s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:57:56.522138524 (16h18m18.266195385s) [upload=16812]: Done uploading segments... Aug 8 01:57:56.522174260 (16h18m18.266231121s) [upload=16812]: Upload finished. err: <nil> Aug 8 01:58:40.668656265 (16h19m2.412713135s) [upload=16827]: Starting upload Aug 8 01:58:40.668711058 (16h19m2.412767924s) [upload=16827]: Done starting upload Aug 8 01:58:40.668790608 (16h19m2.412847457s) [upload=16827]: Uploading segments... Aug 8 01:58:40.668840572 (16h19m2.412897441s) [upload=16827]: Got next segment. Inline: true Aug 8 01:58:40.668846411 (16h19m2.412903277s) [upload=16827]: Waiting for error group managing segments... Aug 8 01:58:40.669005747 (16h19m2.413062607s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:58:40.669017356 (16h19m2.413074217s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:58:40.669021551 (16h19m2.413078412s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:58:40.816114713 (16h19m2.560171563s) [upload=16827]: Done uploading segments... Aug 8 01:58:40.816134617 (16h19m2.560191466s) [upload=16827]: Upload finished. err: <nil> Aug 8 01:59:05.627944078 (16h19m27.372000926s) [upload=16833]: Starting upload Aug 8 01:59:05.627998685 (16h19m27.372055535s) [upload=16833]: Done starting upload Aug 8 01:59:05.628118729 (16h19m27.372175578s) [upload=16833]: Uploading segments... Aug 8 01:59:05.628217606 (16h19m27.372274467s) [upload=16833]: Got next segment. Inline: true Aug 8 01:59:05.628225862 (16h19m27.372282734s) [upload=16833]: Waiting for error group managing segments... Aug 8 01:59:05.628334217 (16h19m27.372391068s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:05.628350984 (16h19m27.372407847s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:05.628354470 (16h19m27.372411329s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:05.774577746 (16h19m27.518634612s) [upload=16833]: Done uploading segments... Aug 8 01:59:05.774602383 (16h19m27.518659233s) [upload=16833]: Upload finished. err: <nil> Aug 8 01:59:37.369718935 (16h19m59.113775787s) [upload=16844]: Starting upload Aug 8 01:59:37.369812437 (16h19m59.113869298s) [upload=16844]: Done starting upload Aug 8 01:59:37.369887515 (16h19m59.113944368s) [upload=16844]: Uploading segments... Aug 8 01:59:37.370021093 (16h19m59.114077981s) [upload=16844]: Got next segment. Inline: true Aug 8 01:59:37.370029981 (16h19m59.114086848s) [upload=16844]: Waiting for error group managing segments... Aug 8 01:59:37.370102430 (16h19m59.114159293s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:37.370109420 (16h19m59.11416628s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:37.370113057 (16h19m59.114169917s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:37.726754734 (16h19m59.47081161s) [upload=16844]: Done uploading segments... Aug 8 01:59:37.726778784 (16h19m59.470835637s) [upload=16844]: Upload finished. err: <nil> Aug 8 02:00:24.719377480 (16h20m46.463434328s) [upload=16863]: Starting upload Aug 8 02:00:24.719456409 (16h20m46.463513255s) [upload=16863]: Done starting upload Aug 8 02:00:24.719560489 (16h20m46.463617335s) [upload=16863]: Uploading segments... Aug 8 02:00:24.719616926 (16h20m46.463673789s) [upload=16863]: Got next segment. Inline: true Aug 8 02:00:24.719622706 (16h20m46.463679552s) [upload=16863]: Waiting for error group managing segments... Aug 8 02:00:24.719659743 (16h20m46.463716591s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:24.719664652 (16h20m46.463721498s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:24.719667649 (16h20m46.463724496s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:25.030175327 (16h20m46.774232197s) [upload=16863]: Done uploading segments... Aug 8 02:00:25.030222980 (16h20m46.774279831s) [upload=16863]: Upload finished. err: <nil> Aug 8 02:00:46.211977832 (16h21m7.956034683s) [upload=16869]: Starting upload Aug 8 02:00:46.212032242 (16h21m7.956089102s) [upload=16869]: Done starting upload Aug 8 02:00:46.212101179 (16h21m7.956158028s) [upload=16869]: Uploading segments... Aug 8 02:00:46.212148507 (16h21m7.956205376s) [upload=16869]: Got next segment. Inline: true Aug 8 02:00:46.212155810 (16h21m7.956212671s) [upload=16869]: Waiting for error group managing segments... Aug 8 02:00:46.212197694 (16h21m7.956254544s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:46.212202763 (16h21m7.956259624s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:46.212206348 (16h21m7.956263209s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:46.360999669 (16h21m8.105056524s) [upload=16869]: Done uploading segments... Aug 8 02:00:46.361040611 (16h21m8.105097472s) [upload=16869]: Upload finished. err: <nil> Aug 8 02:01:57.357493061 (16h22m19.101549913s) [upload=16887]: Starting upload Aug 8 02:01:57.357550990 (16h22m19.101607841s) [upload=16887]: Done starting upload Aug 8 02:01:57.357634434 (16h22m19.101691284s) [upload=16887]: Uploading segments... Aug 8 02:01:57.357688424 (16h22m19.101745285s) [upload=16887]: Got next segment. Inline: true Aug 8 02:01:57.357693917 (16h22m19.101750778s) [upload=16887]: Waiting for error group managing segments... Aug 8 02:01:57.357741416 (16h22m19.101798267s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:01:57.357748493 (16h22m19.101805358s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:01:57.357753129 (16h22m19.101809997s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:01:57.874642140 (16h22m19.618698996s) [upload=16887]: Done uploading segments... Aug 8 02:01:57.874664164 (16h22m19.618721018s) [upload=16887]: Upload finished. err: <nil>
Duration: 962.797728ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X........................X.................] duration:
994.702346ms
FAIL (2025-08-08 02:13:53 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 6751]: Done uploading segments... Aug 8 01:54:07.115487086 (16h14m28.859543939s) [upload=16751]: Upload finished. err: <nil> Aug 8 01:55:10.779008362 (16h15m32.523065211s) [upload=16769]: Starting upload Aug 8 01:55:10.779096198 (16h15m32.523153061s) [upload=16769]: Done starting upload Aug 8 01:55:10.779193425 (16h15m32.523250289s) [upload=16769]: Uploading segments... Aug 8 01:55:10.779250013 (16h15m32.523306883s) [upload=16769]: Got next segment. Inline: true Aug 8 01:55:10.779256039 (16h15m32.5233129s) [upload=16769]: Waiting for error group managing segments... Aug 8 01:55:10.779303624 (16h15m32.523360486s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:55:10.779312117 (16h15m32.523368978s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:55:10.779317881 (16h15m32.523374742s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:55:10.929585505 (16h15m32.673642367s) [upload=16769]: Done uploading segments... Aug 8 01:55:10.929610338 (16h15m32.673667199s) [upload=16769]: Upload finished. err: <nil> Aug 8 01:56:06.435484091 (16h16m28.179540953s) [upload=16784]: Starting upload Aug 8 01:56:06.435552910 (16h16m28.179609773s) [upload=16784]: Done starting upload Aug 8 01:56:06.435619333 (16h16m28.179676183s) [upload=16784]: Uploading segments... Aug 8 01:56:06.435665009 (16h16m28.179721877s) [upload=16784]: Got next segment. Inline: true Aug 8 01:56:06.435670176 (16h16m28.179727036s) [upload=16784]: Waiting for error group managing segments... Aug 8 01:56:06.435712868 (16h16m28.179769728s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:06.435718361 (16h16m28.179775225s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:06.435722349 (16h16m28.179779209s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:06.594737382 (16h16m28.33879423s) [upload=16784]: Done uploading segments... Aug 8 01:56:06.594776360 (16h16m28.338833223s) [upload=16784]: Upload finished. err: <nil> Aug 8 01:56:51.181730272 (16h17m12.925787122s) [upload=16797]: Starting upload Aug 8 01:56:51.181780502 (16h17m12.925837362s) [upload=16797]: Done starting upload Aug 8 01:56:51.181842082 (16h17m12.925898932s) [upload=16797]: Uploading segments... Aug 8 01:56:51.181882111 (16h17m12.925938981s) [upload=16797]: Got next segment. Inline: true Aug 8 01:56:51.181887528 (16h17m12.925944389s) [upload=16797]: Waiting for error group managing segments... Aug 8 01:56:51.181955795 (16h17m12.926012645s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:51.181963090 (16h17m12.926019943s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:51.181966550 (16h17m12.926023404s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:51.374537795 (16h17m13.118594648s) [upload=16797]: Done uploading segments... Aug 8 01:56:51.374553785 (16h17m13.11861064s) [upload=16797]: Upload finished. err: <nil> Aug 8 01:57:56.375733570 (16h18m18.119790416s) [upload=16812]: Starting upload Aug 8 01:57:56.375809631 (16h18m18.119866491s) [upload=16812]: Done starting upload Aug 8 01:57:56.375898814 (16h18m18.119955664s) [upload=16812]: Uploading segments... Aug 8 01:57:56.375972719 (16h18m18.120029579s) [upload=16812]: Got next segment. Inline: true Aug 8 01:57:56.375979950 (16h18m18.120036811s) [upload=16812]: Waiting for error group managing segments... Aug 8 01:57:56.376023911 (16h18m18.120080771s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:57:56.376029224 (16h18m18.120086085s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:57:56.376032588 (16h18m18.120089451s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:57:56.522138524 (16h18m18.266195385s) [upload=16812]: Done uploading segments... Aug 8 01:57:56.522174260 (16h18m18.266231121s) [upload=16812]: Upload finished. err: <nil> Aug 8 01:58:40.668656265 (16h19m2.412713135s) [upload=16827]: Starting upload Aug 8 01:58:40.668711058 (16h19m2.412767924s) [upload=16827]: Done starting upload Aug 8 01:58:40.668790608 (16h19m2.412847457s) [upload=16827]: Uploading segments... Aug 8 01:58:40.668840572 (16h19m2.412897441s) [upload=16827]: Got next segment. Inline: true Aug 8 01:58:40.668846411 (16h19m2.412903277s) [upload=16827]: Waiting for error group managing segments... Aug 8 01:58:40.669005747 (16h19m2.413062607s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:58:40.669017356 (16h19m2.413074217s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:58:40.669021551 (16h19m2.413078412s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:58:40.816114713 (16h19m2.560171563s) [upload=16827]: Done uploading segments... Aug 8 01:58:40.816134617 (16h19m2.560191466s) [upload=16827]: Upload finished. err: <nil> Aug 8 01:59:05.627944078 (16h19m27.372000926s) [upload=16833]: Starting upload Aug 8 01:59:05.627998685 (16h19m27.372055535s) [upload=16833]: Done starting upload Aug 8 01:59:05.628118729 (16h19m27.372175578s) [upload=16833]: Uploading segments... Aug 8 01:59:05.628217606 (16h19m27.372274467s) [upload=16833]: Got next segment. Inline: true Aug 8 01:59:05.628225862 (16h19m27.372282734s) [upload=16833]: Waiting for error group managing segments... Aug 8 01:59:05.628334217 (16h19m27.372391068s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:05.628350984 (16h19m27.372407847s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:05.628354470 (16h19m27.372411329s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:05.774577746 (16h19m27.518634612s) [upload=16833]: Done uploading segments... Aug 8 01:59:05.774602383 (16h19m27.518659233s) [upload=16833]: Upload finished. err: <nil> Aug 8 01:59:37.369718935 (16h19m59.113775787s) [upload=16844]: Starting upload Aug 8 01:59:37.369812437 (16h19m59.113869298s) [upload=16844]: Done starting upload Aug 8 01:59:37.369887515 (16h19m59.113944368s) [upload=16844]: Uploading segments... Aug 8 01:59:37.370021093 (16h19m59.114077981s) [upload=16844]: Got next segment. Inline: true Aug 8 01:59:37.370029981 (16h19m59.114086848s) [upload=16844]: Waiting for error group managing segments... Aug 8 01:59:37.370102430 (16h19m59.114159293s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:37.370109420 (16h19m59.11416628s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:37.370113057 (16h19m59.114169917s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:37.726754734 (16h19m59.47081161s) [upload=16844]: Done uploading segments... Aug 8 01:59:37.726778784 (16h19m59.470835637s) [upload=16844]: Upload finished. err: <nil> Aug 8 02:00:24.719377480 (16h20m46.463434328s) [upload=16863]: Starting upload Aug 8 02:00:24.719456409 (16h20m46.463513255s) [upload=16863]: Done starting upload Aug 8 02:00:24.719560489 (16h20m46.463617335s) [upload=16863]: Uploading segments... Aug 8 02:00:24.719616926 (16h20m46.463673789s) [upload=16863]: Got next segment. Inline: true Aug 8 02:00:24.719622706 (16h20m46.463679552s) [upload=16863]: Waiting for error group managing segments... Aug 8 02:00:24.719659743 (16h20m46.463716591s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:24.719664652 (16h20m46.463721498s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:24.719667649 (16h20m46.463724496s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:25.030175327 (16h20m46.774232197s) [upload=16863]: Done uploading segments... Aug 8 02:00:25.030222980 (16h20m46.774279831s) [upload=16863]: Upload finished. err: <nil> Aug 8 02:00:46.211977832 (16h21m7.956034683s) [upload=16869]: Starting upload Aug 8 02:00:46.212032242 (16h21m7.956089102s) [upload=16869]: Done starting upload Aug 8 02:00:46.212101179 (16h21m7.956158028s) [upload=16869]: Uploading segments... Aug 8 02:00:46.212148507 (16h21m7.956205376s) [upload=16869]: Got next segment. Inline: true Aug 8 02:00:46.212155810 (16h21m7.956212671s) [upload=16869]: Waiting for error group managing segments... Aug 8 02:00:46.212197694 (16h21m7.956254544s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:46.212202763 (16h21m7.956259624s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:46.212206348 (16h21m7.956263209s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:46.360999669 (16h21m8.105056524s) [upload=16869]: Done uploading segments... Aug 8 02:00:46.361040611 (16h21m8.105097472s) [upload=16869]: Upload finished. err: <nil> Aug 8 02:01:57.357493061 (16h22m19.101549913s) [upload=16887]: Starting upload Aug 8 02:01:57.357550990 (16h22m19.101607841s) [upload=16887]: Done starting upload Aug 8 02:01:57.357634434 (16h22m19.101691284s) [upload=16887]: Uploading segments... Aug 8 02:01:57.357688424 (16h22m19.101745285s) [upload=16887]: Got next segment. Inline: true Aug 8 02:01:57.357693917 (16h22m19.101750778s) [upload=16887]: Waiting for error group managing segments... Aug 8 02:01:57.357741416 (16h22m19.101798267s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:01:57.357748493 (16h22m19.101805358s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:01:57.357753129 (16h22m19.101809997s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:01:57.874642140 (16h22m19.618698996s) [upload=16887]: Done uploading segments... Aug 8 02:01:57.874664164 (16h22m19.618721018s) [upload=16887]: Upload finished. err: <nil>
Duration: 994.737554ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.353525406s
FAIL (2025-08-08 02:13:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.353555779s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X........................X................] duration:
835.92204ms
FAIL (2025-08-08 02:13:12 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 6751]: Done uploading segments... Aug 8 01:54:07.115487086 (16h14m28.859543939s) [upload=16751]: Upload finished. err: <nil> Aug 8 01:55:10.779008362 (16h15m32.523065211s) [upload=16769]: Starting upload Aug 8 01:55:10.779096198 (16h15m32.523153061s) [upload=16769]: Done starting upload Aug 8 01:55:10.779193425 (16h15m32.523250289s) [upload=16769]: Uploading segments... Aug 8 01:55:10.779250013 (16h15m32.523306883s) [upload=16769]: Got next segment. Inline: true Aug 8 01:55:10.779256039 (16h15m32.5233129s) [upload=16769]: Waiting for error group managing segments... Aug 8 01:55:10.779303624 (16h15m32.523360486s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:55:10.779312117 (16h15m32.523368978s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:55:10.779317881 (16h15m32.523374742s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:55:10.929585505 (16h15m32.673642367s) [upload=16769]: Done uploading segments... Aug 8 01:55:10.929610338 (16h15m32.673667199s) [upload=16769]: Upload finished. err: <nil> Aug 8 01:56:06.435484091 (16h16m28.179540953s) [upload=16784]: Starting upload Aug 8 01:56:06.435552910 (16h16m28.179609773s) [upload=16784]: Done starting upload Aug 8 01:56:06.435619333 (16h16m28.179676183s) [upload=16784]: Uploading segments... Aug 8 01:56:06.435665009 (16h16m28.179721877s) [upload=16784]: Got next segment. Inline: true Aug 8 01:56:06.435670176 (16h16m28.179727036s) [upload=16784]: Waiting for error group managing segments... Aug 8 01:56:06.435712868 (16h16m28.179769728s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:06.435718361 (16h16m28.179775225s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:06.435722349 (16h16m28.179779209s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:06.594737382 (16h16m28.33879423s) [upload=16784]: Done uploading segments... Aug 8 01:56:06.594776360 (16h16m28.338833223s) [upload=16784]: Upload finished. err: <nil> Aug 8 01:56:51.181730272 (16h17m12.925787122s) [upload=16797]: Starting upload Aug 8 01:56:51.181780502 (16h17m12.925837362s) [upload=16797]: Done starting upload Aug 8 01:56:51.181842082 (16h17m12.925898932s) [upload=16797]: Uploading segments... Aug 8 01:56:51.181882111 (16h17m12.925938981s) [upload=16797]: Got next segment. Inline: true Aug 8 01:56:51.181887528 (16h17m12.925944389s) [upload=16797]: Waiting for error group managing segments... Aug 8 01:56:51.181955795 (16h17m12.926012645s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:51.181963090 (16h17m12.926019943s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:51.181966550 (16h17m12.926023404s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:51.374537795 (16h17m13.118594648s) [upload=16797]: Done uploading segments... Aug 8 01:56:51.374553785 (16h17m13.11861064s) [upload=16797]: Upload finished. err: <nil> Aug 8 01:57:56.375733570 (16h18m18.119790416s) [upload=16812]: Starting upload Aug 8 01:57:56.375809631 (16h18m18.119866491s) [upload=16812]: Done starting upload Aug 8 01:57:56.375898814 (16h18m18.119955664s) [upload=16812]: Uploading segments... Aug 8 01:57:56.375972719 (16h18m18.120029579s) [upload=16812]: Got next segment. Inline: true Aug 8 01:57:56.375979950 (16h18m18.120036811s) [upload=16812]: Waiting for error group managing segments... Aug 8 01:57:56.376023911 (16h18m18.120080771s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:57:56.376029224 (16h18m18.120086085s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:57:56.376032588 (16h18m18.120089451s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:57:56.522138524 (16h18m18.266195385s) [upload=16812]: Done uploading segments... Aug 8 01:57:56.522174260 (16h18m18.266231121s) [upload=16812]: Upload finished. err: <nil> Aug 8 01:58:40.668656265 (16h19m2.412713135s) [upload=16827]: Starting upload Aug 8 01:58:40.668711058 (16h19m2.412767924s) [upload=16827]: Done starting upload Aug 8 01:58:40.668790608 (16h19m2.412847457s) [upload=16827]: Uploading segments... Aug 8 01:58:40.668840572 (16h19m2.412897441s) [upload=16827]: Got next segment. Inline: true Aug 8 01:58:40.668846411 (16h19m2.412903277s) [upload=16827]: Waiting for error group managing segments... Aug 8 01:58:40.669005747 (16h19m2.413062607s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:58:40.669017356 (16h19m2.413074217s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:58:40.669021551 (16h19m2.413078412s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:58:40.816114713 (16h19m2.560171563s) [upload=16827]: Done uploading segments... Aug 8 01:58:40.816134617 (16h19m2.560191466s) [upload=16827]: Upload finished. err: <nil> Aug 8 01:59:05.627944078 (16h19m27.372000926s) [upload=16833]: Starting upload Aug 8 01:59:05.627998685 (16h19m27.372055535s) [upload=16833]: Done starting upload Aug 8 01:59:05.628118729 (16h19m27.372175578s) [upload=16833]: Uploading segments... Aug 8 01:59:05.628217606 (16h19m27.372274467s) [upload=16833]: Got next segment. Inline: true Aug 8 01:59:05.628225862 (16h19m27.372282734s) [upload=16833]: Waiting for error group managing segments... Aug 8 01:59:05.628334217 (16h19m27.372391068s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:05.628350984 (16h19m27.372407847s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:05.628354470 (16h19m27.372411329s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:05.774577746 (16h19m27.518634612s) [upload=16833]: Done uploading segments... Aug 8 01:59:05.774602383 (16h19m27.518659233s) [upload=16833]: Upload finished. err: <nil> Aug 8 01:59:37.369718935 (16h19m59.113775787s) [upload=16844]: Starting upload Aug 8 01:59:37.369812437 (16h19m59.113869298s) [upload=16844]: Done starting upload Aug 8 01:59:37.369887515 (16h19m59.113944368s) [upload=16844]: Uploading segments... Aug 8 01:59:37.370021093 (16h19m59.114077981s) [upload=16844]: Got next segment. Inline: true Aug 8 01:59:37.370029981 (16h19m59.114086848s) [upload=16844]: Waiting for error group managing segments... Aug 8 01:59:37.370102430 (16h19m59.114159293s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:37.370109420 (16h19m59.11416628s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:37.370113057 (16h19m59.114169917s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:37.726754734 (16h19m59.47081161s) [upload=16844]: Done uploading segments... Aug 8 01:59:37.726778784 (16h19m59.470835637s) [upload=16844]: Upload finished. err: <nil> Aug 8 02:00:24.719377480 (16h20m46.463434328s) [upload=16863]: Starting upload Aug 8 02:00:24.719456409 (16h20m46.463513255s) [upload=16863]: Done starting upload Aug 8 02:00:24.719560489 (16h20m46.463617335s) [upload=16863]: Uploading segments... Aug 8 02:00:24.719616926 (16h20m46.463673789s) [upload=16863]: Got next segment. Inline: true Aug 8 02:00:24.719622706 (16h20m46.463679552s) [upload=16863]: Waiting for error group managing segments... Aug 8 02:00:24.719659743 (16h20m46.463716591s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:24.719664652 (16h20m46.463721498s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:24.719667649 (16h20m46.463724496s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:25.030175327 (16h20m46.774232197s) [upload=16863]: Done uploading segments... Aug 8 02:00:25.030222980 (16h20m46.774279831s) [upload=16863]: Upload finished. err: <nil> Aug 8 02:00:46.211977832 (16h21m7.956034683s) [upload=16869]: Starting upload Aug 8 02:00:46.212032242 (16h21m7.956089102s) [upload=16869]: Done starting upload Aug 8 02:00:46.212101179 (16h21m7.956158028s) [upload=16869]: Uploading segments... Aug 8 02:00:46.212148507 (16h21m7.956205376s) [upload=16869]: Got next segment. Inline: true Aug 8 02:00:46.212155810 (16h21m7.956212671s) [upload=16869]: Waiting for error group managing segments... Aug 8 02:00:46.212197694 (16h21m7.956254544s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:46.212202763 (16h21m7.956259624s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:46.212206348 (16h21m7.956263209s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:46.360999669 (16h21m8.105056524s) [upload=16869]: Done uploading segments... Aug 8 02:00:46.361040611 (16h21m8.105097472s) [upload=16869]: Upload finished. err: <nil> Aug 8 02:01:57.357493061 (16h22m19.101549913s) [upload=16887]: Starting upload Aug 8 02:01:57.357550990 (16h22m19.101607841s) [upload=16887]: Done starting upload Aug 8 02:01:57.357634434 (16h22m19.101691284s) [upload=16887]: Uploading segments... Aug 8 02:01:57.357688424 (16h22m19.101745285s) [upload=16887]: Got next segment. Inline: true Aug 8 02:01:57.357693917 (16h22m19.101750778s) [upload=16887]: Waiting for error group managing segments... Aug 8 02:01:57.357741416 (16h22m19.101798267s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:01:57.357748493 (16h22m19.101805358s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:01:57.357753129 (16h22m19.101809997s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:01:57.874642140 (16h22m19.618698996s) [upload=16887]: Done uploading segments... Aug 8 02:01:57.874664164 (16h22m19.618721018s) [upload=16887]: Upload finished. err: <nil>
Duration: 835.954638ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X........................X...............] duration:
848.977742ms
FAIL (2025-08-08 02:12:51 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 6751]: Done uploading segments... Aug 8 01:54:07.115487086 (16h14m28.859543939s) [upload=16751]: Upload finished. err: <nil> Aug 8 01:55:10.779008362 (16h15m32.523065211s) [upload=16769]: Starting upload Aug 8 01:55:10.779096198 (16h15m32.523153061s) [upload=16769]: Done starting upload Aug 8 01:55:10.779193425 (16h15m32.523250289s) [upload=16769]: Uploading segments... Aug 8 01:55:10.779250013 (16h15m32.523306883s) [upload=16769]: Got next segment. Inline: true Aug 8 01:55:10.779256039 (16h15m32.5233129s) [upload=16769]: Waiting for error group managing segments... Aug 8 01:55:10.779303624 (16h15m32.523360486s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:55:10.779312117 (16h15m32.523368978s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:55:10.779317881 (16h15m32.523374742s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:55:10.929585505 (16h15m32.673642367s) [upload=16769]: Done uploading segments... Aug 8 01:55:10.929610338 (16h15m32.673667199s) [upload=16769]: Upload finished. err: <nil> Aug 8 01:56:06.435484091 (16h16m28.179540953s) [upload=16784]: Starting upload Aug 8 01:56:06.435552910 (16h16m28.179609773s) [upload=16784]: Done starting upload Aug 8 01:56:06.435619333 (16h16m28.179676183s) [upload=16784]: Uploading segments... Aug 8 01:56:06.435665009 (16h16m28.179721877s) [upload=16784]: Got next segment. Inline: true Aug 8 01:56:06.435670176 (16h16m28.179727036s) [upload=16784]: Waiting for error group managing segments... Aug 8 01:56:06.435712868 (16h16m28.179769728s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:06.435718361 (16h16m28.179775225s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:06.435722349 (16h16m28.179779209s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:06.594737382 (16h16m28.33879423s) [upload=16784]: Done uploading segments... Aug 8 01:56:06.594776360 (16h16m28.338833223s) [upload=16784]: Upload finished. err: <nil> Aug 8 01:56:51.181730272 (16h17m12.925787122s) [upload=16797]: Starting upload Aug 8 01:56:51.181780502 (16h17m12.925837362s) [upload=16797]: Done starting upload Aug 8 01:56:51.181842082 (16h17m12.925898932s) [upload=16797]: Uploading segments... Aug 8 01:56:51.181882111 (16h17m12.925938981s) [upload=16797]: Got next segment. Inline: true Aug 8 01:56:51.181887528 (16h17m12.925944389s) [upload=16797]: Waiting for error group managing segments... Aug 8 01:56:51.181955795 (16h17m12.926012645s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:51.181963090 (16h17m12.926019943s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:51.181966550 (16h17m12.926023404s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:51.374537795 (16h17m13.118594648s) [upload=16797]: Done uploading segments... Aug 8 01:56:51.374553785 (16h17m13.11861064s) [upload=16797]: Upload finished. err: <nil> Aug 8 01:57:56.375733570 (16h18m18.119790416s) [upload=16812]: Starting upload Aug 8 01:57:56.375809631 (16h18m18.119866491s) [upload=16812]: Done starting upload Aug 8 01:57:56.375898814 (16h18m18.119955664s) [upload=16812]: Uploading segments... Aug 8 01:57:56.375972719 (16h18m18.120029579s) [upload=16812]: Got next segment. Inline: true Aug 8 01:57:56.375979950 (16h18m18.120036811s) [upload=16812]: Waiting for error group managing segments... Aug 8 01:57:56.376023911 (16h18m18.120080771s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:57:56.376029224 (16h18m18.120086085s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:57:56.376032588 (16h18m18.120089451s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:57:56.522138524 (16h18m18.266195385s) [upload=16812]: Done uploading segments... Aug 8 01:57:56.522174260 (16h18m18.266231121s) [upload=16812]: Upload finished. err: <nil> Aug 8 01:58:40.668656265 (16h19m2.412713135s) [upload=16827]: Starting upload Aug 8 01:58:40.668711058 (16h19m2.412767924s) [upload=16827]: Done starting upload Aug 8 01:58:40.668790608 (16h19m2.412847457s) [upload=16827]: Uploading segments... Aug 8 01:58:40.668840572 (16h19m2.412897441s) [upload=16827]: Got next segment. Inline: true Aug 8 01:58:40.668846411 (16h19m2.412903277s) [upload=16827]: Waiting for error group managing segments... Aug 8 01:58:40.669005747 (16h19m2.413062607s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:58:40.669017356 (16h19m2.413074217s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:58:40.669021551 (16h19m2.413078412s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:58:40.816114713 (16h19m2.560171563s) [upload=16827]: Done uploading segments... Aug 8 01:58:40.816134617 (16h19m2.560191466s) [upload=16827]: Upload finished. err: <nil> Aug 8 01:59:05.627944078 (16h19m27.372000926s) [upload=16833]: Starting upload Aug 8 01:59:05.627998685 (16h19m27.372055535s) [upload=16833]: Done starting upload Aug 8 01:59:05.628118729 (16h19m27.372175578s) [upload=16833]: Uploading segments... Aug 8 01:59:05.628217606 (16h19m27.372274467s) [upload=16833]: Got next segment. Inline: true Aug 8 01:59:05.628225862 (16h19m27.372282734s) [upload=16833]: Waiting for error group managing segments... Aug 8 01:59:05.628334217 (16h19m27.372391068s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:05.628350984 (16h19m27.372407847s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:05.628354470 (16h19m27.372411329s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:05.774577746 (16h19m27.518634612s) [upload=16833]: Done uploading segments... Aug 8 01:59:05.774602383 (16h19m27.518659233s) [upload=16833]: Upload finished. err: <nil> Aug 8 01:59:37.369718935 (16h19m59.113775787s) [upload=16844]: Starting upload Aug 8 01:59:37.369812437 (16h19m59.113869298s) [upload=16844]: Done starting upload Aug 8 01:59:37.369887515 (16h19m59.113944368s) [upload=16844]: Uploading segments... Aug 8 01:59:37.370021093 (16h19m59.114077981s) [upload=16844]: Got next segment. Inline: true Aug 8 01:59:37.370029981 (16h19m59.114086848s) [upload=16844]: Waiting for error group managing segments... Aug 8 01:59:37.370102430 (16h19m59.114159293s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:37.370109420 (16h19m59.11416628s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:37.370113057 (16h19m59.114169917s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:37.726754734 (16h19m59.47081161s) [upload=16844]: Done uploading segments... Aug 8 01:59:37.726778784 (16h19m59.470835637s) [upload=16844]: Upload finished. err: <nil> Aug 8 02:00:24.719377480 (16h20m46.463434328s) [upload=16863]: Starting upload Aug 8 02:00:24.719456409 (16h20m46.463513255s) [upload=16863]: Done starting upload Aug 8 02:00:24.719560489 (16h20m46.463617335s) [upload=16863]: Uploading segments... Aug 8 02:00:24.719616926 (16h20m46.463673789s) [upload=16863]: Got next segment. Inline: true Aug 8 02:00:24.719622706 (16h20m46.463679552s) [upload=16863]: Waiting for error group managing segments... Aug 8 02:00:24.719659743 (16h20m46.463716591s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:24.719664652 (16h20m46.463721498s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:24.719667649 (16h20m46.463724496s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:25.030175327 (16h20m46.774232197s) [upload=16863]: Done uploading segments... Aug 8 02:00:25.030222980 (16h20m46.774279831s) [upload=16863]: Upload finished. err: <nil> Aug 8 02:00:46.211977832 (16h21m7.956034683s) [upload=16869]: Starting upload Aug 8 02:00:46.212032242 (16h21m7.956089102s) [upload=16869]: Done starting upload Aug 8 02:00:46.212101179 (16h21m7.956158028s) [upload=16869]: Uploading segments... Aug 8 02:00:46.212148507 (16h21m7.956205376s) [upload=16869]: Got next segment. Inline: true Aug 8 02:00:46.212155810 (16h21m7.956212671s) [upload=16869]: Waiting for error group managing segments... Aug 8 02:00:46.212197694 (16h21m7.956254544s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:46.212202763 (16h21m7.956259624s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:46.212206348 (16h21m7.956263209s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:46.360999669 (16h21m8.105056524s) [upload=16869]: Done uploading segments... Aug 8 02:00:46.361040611 (16h21m8.105097472s) [upload=16869]: Upload finished. err: <nil> Aug 8 02:01:57.357493061 (16h22m19.101549913s) [upload=16887]: Starting upload Aug 8 02:01:57.357550990 (16h22m19.101607841s) [upload=16887]: Done starting upload Aug 8 02:01:57.357634434 (16h22m19.101691284s) [upload=16887]: Uploading segments... Aug 8 02:01:57.357688424 (16h22m19.101745285s) [upload=16887]: Got next segment. Inline: true Aug 8 02:01:57.357693917 (16h22m19.101750778s) [upload=16887]: Waiting for error group managing segments... Aug 8 02:01:57.357741416 (16h22m19.101798267s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:01:57.357748493 (16h22m19.101805358s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:01:57.357753129 (16h22m19.101809997s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:01:57.874642140 (16h22m19.618698996s) [upload=16887]: Done uploading segments... Aug 8 02:01:57.874664164 (16h22m19.618721018s) [upload=16887]: Upload finished. err: <nil>
Duration: 849.007999ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X........................X..............] duration:
1.099360436s
FAIL (2025-08-08 02:12:23 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 6751]: Done uploading segments... Aug 8 01:54:07.115487086 (16h14m28.859543939s) [upload=16751]: Upload finished. err: <nil> Aug 8 01:55:10.779008362 (16h15m32.523065211s) [upload=16769]: Starting upload Aug 8 01:55:10.779096198 (16h15m32.523153061s) [upload=16769]: Done starting upload Aug 8 01:55:10.779193425 (16h15m32.523250289s) [upload=16769]: Uploading segments... Aug 8 01:55:10.779250013 (16h15m32.523306883s) [upload=16769]: Got next segment. Inline: true Aug 8 01:55:10.779256039 (16h15m32.5233129s) [upload=16769]: Waiting for error group managing segments... Aug 8 01:55:10.779303624 (16h15m32.523360486s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:55:10.779312117 (16h15m32.523368978s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:55:10.779317881 (16h15m32.523374742s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:55:10.929585505 (16h15m32.673642367s) [upload=16769]: Done uploading segments... Aug 8 01:55:10.929610338 (16h15m32.673667199s) [upload=16769]: Upload finished. err: <nil> Aug 8 01:56:06.435484091 (16h16m28.179540953s) [upload=16784]: Starting upload Aug 8 01:56:06.435552910 (16h16m28.179609773s) [upload=16784]: Done starting upload Aug 8 01:56:06.435619333 (16h16m28.179676183s) [upload=16784]: Uploading segments... Aug 8 01:56:06.435665009 (16h16m28.179721877s) [upload=16784]: Got next segment. Inline: true Aug 8 01:56:06.435670176 (16h16m28.179727036s) [upload=16784]: Waiting for error group managing segments... Aug 8 01:56:06.435712868 (16h16m28.179769728s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:06.435718361 (16h16m28.179775225s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:06.435722349 (16h16m28.179779209s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:06.594737382 (16h16m28.33879423s) [upload=16784]: Done uploading segments... Aug 8 01:56:06.594776360 (16h16m28.338833223s) [upload=16784]: Upload finished. err: <nil> Aug 8 01:56:51.181730272 (16h17m12.925787122s) [upload=16797]: Starting upload Aug 8 01:56:51.181780502 (16h17m12.925837362s) [upload=16797]: Done starting upload Aug 8 01:56:51.181842082 (16h17m12.925898932s) [upload=16797]: Uploading segments... Aug 8 01:56:51.181882111 (16h17m12.925938981s) [upload=16797]: Got next segment. Inline: true Aug 8 01:56:51.181887528 (16h17m12.925944389s) [upload=16797]: Waiting for error group managing segments... Aug 8 01:56:51.181955795 (16h17m12.926012645s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:51.181963090 (16h17m12.926019943s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:51.181966550 (16h17m12.926023404s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:51.374537795 (16h17m13.118594648s) [upload=16797]: Done uploading segments... Aug 8 01:56:51.374553785 (16h17m13.11861064s) [upload=16797]: Upload finished. err: <nil> Aug 8 01:57:56.375733570 (16h18m18.119790416s) [upload=16812]: Starting upload Aug 8 01:57:56.375809631 (16h18m18.119866491s) [upload=16812]: Done starting upload Aug 8 01:57:56.375898814 (16h18m18.119955664s) [upload=16812]: Uploading segments... Aug 8 01:57:56.375972719 (16h18m18.120029579s) [upload=16812]: Got next segment. Inline: true Aug 8 01:57:56.375979950 (16h18m18.120036811s) [upload=16812]: Waiting for error group managing segments... Aug 8 01:57:56.376023911 (16h18m18.120080771s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:57:56.376029224 (16h18m18.120086085s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:57:56.376032588 (16h18m18.120089451s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:57:56.522138524 (16h18m18.266195385s) [upload=16812]: Done uploading segments... Aug 8 01:57:56.522174260 (16h18m18.266231121s) [upload=16812]: Upload finished. err: <nil> Aug 8 01:58:40.668656265 (16h19m2.412713135s) [upload=16827]: Starting upload Aug 8 01:58:40.668711058 (16h19m2.412767924s) [upload=16827]: Done starting upload Aug 8 01:58:40.668790608 (16h19m2.412847457s) [upload=16827]: Uploading segments... Aug 8 01:58:40.668840572 (16h19m2.412897441s) [upload=16827]: Got next segment. Inline: true Aug 8 01:58:40.668846411 (16h19m2.412903277s) [upload=16827]: Waiting for error group managing segments... Aug 8 01:58:40.669005747 (16h19m2.413062607s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:58:40.669017356 (16h19m2.413074217s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:58:40.669021551 (16h19m2.413078412s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:58:40.816114713 (16h19m2.560171563s) [upload=16827]: Done uploading segments... Aug 8 01:58:40.816134617 (16h19m2.560191466s) [upload=16827]: Upload finished. err: <nil> Aug 8 01:59:05.627944078 (16h19m27.372000926s) [upload=16833]: Starting upload Aug 8 01:59:05.627998685 (16h19m27.372055535s) [upload=16833]: Done starting upload Aug 8 01:59:05.628118729 (16h19m27.372175578s) [upload=16833]: Uploading segments... Aug 8 01:59:05.628217606 (16h19m27.372274467s) [upload=16833]: Got next segment. Inline: true Aug 8 01:59:05.628225862 (16h19m27.372282734s) [upload=16833]: Waiting for error group managing segments... Aug 8 01:59:05.628334217 (16h19m27.372391068s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:05.628350984 (16h19m27.372407847s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:05.628354470 (16h19m27.372411329s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:05.774577746 (16h19m27.518634612s) [upload=16833]: Done uploading segments... Aug 8 01:59:05.774602383 (16h19m27.518659233s) [upload=16833]: Upload finished. err: <nil> Aug 8 01:59:37.369718935 (16h19m59.113775787s) [upload=16844]: Starting upload Aug 8 01:59:37.369812437 (16h19m59.113869298s) [upload=16844]: Done starting upload Aug 8 01:59:37.369887515 (16h19m59.113944368s) [upload=16844]: Uploading segments... Aug 8 01:59:37.370021093 (16h19m59.114077981s) [upload=16844]: Got next segment. Inline: true Aug 8 01:59:37.370029981 (16h19m59.114086848s) [upload=16844]: Waiting for error group managing segments... Aug 8 01:59:37.370102430 (16h19m59.114159293s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:37.370109420 (16h19m59.11416628s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:37.370113057 (16h19m59.114169917s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:37.726754734 (16h19m59.47081161s) [upload=16844]: Done uploading segments... Aug 8 01:59:37.726778784 (16h19m59.470835637s) [upload=16844]: Upload finished. err: <nil> Aug 8 02:00:24.719377480 (16h20m46.463434328s) [upload=16863]: Starting upload Aug 8 02:00:24.719456409 (16h20m46.463513255s) [upload=16863]: Done starting upload Aug 8 02:00:24.719560489 (16h20m46.463617335s) [upload=16863]: Uploading segments... Aug 8 02:00:24.719616926 (16h20m46.463673789s) [upload=16863]: Got next segment. Inline: true Aug 8 02:00:24.719622706 (16h20m46.463679552s) [upload=16863]: Waiting for error group managing segments... Aug 8 02:00:24.719659743 (16h20m46.463716591s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:24.719664652 (16h20m46.463721498s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:24.719667649 (16h20m46.463724496s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:25.030175327 (16h20m46.774232197s) [upload=16863]: Done uploading segments... Aug 8 02:00:25.030222980 (16h20m46.774279831s) [upload=16863]: Upload finished. err: <nil> Aug 8 02:00:46.211977832 (16h21m7.956034683s) [upload=16869]: Starting upload Aug 8 02:00:46.212032242 (16h21m7.956089102s) [upload=16869]: Done starting upload Aug 8 02:00:46.212101179 (16h21m7.956158028s) [upload=16869]: Uploading segments... Aug 8 02:00:46.212148507 (16h21m7.956205376s) [upload=16869]: Got next segment. Inline: true Aug 8 02:00:46.212155810 (16h21m7.956212671s) [upload=16869]: Waiting for error group managing segments... Aug 8 02:00:46.212197694 (16h21m7.956254544s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:46.212202763 (16h21m7.956259624s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:46.212206348 (16h21m7.956263209s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:46.360999669 (16h21m8.105056524s) [upload=16869]: Done uploading segments... Aug 8 02:00:46.361040611 (16h21m8.105097472s) [upload=16869]: Upload finished. err: <nil> Aug 8 02:01:57.357493061 (16h22m19.101549913s) [upload=16887]: Starting upload Aug 8 02:01:57.357550990 (16h22m19.101607841s) [upload=16887]: Done starting upload Aug 8 02:01:57.357634434 (16h22m19.101691284s) [upload=16887]: Uploading segments... Aug 8 02:01:57.357688424 (16h22m19.101745285s) [upload=16887]: Got next segment. Inline: true Aug 8 02:01:57.357693917 (16h22m19.101750778s) [upload=16887]: Waiting for error group managing segments... Aug 8 02:01:57.357741416 (16h22m19.101798267s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:01:57.357748493 (16h22m19.101805358s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:01:57.357753129 (16h22m19.101809997s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:01:57.874642140 (16h22m19.618698996s) [upload=16887]: Done uploading segments... Aug 8 02:01:57.874664164 (16h22m19.618721018s) [upload=16887]: Upload finished. err: <nil>
Duration: 1.099397909s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.433692349s
FAIL (2025-08-08 02:12:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.433725692s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.571926005s
FAIL (2025-08-08 02:11:53 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.571956361s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X........................X.............] duration:
854.66463ms
FAIL (2025-08-08 02:11:14 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 6751]: Done uploading segments... Aug 8 01:54:07.115487086 (16h14m28.859543939s) [upload=16751]: Upload finished. err: <nil> Aug 8 01:55:10.779008362 (16h15m32.523065211s) [upload=16769]: Starting upload Aug 8 01:55:10.779096198 (16h15m32.523153061s) [upload=16769]: Done starting upload Aug 8 01:55:10.779193425 (16h15m32.523250289s) [upload=16769]: Uploading segments... Aug 8 01:55:10.779250013 (16h15m32.523306883s) [upload=16769]: Got next segment. Inline: true Aug 8 01:55:10.779256039 (16h15m32.5233129s) [upload=16769]: Waiting for error group managing segments... Aug 8 01:55:10.779303624 (16h15m32.523360486s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:55:10.779312117 (16h15m32.523368978s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:55:10.779317881 (16h15m32.523374742s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:55:10.929585505 (16h15m32.673642367s) [upload=16769]: Done uploading segments... Aug 8 01:55:10.929610338 (16h15m32.673667199s) [upload=16769]: Upload finished. err: <nil> Aug 8 01:56:06.435484091 (16h16m28.179540953s) [upload=16784]: Starting upload Aug 8 01:56:06.435552910 (16h16m28.179609773s) [upload=16784]: Done starting upload Aug 8 01:56:06.435619333 (16h16m28.179676183s) [upload=16784]: Uploading segments... Aug 8 01:56:06.435665009 (16h16m28.179721877s) [upload=16784]: Got next segment. Inline: true Aug 8 01:56:06.435670176 (16h16m28.179727036s) [upload=16784]: Waiting for error group managing segments... Aug 8 01:56:06.435712868 (16h16m28.179769728s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:06.435718361 (16h16m28.179775225s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:06.435722349 (16h16m28.179779209s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:06.594737382 (16h16m28.33879423s) [upload=16784]: Done uploading segments... Aug 8 01:56:06.594776360 (16h16m28.338833223s) [upload=16784]: Upload finished. err: <nil> Aug 8 01:56:51.181730272 (16h17m12.925787122s) [upload=16797]: Starting upload Aug 8 01:56:51.181780502 (16h17m12.925837362s) [upload=16797]: Done starting upload Aug 8 01:56:51.181842082 (16h17m12.925898932s) [upload=16797]: Uploading segments... Aug 8 01:56:51.181882111 (16h17m12.925938981s) [upload=16797]: Got next segment. Inline: true Aug 8 01:56:51.181887528 (16h17m12.925944389s) [upload=16797]: Waiting for error group managing segments... Aug 8 01:56:51.181955795 (16h17m12.926012645s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:51.181963090 (16h17m12.926019943s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:51.181966550 (16h17m12.926023404s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:51.374537795 (16h17m13.118594648s) [upload=16797]: Done uploading segments... Aug 8 01:56:51.374553785 (16h17m13.11861064s) [upload=16797]: Upload finished. err: <nil> Aug 8 01:57:56.375733570 (16h18m18.119790416s) [upload=16812]: Starting upload Aug 8 01:57:56.375809631 (16h18m18.119866491s) [upload=16812]: Done starting upload Aug 8 01:57:56.375898814 (16h18m18.119955664s) [upload=16812]: Uploading segments... Aug 8 01:57:56.375972719 (16h18m18.120029579s) [upload=16812]: Got next segment. Inline: true Aug 8 01:57:56.375979950 (16h18m18.120036811s) [upload=16812]: Waiting for error group managing segments... Aug 8 01:57:56.376023911 (16h18m18.120080771s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:57:56.376029224 (16h18m18.120086085s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:57:56.376032588 (16h18m18.120089451s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:57:56.522138524 (16h18m18.266195385s) [upload=16812]: Done uploading segments... Aug 8 01:57:56.522174260 (16h18m18.266231121s) [upload=16812]: Upload finished. err: <nil> Aug 8 01:58:40.668656265 (16h19m2.412713135s) [upload=16827]: Starting upload Aug 8 01:58:40.668711058 (16h19m2.412767924s) [upload=16827]: Done starting upload Aug 8 01:58:40.668790608 (16h19m2.412847457s) [upload=16827]: Uploading segments... Aug 8 01:58:40.668840572 (16h19m2.412897441s) [upload=16827]: Got next segment. Inline: true Aug 8 01:58:40.668846411 (16h19m2.412903277s) [upload=16827]: Waiting for error group managing segments... Aug 8 01:58:40.669005747 (16h19m2.413062607s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:58:40.669017356 (16h19m2.413074217s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:58:40.669021551 (16h19m2.413078412s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:58:40.816114713 (16h19m2.560171563s) [upload=16827]: Done uploading segments... Aug 8 01:58:40.816134617 (16h19m2.560191466s) [upload=16827]: Upload finished. err: <nil> Aug 8 01:59:05.627944078 (16h19m27.372000926s) [upload=16833]: Starting upload Aug 8 01:59:05.627998685 (16h19m27.372055535s) [upload=16833]: Done starting upload Aug 8 01:59:05.628118729 (16h19m27.372175578s) [upload=16833]: Uploading segments... Aug 8 01:59:05.628217606 (16h19m27.372274467s) [upload=16833]: Got next segment. Inline: true Aug 8 01:59:05.628225862 (16h19m27.372282734s) [upload=16833]: Waiting for error group managing segments... Aug 8 01:59:05.628334217 (16h19m27.372391068s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:05.628350984 (16h19m27.372407847s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:05.628354470 (16h19m27.372411329s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:05.774577746 (16h19m27.518634612s) [upload=16833]: Done uploading segments... Aug 8 01:59:05.774602383 (16h19m27.518659233s) [upload=16833]: Upload finished. err: <nil> Aug 8 01:59:37.369718935 (16h19m59.113775787s) [upload=16844]: Starting upload Aug 8 01:59:37.369812437 (16h19m59.113869298s) [upload=16844]: Done starting upload Aug 8 01:59:37.369887515 (16h19m59.113944368s) [upload=16844]: Uploading segments... Aug 8 01:59:37.370021093 (16h19m59.114077981s) [upload=16844]: Got next segment. Inline: true Aug 8 01:59:37.370029981 (16h19m59.114086848s) [upload=16844]: Waiting for error group managing segments... Aug 8 01:59:37.370102430 (16h19m59.114159293s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:37.370109420 (16h19m59.11416628s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:37.370113057 (16h19m59.114169917s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:37.726754734 (16h19m59.47081161s) [upload=16844]: Done uploading segments... Aug 8 01:59:37.726778784 (16h19m59.470835637s) [upload=16844]: Upload finished. err: <nil> Aug 8 02:00:24.719377480 (16h20m46.463434328s) [upload=16863]: Starting upload Aug 8 02:00:24.719456409 (16h20m46.463513255s) [upload=16863]: Done starting upload Aug 8 02:00:24.719560489 (16h20m46.463617335s) [upload=16863]: Uploading segments... Aug 8 02:00:24.719616926 (16h20m46.463673789s) [upload=16863]: Got next segment. Inline: true Aug 8 02:00:24.719622706 (16h20m46.463679552s) [upload=16863]: Waiting for error group managing segments... Aug 8 02:00:24.719659743 (16h20m46.463716591s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:24.719664652 (16h20m46.463721498s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:24.719667649 (16h20m46.463724496s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:25.030175327 (16h20m46.774232197s) [upload=16863]: Done uploading segments... Aug 8 02:00:25.030222980 (16h20m46.774279831s) [upload=16863]: Upload finished. err: <nil> Aug 8 02:00:46.211977832 (16h21m7.956034683s) [upload=16869]: Starting upload Aug 8 02:00:46.212032242 (16h21m7.956089102s) [upload=16869]: Done starting upload Aug 8 02:00:46.212101179 (16h21m7.956158028s) [upload=16869]: Uploading segments... Aug 8 02:00:46.212148507 (16h21m7.956205376s) [upload=16869]: Got next segment. Inline: true Aug 8 02:00:46.212155810 (16h21m7.956212671s) [upload=16869]: Waiting for error group managing segments... Aug 8 02:00:46.212197694 (16h21m7.956254544s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:46.212202763 (16h21m7.956259624s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:46.212206348 (16h21m7.956263209s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:46.360999669 (16h21m8.105056524s) [upload=16869]: Done uploading segments... Aug 8 02:00:46.361040611 (16h21m8.105097472s) [upload=16869]: Upload finished. err: <nil> Aug 8 02:01:57.357493061 (16h22m19.101549913s) [upload=16887]: Starting upload Aug 8 02:01:57.357550990 (16h22m19.101607841s) [upload=16887]: Done starting upload Aug 8 02:01:57.357634434 (16h22m19.101691284s) [upload=16887]: Uploading segments... Aug 8 02:01:57.357688424 (16h22m19.101745285s) [upload=16887]: Got next segment. Inline: true Aug 8 02:01:57.357693917 (16h22m19.101750778s) [upload=16887]: Waiting for error group managing segments... Aug 8 02:01:57.357741416 (16h22m19.101798267s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:01:57.357748493 (16h22m19.101805358s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:01:57.357753129 (16h22m19.101809997s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:01:57.874642140 (16h22m19.618698996s) [upload=16887]: Done uploading segments... Aug 8 02:01:57.874664164 (16h22m19.618721018s) [upload=16887]: Upload finished. err: <nil>
Duration: 854.728062ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.688504646s
FAIL (2025-08-08 02:10:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.688533413s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.....................X........................X............] duration:
834.912468ms
FAIL (2025-08-08 02:10:08 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 6751]: Done uploading segments... Aug 8 01:54:07.115487086 (16h14m28.859543939s) [upload=16751]: Upload finished. err: <nil> Aug 8 01:55:10.779008362 (16h15m32.523065211s) [upload=16769]: Starting upload Aug 8 01:55:10.779096198 (16h15m32.523153061s) [upload=16769]: Done starting upload Aug 8 01:55:10.779193425 (16h15m32.523250289s) [upload=16769]: Uploading segments... Aug 8 01:55:10.779250013 (16h15m32.523306883s) [upload=16769]: Got next segment. Inline: true Aug 8 01:55:10.779256039 (16h15m32.5233129s) [upload=16769]: Waiting for error group managing segments... Aug 8 01:55:10.779303624 (16h15m32.523360486s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:55:10.779312117 (16h15m32.523368978s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:55:10.779317881 (16h15m32.523374742s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:55:10.929585505 (16h15m32.673642367s) [upload=16769]: Done uploading segments... Aug 8 01:55:10.929610338 (16h15m32.673667199s) [upload=16769]: Upload finished. err: <nil> Aug 8 01:56:06.435484091 (16h16m28.179540953s) [upload=16784]: Starting upload Aug 8 01:56:06.435552910 (16h16m28.179609773s) [upload=16784]: Done starting upload Aug 8 01:56:06.435619333 (16h16m28.179676183s) [upload=16784]: Uploading segments... Aug 8 01:56:06.435665009 (16h16m28.179721877s) [upload=16784]: Got next segment. Inline: true Aug 8 01:56:06.435670176 (16h16m28.179727036s) [upload=16784]: Waiting for error group managing segments... Aug 8 01:56:06.435712868 (16h16m28.179769728s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:06.435718361 (16h16m28.179775225s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:06.435722349 (16h16m28.179779209s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:06.594737382 (16h16m28.33879423s) [upload=16784]: Done uploading segments... Aug 8 01:56:06.594776360 (16h16m28.338833223s) [upload=16784]: Upload finished. err: <nil> Aug 8 01:56:51.181730272 (16h17m12.925787122s) [upload=16797]: Starting upload Aug 8 01:56:51.181780502 (16h17m12.925837362s) [upload=16797]: Done starting upload Aug 8 01:56:51.181842082 (16h17m12.925898932s) [upload=16797]: Uploading segments... Aug 8 01:56:51.181882111 (16h17m12.925938981s) [upload=16797]: Got next segment. Inline: true Aug 8 01:56:51.181887528 (16h17m12.925944389s) [upload=16797]: Waiting for error group managing segments... Aug 8 01:56:51.181955795 (16h17m12.926012645s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:51.181963090 (16h17m12.926019943s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:51.181966550 (16h17m12.926023404s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:51.374537795 (16h17m13.118594648s) [upload=16797]: Done uploading segments... Aug 8 01:56:51.374553785 (16h17m13.11861064s) [upload=16797]: Upload finished. err: <nil> Aug 8 01:57:56.375733570 (16h18m18.119790416s) [upload=16812]: Starting upload Aug 8 01:57:56.375809631 (16h18m18.119866491s) [upload=16812]: Done starting upload Aug 8 01:57:56.375898814 (16h18m18.119955664s) [upload=16812]: Uploading segments... Aug 8 01:57:56.375972719 (16h18m18.120029579s) [upload=16812]: Got next segment. Inline: true Aug 8 01:57:56.375979950 (16h18m18.120036811s) [upload=16812]: Waiting for error group managing segments... Aug 8 01:57:56.376023911 (16h18m18.120080771s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:57:56.376029224 (16h18m18.120086085s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:57:56.376032588 (16h18m18.120089451s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:57:56.522138524 (16h18m18.266195385s) [upload=16812]: Done uploading segments... Aug 8 01:57:56.522174260 (16h18m18.266231121s) [upload=16812]: Upload finished. err: <nil> Aug 8 01:58:40.668656265 (16h19m2.412713135s) [upload=16827]: Starting upload Aug 8 01:58:40.668711058 (16h19m2.412767924s) [upload=16827]: Done starting upload Aug 8 01:58:40.668790608 (16h19m2.412847457s) [upload=16827]: Uploading segments... Aug 8 01:58:40.668840572 (16h19m2.412897441s) [upload=16827]: Got next segment. Inline: true Aug 8 01:58:40.668846411 (16h19m2.412903277s) [upload=16827]: Waiting for error group managing segments... Aug 8 01:58:40.669005747 (16h19m2.413062607s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:58:40.669017356 (16h19m2.413074217s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:58:40.669021551 (16h19m2.413078412s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:58:40.816114713 (16h19m2.560171563s) [upload=16827]: Done uploading segments... Aug 8 01:58:40.816134617 (16h19m2.560191466s) [upload=16827]: Upload finished. err: <nil> Aug 8 01:59:05.627944078 (16h19m27.372000926s) [upload=16833]: Starting upload Aug 8 01:59:05.627998685 (16h19m27.372055535s) [upload=16833]: Done starting upload Aug 8 01:59:05.628118729 (16h19m27.372175578s) [upload=16833]: Uploading segments... Aug 8 01:59:05.628217606 (16h19m27.372274467s) [upload=16833]: Got next segment. Inline: true Aug 8 01:59:05.628225862 (16h19m27.372282734s) [upload=16833]: Waiting for error group managing segments... Aug 8 01:59:05.628334217 (16h19m27.372391068s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:05.628350984 (16h19m27.372407847s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:05.628354470 (16h19m27.372411329s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:05.774577746 (16h19m27.518634612s) [upload=16833]: Done uploading segments... Aug 8 01:59:05.774602383 (16h19m27.518659233s) [upload=16833]: Upload finished. err: <nil> Aug 8 01:59:37.369718935 (16h19m59.113775787s) [upload=16844]: Starting upload Aug 8 01:59:37.369812437 (16h19m59.113869298s) [upload=16844]: Done starting upload Aug 8 01:59:37.369887515 (16h19m59.113944368s) [upload=16844]: Uploading segments... Aug 8 01:59:37.370021093 (16h19m59.114077981s) [upload=16844]: Got next segment. Inline: true Aug 8 01:59:37.370029981 (16h19m59.114086848s) [upload=16844]: Waiting for error group managing segments... Aug 8 01:59:37.370102430 (16h19m59.114159293s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:37.370109420 (16h19m59.11416628s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:37.370113057 (16h19m59.114169917s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:37.726754734 (16h19m59.47081161s) [upload=16844]: Done uploading segments... Aug 8 01:59:37.726778784 (16h19m59.470835637s) [upload=16844]: Upload finished. err: <nil> Aug 8 02:00:24.719377480 (16h20m46.463434328s) [upload=16863]: Starting upload Aug 8 02:00:24.719456409 (16h20m46.463513255s) [upload=16863]: Done starting upload Aug 8 02:00:24.719560489 (16h20m46.463617335s) [upload=16863]: Uploading segments... Aug 8 02:00:24.719616926 (16h20m46.463673789s) [upload=16863]: Got next segment. Inline: true Aug 8 02:00:24.719622706 (16h20m46.463679552s) [upload=16863]: Waiting for error group managing segments... Aug 8 02:00:24.719659743 (16h20m46.463716591s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:24.719664652 (16h20m46.463721498s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:24.719667649 (16h20m46.463724496s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:25.030175327 (16h20m46.774232197s) [upload=16863]: Done uploading segments... Aug 8 02:00:25.030222980 (16h20m46.774279831s) [upload=16863]: Upload finished. err: <nil> Aug 8 02:00:46.211977832 (16h21m7.956034683s) [upload=16869]: Starting upload Aug 8 02:00:46.212032242 (16h21m7.956089102s) [upload=16869]: Done starting upload Aug 8 02:00:46.212101179 (16h21m7.956158028s) [upload=16869]: Uploading segments... Aug 8 02:00:46.212148507 (16h21m7.956205376s) [upload=16869]: Got next segment. Inline: true Aug 8 02:00:46.212155810 (16h21m7.956212671s) [upload=16869]: Waiting for error group managing segments... Aug 8 02:00:46.212197694 (16h21m7.956254544s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:46.212202763 (16h21m7.956259624s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:46.212206348 (16h21m7.956263209s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:46.360999669 (16h21m8.105056524s) [upload=16869]: Done uploading segments... Aug 8 02:00:46.361040611 (16h21m8.105097472s) [upload=16869]: Upload finished. err: <nil> Aug 8 02:01:57.357493061 (16h22m19.101549913s) [upload=16887]: Starting upload Aug 8 02:01:57.357550990 (16h22m19.101607841s) [upload=16887]: Done starting upload Aug 8 02:01:57.357634434 (16h22m19.101691284s) [upload=16887]: Uploading segments... Aug 8 02:01:57.357688424 (16h22m19.101745285s) [upload=16887]: Got next segment. Inline: true Aug 8 02:01:57.357693917 (16h22m19.101750778s) [upload=16887]: Waiting for error group managing segments... Aug 8 02:01:57.357741416 (16h22m19.101798267s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:01:57.357748493 (16h22m19.101805358s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:01:57.357753129 (16h22m19.101809997s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:01:57.874642140 (16h22m19.618698996s) [upload=16887]: Done uploading segments... Aug 8 02:01:57.874664164 (16h22m19.618721018s) [upload=16887]: Upload finished. err: <nil>
Duration: 834.945829ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.407052999s
FAIL (2025-08-08 02:10:00 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.407083925s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X.....................X........................X...........] duration:
839.265324ms
FAIL (2025-08-08 02:09:49 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 6751]: Done uploading segments... Aug 8 01:54:07.115487086 (16h14m28.859543939s) [upload=16751]: Upload finished. err: <nil> Aug 8 01:55:10.779008362 (16h15m32.523065211s) [upload=16769]: Starting upload Aug 8 01:55:10.779096198 (16h15m32.523153061s) [upload=16769]: Done starting upload Aug 8 01:55:10.779193425 (16h15m32.523250289s) [upload=16769]: Uploading segments... Aug 8 01:55:10.779250013 (16h15m32.523306883s) [upload=16769]: Got next segment. Inline: true Aug 8 01:55:10.779256039 (16h15m32.5233129s) [upload=16769]: Waiting for error group managing segments... Aug 8 01:55:10.779303624 (16h15m32.523360486s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:55:10.779312117 (16h15m32.523368978s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:55:10.779317881 (16h15m32.523374742s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:55:10.929585505 (16h15m32.673642367s) [upload=16769]: Done uploading segments... Aug 8 01:55:10.929610338 (16h15m32.673667199s) [upload=16769]: Upload finished. err: <nil> Aug 8 01:56:06.435484091 (16h16m28.179540953s) [upload=16784]: Starting upload Aug 8 01:56:06.435552910 (16h16m28.179609773s) [upload=16784]: Done starting upload Aug 8 01:56:06.435619333 (16h16m28.179676183s) [upload=16784]: Uploading segments... Aug 8 01:56:06.435665009 (16h16m28.179721877s) [upload=16784]: Got next segment. Inline: true Aug 8 01:56:06.435670176 (16h16m28.179727036s) [upload=16784]: Waiting for error group managing segments... Aug 8 01:56:06.435712868 (16h16m28.179769728s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:06.435718361 (16h16m28.179775225s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:06.435722349 (16h16m28.179779209s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:06.594737382 (16h16m28.33879423s) [upload=16784]: Done uploading segments... Aug 8 01:56:06.594776360 (16h16m28.338833223s) [upload=16784]: Upload finished. err: <nil> Aug 8 01:56:51.181730272 (16h17m12.925787122s) [upload=16797]: Starting upload Aug 8 01:56:51.181780502 (16h17m12.925837362s) [upload=16797]: Done starting upload Aug 8 01:56:51.181842082 (16h17m12.925898932s) [upload=16797]: Uploading segments... Aug 8 01:56:51.181882111 (16h17m12.925938981s) [upload=16797]: Got next segment. Inline: true Aug 8 01:56:51.181887528 (16h17m12.925944389s) [upload=16797]: Waiting for error group managing segments... Aug 8 01:56:51.181955795 (16h17m12.926012645s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:51.181963090 (16h17m12.926019943s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:51.181966550 (16h17m12.926023404s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:51.374537795 (16h17m13.118594648s) [upload=16797]: Done uploading segments... Aug 8 01:56:51.374553785 (16h17m13.11861064s) [upload=16797]: Upload finished. err: <nil> Aug 8 01:57:56.375733570 (16h18m18.119790416s) [upload=16812]: Starting upload Aug 8 01:57:56.375809631 (16h18m18.119866491s) [upload=16812]: Done starting upload Aug 8 01:57:56.375898814 (16h18m18.119955664s) [upload=16812]: Uploading segments... Aug 8 01:57:56.375972719 (16h18m18.120029579s) [upload=16812]: Got next segment. Inline: true Aug 8 01:57:56.375979950 (16h18m18.120036811s) [upload=16812]: Waiting for error group managing segments... Aug 8 01:57:56.376023911 (16h18m18.120080771s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:57:56.376029224 (16h18m18.120086085s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:57:56.376032588 (16h18m18.120089451s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:57:56.522138524 (16h18m18.266195385s) [upload=16812]: Done uploading segments... Aug 8 01:57:56.522174260 (16h18m18.266231121s) [upload=16812]: Upload finished. err: <nil> Aug 8 01:58:40.668656265 (16h19m2.412713135s) [upload=16827]: Starting upload Aug 8 01:58:40.668711058 (16h19m2.412767924s) [upload=16827]: Done starting upload Aug 8 01:58:40.668790608 (16h19m2.412847457s) [upload=16827]: Uploading segments... Aug 8 01:58:40.668840572 (16h19m2.412897441s) [upload=16827]: Got next segment. Inline: true Aug 8 01:58:40.668846411 (16h19m2.412903277s) [upload=16827]: Waiting for error group managing segments... Aug 8 01:58:40.669005747 (16h19m2.413062607s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:58:40.669017356 (16h19m2.413074217s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:58:40.669021551 (16h19m2.413078412s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:58:40.816114713 (16h19m2.560171563s) [upload=16827]: Done uploading segments... Aug 8 01:58:40.816134617 (16h19m2.560191466s) [upload=16827]: Upload finished. err: <nil> Aug 8 01:59:05.627944078 (16h19m27.372000926s) [upload=16833]: Starting upload Aug 8 01:59:05.627998685 (16h19m27.372055535s) [upload=16833]: Done starting upload Aug 8 01:59:05.628118729 (16h19m27.372175578s) [upload=16833]: Uploading segments... Aug 8 01:59:05.628217606 (16h19m27.372274467s) [upload=16833]: Got next segment. Inline: true Aug 8 01:59:05.628225862 (16h19m27.372282734s) [upload=16833]: Waiting for error group managing segments... Aug 8 01:59:05.628334217 (16h19m27.372391068s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:05.628350984 (16h19m27.372407847s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:05.628354470 (16h19m27.372411329s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:05.774577746 (16h19m27.518634612s) [upload=16833]: Done uploading segments... Aug 8 01:59:05.774602383 (16h19m27.518659233s) [upload=16833]: Upload finished. err: <nil> Aug 8 01:59:37.369718935 (16h19m59.113775787s) [upload=16844]: Starting upload Aug 8 01:59:37.369812437 (16h19m59.113869298s) [upload=16844]: Done starting upload Aug 8 01:59:37.369887515 (16h19m59.113944368s) [upload=16844]: Uploading segments... Aug 8 01:59:37.370021093 (16h19m59.114077981s) [upload=16844]: Got next segment. Inline: true Aug 8 01:59:37.370029981 (16h19m59.114086848s) [upload=16844]: Waiting for error group managing segments... Aug 8 01:59:37.370102430 (16h19m59.114159293s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:37.370109420 (16h19m59.11416628s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:37.370113057 (16h19m59.114169917s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:37.726754734 (16h19m59.47081161s) [upload=16844]: Done uploading segments... Aug 8 01:59:37.726778784 (16h19m59.470835637s) [upload=16844]: Upload finished. err: <nil> Aug 8 02:00:24.719377480 (16h20m46.463434328s) [upload=16863]: Starting upload Aug 8 02:00:24.719456409 (16h20m46.463513255s) [upload=16863]: Done starting upload Aug 8 02:00:24.719560489 (16h20m46.463617335s) [upload=16863]: Uploading segments... Aug 8 02:00:24.719616926 (16h20m46.463673789s) [upload=16863]: Got next segment. Inline: true Aug 8 02:00:24.719622706 (16h20m46.463679552s) [upload=16863]: Waiting for error group managing segments... Aug 8 02:00:24.719659743 (16h20m46.463716591s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:24.719664652 (16h20m46.463721498s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:24.719667649 (16h20m46.463724496s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:25.030175327 (16h20m46.774232197s) [upload=16863]: Done uploading segments... Aug 8 02:00:25.030222980 (16h20m46.774279831s) [upload=16863]: Upload finished. err: <nil> Aug 8 02:00:46.211977832 (16h21m7.956034683s) [upload=16869]: Starting upload Aug 8 02:00:46.212032242 (16h21m7.956089102s) [upload=16869]: Done starting upload Aug 8 02:00:46.212101179 (16h21m7.956158028s) [upload=16869]: Uploading segments... Aug 8 02:00:46.212148507 (16h21m7.956205376s) [upload=16869]: Got next segment. Inline: true Aug 8 02:00:46.212155810 (16h21m7.956212671s) [upload=16869]: Waiting for error group managing segments... Aug 8 02:00:46.212197694 (16h21m7.956254544s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:46.212202763 (16h21m7.956259624s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:46.212206348 (16h21m7.956263209s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:46.360999669 (16h21m8.105056524s) [upload=16869]: Done uploading segments... Aug 8 02:00:46.361040611 (16h21m8.105097472s) [upload=16869]: Upload finished. err: <nil> Aug 8 02:01:57.357493061 (16h22m19.101549913s) [upload=16887]: Starting upload Aug 8 02:01:57.357550990 (16h22m19.101607841s) [upload=16887]: Done starting upload Aug 8 02:01:57.357634434 (16h22m19.101691284s) [upload=16887]: Uploading segments... Aug 8 02:01:57.357688424 (16h22m19.101745285s) [upload=16887]: Got next segment. Inline: true Aug 8 02:01:57.357693917 (16h22m19.101750778s) [upload=16887]: Waiting for error group managing segments... Aug 8 02:01:57.357741416 (16h22m19.101798267s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:01:57.357748493 (16h22m19.101805358s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:01:57.357753129 (16h22m19.101809997s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:01:57.874642140 (16h22m19.618698996s) [upload=16887]: Done uploading segments... Aug 8 02:01:57.874664164 (16h22m19.618721018s) [upload=16887]: Upload finished. err: <nil>
Duration: 839.295299ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.857331873s
FAIL (2025-08-08 02:09:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.857368413s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.501325307s
FAIL (2025-08-08 02:09:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.501361635s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X.....................X........................X..........] duration:
825.390708ms
FAIL (2025-08-08 02:08:41 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 6751]: Done uploading segments... Aug 8 01:54:07.115487086 (16h14m28.859543939s) [upload=16751]: Upload finished. err: <nil> Aug 8 01:55:10.779008362 (16h15m32.523065211s) [upload=16769]: Starting upload Aug 8 01:55:10.779096198 (16h15m32.523153061s) [upload=16769]: Done starting upload Aug 8 01:55:10.779193425 (16h15m32.523250289s) [upload=16769]: Uploading segments... Aug 8 01:55:10.779250013 (16h15m32.523306883s) [upload=16769]: Got next segment. Inline: true Aug 8 01:55:10.779256039 (16h15m32.5233129s) [upload=16769]: Waiting for error group managing segments... Aug 8 01:55:10.779303624 (16h15m32.523360486s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:55:10.779312117 (16h15m32.523368978s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:55:10.779317881 (16h15m32.523374742s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:55:10.929585505 (16h15m32.673642367s) [upload=16769]: Done uploading segments... Aug 8 01:55:10.929610338 (16h15m32.673667199s) [upload=16769]: Upload finished. err: <nil> Aug 8 01:56:06.435484091 (16h16m28.179540953s) [upload=16784]: Starting upload Aug 8 01:56:06.435552910 (16h16m28.179609773s) [upload=16784]: Done starting upload Aug 8 01:56:06.435619333 (16h16m28.179676183s) [upload=16784]: Uploading segments... Aug 8 01:56:06.435665009 (16h16m28.179721877s) [upload=16784]: Got next segment. Inline: true Aug 8 01:56:06.435670176 (16h16m28.179727036s) [upload=16784]: Waiting for error group managing segments... Aug 8 01:56:06.435712868 (16h16m28.179769728s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:06.435718361 (16h16m28.179775225s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:06.435722349 (16h16m28.179779209s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:06.594737382 (16h16m28.33879423s) [upload=16784]: Done uploading segments... Aug 8 01:56:06.594776360 (16h16m28.338833223s) [upload=16784]: Upload finished. err: <nil> Aug 8 01:56:51.181730272 (16h17m12.925787122s) [upload=16797]: Starting upload Aug 8 01:56:51.181780502 (16h17m12.925837362s) [upload=16797]: Done starting upload Aug 8 01:56:51.181842082 (16h17m12.925898932s) [upload=16797]: Uploading segments... Aug 8 01:56:51.181882111 (16h17m12.925938981s) [upload=16797]: Got next segment. Inline: true Aug 8 01:56:51.181887528 (16h17m12.925944389s) [upload=16797]: Waiting for error group managing segments... Aug 8 01:56:51.181955795 (16h17m12.926012645s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:51.181963090 (16h17m12.926019943s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:51.181966550 (16h17m12.926023404s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:51.374537795 (16h17m13.118594648s) [upload=16797]: Done uploading segments... Aug 8 01:56:51.374553785 (16h17m13.11861064s) [upload=16797]: Upload finished. err: <nil> Aug 8 01:57:56.375733570 (16h18m18.119790416s) [upload=16812]: Starting upload Aug 8 01:57:56.375809631 (16h18m18.119866491s) [upload=16812]: Done starting upload Aug 8 01:57:56.375898814 (16h18m18.119955664s) [upload=16812]: Uploading segments... Aug 8 01:57:56.375972719 (16h18m18.120029579s) [upload=16812]: Got next segment. Inline: true Aug 8 01:57:56.375979950 (16h18m18.120036811s) [upload=16812]: Waiting for error group managing segments... Aug 8 01:57:56.376023911 (16h18m18.120080771s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:57:56.376029224 (16h18m18.120086085s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:57:56.376032588 (16h18m18.120089451s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:57:56.522138524 (16h18m18.266195385s) [upload=16812]: Done uploading segments... Aug 8 01:57:56.522174260 (16h18m18.266231121s) [upload=16812]: Upload finished. err: <nil> Aug 8 01:58:40.668656265 (16h19m2.412713135s) [upload=16827]: Starting upload Aug 8 01:58:40.668711058 (16h19m2.412767924s) [upload=16827]: Done starting upload Aug 8 01:58:40.668790608 (16h19m2.412847457s) [upload=16827]: Uploading segments... Aug 8 01:58:40.668840572 (16h19m2.412897441s) [upload=16827]: Got next segment. Inline: true Aug 8 01:58:40.668846411 (16h19m2.412903277s) [upload=16827]: Waiting for error group managing segments... Aug 8 01:58:40.669005747 (16h19m2.413062607s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:58:40.669017356 (16h19m2.413074217s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:58:40.669021551 (16h19m2.413078412s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:58:40.816114713 (16h19m2.560171563s) [upload=16827]: Done uploading segments... Aug 8 01:58:40.816134617 (16h19m2.560191466s) [upload=16827]: Upload finished. err: <nil> Aug 8 01:59:05.627944078 (16h19m27.372000926s) [upload=16833]: Starting upload Aug 8 01:59:05.627998685 (16h19m27.372055535s) [upload=16833]: Done starting upload Aug 8 01:59:05.628118729 (16h19m27.372175578s) [upload=16833]: Uploading segments... Aug 8 01:59:05.628217606 (16h19m27.372274467s) [upload=16833]: Got next segment. Inline: true Aug 8 01:59:05.628225862 (16h19m27.372282734s) [upload=16833]: Waiting for error group managing segments... Aug 8 01:59:05.628334217 (16h19m27.372391068s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:05.628350984 (16h19m27.372407847s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:05.628354470 (16h19m27.372411329s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:05.774577746 (16h19m27.518634612s) [upload=16833]: Done uploading segments... Aug 8 01:59:05.774602383 (16h19m27.518659233s) [upload=16833]: Upload finished. err: <nil> Aug 8 01:59:37.369718935 (16h19m59.113775787s) [upload=16844]: Starting upload Aug 8 01:59:37.369812437 (16h19m59.113869298s) [upload=16844]: Done starting upload Aug 8 01:59:37.369887515 (16h19m59.113944368s) [upload=16844]: Uploading segments... Aug 8 01:59:37.370021093 (16h19m59.114077981s) [upload=16844]: Got next segment. Inline: true Aug 8 01:59:37.370029981 (16h19m59.114086848s) [upload=16844]: Waiting for error group managing segments... Aug 8 01:59:37.370102430 (16h19m59.114159293s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:37.370109420 (16h19m59.11416628s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:37.370113057 (16h19m59.114169917s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:37.726754734 (16h19m59.47081161s) [upload=16844]: Done uploading segments... Aug 8 01:59:37.726778784 (16h19m59.470835637s) [upload=16844]: Upload finished. err: <nil> Aug 8 02:00:24.719377480 (16h20m46.463434328s) [upload=16863]: Starting upload Aug 8 02:00:24.719456409 (16h20m46.463513255s) [upload=16863]: Done starting upload Aug 8 02:00:24.719560489 (16h20m46.463617335s) [upload=16863]: Uploading segments... Aug 8 02:00:24.719616926 (16h20m46.463673789s) [upload=16863]: Got next segment. Inline: true Aug 8 02:00:24.719622706 (16h20m46.463679552s) [upload=16863]: Waiting for error group managing segments... Aug 8 02:00:24.719659743 (16h20m46.463716591s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:24.719664652 (16h20m46.463721498s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:24.719667649 (16h20m46.463724496s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:25.030175327 (16h20m46.774232197s) [upload=16863]: Done uploading segments... Aug 8 02:00:25.030222980 (16h20m46.774279831s) [upload=16863]: Upload finished. err: <nil> Aug 8 02:00:46.211977832 (16h21m7.956034683s) [upload=16869]: Starting upload Aug 8 02:00:46.212032242 (16h21m7.956089102s) [upload=16869]: Done starting upload Aug 8 02:00:46.212101179 (16h21m7.956158028s) [upload=16869]: Uploading segments... Aug 8 02:00:46.212148507 (16h21m7.956205376s) [upload=16869]: Got next segment. Inline: true Aug 8 02:00:46.212155810 (16h21m7.956212671s) [upload=16869]: Waiting for error group managing segments... Aug 8 02:00:46.212197694 (16h21m7.956254544s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:46.212202763 (16h21m7.956259624s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:46.212206348 (16h21m7.956263209s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:46.360999669 (16h21m8.105056524s) [upload=16869]: Done uploading segments... Aug 8 02:00:46.361040611 (16h21m8.105097472s) [upload=16869]: Upload finished. err: <nil> Aug 8 02:01:57.357493061 (16h22m19.101549913s) [upload=16887]: Starting upload Aug 8 02:01:57.357550990 (16h22m19.101607841s) [upload=16887]: Done starting upload Aug 8 02:01:57.357634434 (16h22m19.101691284s) [upload=16887]: Uploading segments... Aug 8 02:01:57.357688424 (16h22m19.101745285s) [upload=16887]: Got next segment. Inline: true Aug 8 02:01:57.357693917 (16h22m19.101750778s) [upload=16887]: Waiting for error group managing segments... Aug 8 02:01:57.357741416 (16h22m19.101798267s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:01:57.357748493 (16h22m19.101805358s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:01:57.357753129 (16h22m19.101809997s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:01:57.874642140 (16h22m19.618698996s) [upload=16887]: Done uploading segments... Aug 8 02:01:57.874664164 (16h22m19.618721018s) [upload=16887]: Upload finished. err: <nil>
Duration: 825.437846ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.604511434s
FAIL (2025-08-08 02:08:05 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.60454125s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X.....................X........................X.........] duration:
997.089434ms
FAIL (2025-08-08 02:07:50 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 6751]: Done uploading segments... Aug 8 01:54:07.115487086 (16h14m28.859543939s) [upload=16751]: Upload finished. err: <nil> Aug 8 01:55:10.779008362 (16h15m32.523065211s) [upload=16769]: Starting upload Aug 8 01:55:10.779096198 (16h15m32.523153061s) [upload=16769]: Done starting upload Aug 8 01:55:10.779193425 (16h15m32.523250289s) [upload=16769]: Uploading segments... Aug 8 01:55:10.779250013 (16h15m32.523306883s) [upload=16769]: Got next segment. Inline: true Aug 8 01:55:10.779256039 (16h15m32.5233129s) [upload=16769]: Waiting for error group managing segments... Aug 8 01:55:10.779303624 (16h15m32.523360486s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:55:10.779312117 (16h15m32.523368978s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:55:10.779317881 (16h15m32.523374742s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:55:10.929585505 (16h15m32.673642367s) [upload=16769]: Done uploading segments... Aug 8 01:55:10.929610338 (16h15m32.673667199s) [upload=16769]: Upload finished. err: <nil> Aug 8 01:56:06.435484091 (16h16m28.179540953s) [upload=16784]: Starting upload Aug 8 01:56:06.435552910 (16h16m28.179609773s) [upload=16784]: Done starting upload Aug 8 01:56:06.435619333 (16h16m28.179676183s) [upload=16784]: Uploading segments... Aug 8 01:56:06.435665009 (16h16m28.179721877s) [upload=16784]: Got next segment. Inline: true Aug 8 01:56:06.435670176 (16h16m28.179727036s) [upload=16784]: Waiting for error group managing segments... Aug 8 01:56:06.435712868 (16h16m28.179769728s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:06.435718361 (16h16m28.179775225s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:06.435722349 (16h16m28.179779209s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:06.594737382 (16h16m28.33879423s) [upload=16784]: Done uploading segments... Aug 8 01:56:06.594776360 (16h16m28.338833223s) [upload=16784]: Upload finished. err: <nil> Aug 8 01:56:51.181730272 (16h17m12.925787122s) [upload=16797]: Starting upload Aug 8 01:56:51.181780502 (16h17m12.925837362s) [upload=16797]: Done starting upload Aug 8 01:56:51.181842082 (16h17m12.925898932s) [upload=16797]: Uploading segments... Aug 8 01:56:51.181882111 (16h17m12.925938981s) [upload=16797]: Got next segment. Inline: true Aug 8 01:56:51.181887528 (16h17m12.925944389s) [upload=16797]: Waiting for error group managing segments... Aug 8 01:56:51.181955795 (16h17m12.926012645s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:51.181963090 (16h17m12.926019943s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:51.181966550 (16h17m12.926023404s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:51.374537795 (16h17m13.118594648s) [upload=16797]: Done uploading segments... Aug 8 01:56:51.374553785 (16h17m13.11861064s) [upload=16797]: Upload finished. err: <nil> Aug 8 01:57:56.375733570 (16h18m18.119790416s) [upload=16812]: Starting upload Aug 8 01:57:56.375809631 (16h18m18.119866491s) [upload=16812]: Done starting upload Aug 8 01:57:56.375898814 (16h18m18.119955664s) [upload=16812]: Uploading segments... Aug 8 01:57:56.375972719 (16h18m18.120029579s) [upload=16812]: Got next segment. Inline: true Aug 8 01:57:56.375979950 (16h18m18.120036811s) [upload=16812]: Waiting for error group managing segments... Aug 8 01:57:56.376023911 (16h18m18.120080771s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:57:56.376029224 (16h18m18.120086085s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:57:56.376032588 (16h18m18.120089451s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:57:56.522138524 (16h18m18.266195385s) [upload=16812]: Done uploading segments... Aug 8 01:57:56.522174260 (16h18m18.266231121s) [upload=16812]: Upload finished. err: <nil> Aug 8 01:58:40.668656265 (16h19m2.412713135s) [upload=16827]: Starting upload Aug 8 01:58:40.668711058 (16h19m2.412767924s) [upload=16827]: Done starting upload Aug 8 01:58:40.668790608 (16h19m2.412847457s) [upload=16827]: Uploading segments... Aug 8 01:58:40.668840572 (16h19m2.412897441s) [upload=16827]: Got next segment. Inline: true Aug 8 01:58:40.668846411 (16h19m2.412903277s) [upload=16827]: Waiting for error group managing segments... Aug 8 01:58:40.669005747 (16h19m2.413062607s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:58:40.669017356 (16h19m2.413074217s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:58:40.669021551 (16h19m2.413078412s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:58:40.816114713 (16h19m2.560171563s) [upload=16827]: Done uploading segments... Aug 8 01:58:40.816134617 (16h19m2.560191466s) [upload=16827]: Upload finished. err: <nil> Aug 8 01:59:05.627944078 (16h19m27.372000926s) [upload=16833]: Starting upload Aug 8 01:59:05.627998685 (16h19m27.372055535s) [upload=16833]: Done starting upload Aug 8 01:59:05.628118729 (16h19m27.372175578s) [upload=16833]: Uploading segments... Aug 8 01:59:05.628217606 (16h19m27.372274467s) [upload=16833]: Got next segment. Inline: true Aug 8 01:59:05.628225862 (16h19m27.372282734s) [upload=16833]: Waiting for error group managing segments... Aug 8 01:59:05.628334217 (16h19m27.372391068s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:05.628350984 (16h19m27.372407847s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:05.628354470 (16h19m27.372411329s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:05.774577746 (16h19m27.518634612s) [upload=16833]: Done uploading segments... Aug 8 01:59:05.774602383 (16h19m27.518659233s) [upload=16833]: Upload finished. err: <nil> Aug 8 01:59:37.369718935 (16h19m59.113775787s) [upload=16844]: Starting upload Aug 8 01:59:37.369812437 (16h19m59.113869298s) [upload=16844]: Done starting upload Aug 8 01:59:37.369887515 (16h19m59.113944368s) [upload=16844]: Uploading segments... Aug 8 01:59:37.370021093 (16h19m59.114077981s) [upload=16844]: Got next segment. Inline: true Aug 8 01:59:37.370029981 (16h19m59.114086848s) [upload=16844]: Waiting for error group managing segments... Aug 8 01:59:37.370102430 (16h19m59.114159293s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:37.370109420 (16h19m59.11416628s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:37.370113057 (16h19m59.114169917s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:37.726754734 (16h19m59.47081161s) [upload=16844]: Done uploading segments... Aug 8 01:59:37.726778784 (16h19m59.470835637s) [upload=16844]: Upload finished. err: <nil> Aug 8 02:00:24.719377480 (16h20m46.463434328s) [upload=16863]: Starting upload Aug 8 02:00:24.719456409 (16h20m46.463513255s) [upload=16863]: Done starting upload Aug 8 02:00:24.719560489 (16h20m46.463617335s) [upload=16863]: Uploading segments... Aug 8 02:00:24.719616926 (16h20m46.463673789s) [upload=16863]: Got next segment. Inline: true Aug 8 02:00:24.719622706 (16h20m46.463679552s) [upload=16863]: Waiting for error group managing segments... Aug 8 02:00:24.719659743 (16h20m46.463716591s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:24.719664652 (16h20m46.463721498s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:24.719667649 (16h20m46.463724496s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:25.030175327 (16h20m46.774232197s) [upload=16863]: Done uploading segments... Aug 8 02:00:25.030222980 (16h20m46.774279831s) [upload=16863]: Upload finished. err: <nil> Aug 8 02:00:46.211977832 (16h21m7.956034683s) [upload=16869]: Starting upload Aug 8 02:00:46.212032242 (16h21m7.956089102s) [upload=16869]: Done starting upload Aug 8 02:00:46.212101179 (16h21m7.956158028s) [upload=16869]: Uploading segments... Aug 8 02:00:46.212148507 (16h21m7.956205376s) [upload=16869]: Got next segment. Inline: true Aug 8 02:00:46.212155810 (16h21m7.956212671s) [upload=16869]: Waiting for error group managing segments... Aug 8 02:00:46.212197694 (16h21m7.956254544s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:46.212202763 (16h21m7.956259624s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:46.212206348 (16h21m7.956263209s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:46.360999669 (16h21m8.105056524s) [upload=16869]: Done uploading segments... Aug 8 02:00:46.361040611 (16h21m8.105097472s) [upload=16869]: Upload finished. err: <nil> Aug 8 02:01:57.357493061 (16h22m19.101549913s) [upload=16887]: Starting upload Aug 8 02:01:57.357550990 (16h22m19.101607841s) [upload=16887]: Done starting upload Aug 8 02:01:57.357634434 (16h22m19.101691284s) [upload=16887]: Uploading segments... Aug 8 02:01:57.357688424 (16h22m19.101745285s) [upload=16887]: Got next segment. Inline: true Aug 8 02:01:57.357693917 (16h22m19.101750778s) [upload=16887]: Waiting for error group managing segments... Aug 8 02:01:57.357741416 (16h22m19.101798267s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:01:57.357748493 (16h22m19.101805358s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:01:57.357753129 (16h22m19.101809997s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:01:57.874642140 (16h22m19.618698996s) [upload=16887]: Done uploading segments... Aug 8 02:01:57.874664164 (16h22m19.618721018s) [upload=16887]: Upload finished. err: <nil>
Duration: 997.186852ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X.....................X........................X........] duration:
842.566958ms
FAIL (2025-08-08 02:07:34 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 6751]: Done uploading segments... Aug 8 01:54:07.115487086 (16h14m28.859543939s) [upload=16751]: Upload finished. err: <nil> Aug 8 01:55:10.779008362 (16h15m32.523065211s) [upload=16769]: Starting upload Aug 8 01:55:10.779096198 (16h15m32.523153061s) [upload=16769]: Done starting upload Aug 8 01:55:10.779193425 (16h15m32.523250289s) [upload=16769]: Uploading segments... Aug 8 01:55:10.779250013 (16h15m32.523306883s) [upload=16769]: Got next segment. Inline: true Aug 8 01:55:10.779256039 (16h15m32.5233129s) [upload=16769]: Waiting for error group managing segments... Aug 8 01:55:10.779303624 (16h15m32.523360486s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:55:10.779312117 (16h15m32.523368978s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:55:10.779317881 (16h15m32.523374742s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:55:10.929585505 (16h15m32.673642367s) [upload=16769]: Done uploading segments... Aug 8 01:55:10.929610338 (16h15m32.673667199s) [upload=16769]: Upload finished. err: <nil> Aug 8 01:56:06.435484091 (16h16m28.179540953s) [upload=16784]: Starting upload Aug 8 01:56:06.435552910 (16h16m28.179609773s) [upload=16784]: Done starting upload Aug 8 01:56:06.435619333 (16h16m28.179676183s) [upload=16784]: Uploading segments... Aug 8 01:56:06.435665009 (16h16m28.179721877s) [upload=16784]: Got next segment. Inline: true Aug 8 01:56:06.435670176 (16h16m28.179727036s) [upload=16784]: Waiting for error group managing segments... Aug 8 01:56:06.435712868 (16h16m28.179769728s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:06.435718361 (16h16m28.179775225s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:06.435722349 (16h16m28.179779209s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:06.594737382 (16h16m28.33879423s) [upload=16784]: Done uploading segments... Aug 8 01:56:06.594776360 (16h16m28.338833223s) [upload=16784]: Upload finished. err: <nil> Aug 8 01:56:51.181730272 (16h17m12.925787122s) [upload=16797]: Starting upload Aug 8 01:56:51.181780502 (16h17m12.925837362s) [upload=16797]: Done starting upload Aug 8 01:56:51.181842082 (16h17m12.925898932s) [upload=16797]: Uploading segments... Aug 8 01:56:51.181882111 (16h17m12.925938981s) [upload=16797]: Got next segment. Inline: true Aug 8 01:56:51.181887528 (16h17m12.925944389s) [upload=16797]: Waiting for error group managing segments... Aug 8 01:56:51.181955795 (16h17m12.926012645s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:51.181963090 (16h17m12.926019943s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:51.181966550 (16h17m12.926023404s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:51.374537795 (16h17m13.118594648s) [upload=16797]: Done uploading segments... Aug 8 01:56:51.374553785 (16h17m13.11861064s) [upload=16797]: Upload finished. err: <nil> Aug 8 01:57:56.375733570 (16h18m18.119790416s) [upload=16812]: Starting upload Aug 8 01:57:56.375809631 (16h18m18.119866491s) [upload=16812]: Done starting upload Aug 8 01:57:56.375898814 (16h18m18.119955664s) [upload=16812]: Uploading segments... Aug 8 01:57:56.375972719 (16h18m18.120029579s) [upload=16812]: Got next segment. Inline: true Aug 8 01:57:56.375979950 (16h18m18.120036811s) [upload=16812]: Waiting for error group managing segments... Aug 8 01:57:56.376023911 (16h18m18.120080771s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:57:56.376029224 (16h18m18.120086085s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:57:56.376032588 (16h18m18.120089451s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:57:56.522138524 (16h18m18.266195385s) [upload=16812]: Done uploading segments... Aug 8 01:57:56.522174260 (16h18m18.266231121s) [upload=16812]: Upload finished. err: <nil> Aug 8 01:58:40.668656265 (16h19m2.412713135s) [upload=16827]: Starting upload Aug 8 01:58:40.668711058 (16h19m2.412767924s) [upload=16827]: Done starting upload Aug 8 01:58:40.668790608 (16h19m2.412847457s) [upload=16827]: Uploading segments... Aug 8 01:58:40.668840572 (16h19m2.412897441s) [upload=16827]: Got next segment. Inline: true Aug 8 01:58:40.668846411 (16h19m2.412903277s) [upload=16827]: Waiting for error group managing segments... Aug 8 01:58:40.669005747 (16h19m2.413062607s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:58:40.669017356 (16h19m2.413074217s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:58:40.669021551 (16h19m2.413078412s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:58:40.816114713 (16h19m2.560171563s) [upload=16827]: Done uploading segments... Aug 8 01:58:40.816134617 (16h19m2.560191466s) [upload=16827]: Upload finished. err: <nil> Aug 8 01:59:05.627944078 (16h19m27.372000926s) [upload=16833]: Starting upload Aug 8 01:59:05.627998685 (16h19m27.372055535s) [upload=16833]: Done starting upload Aug 8 01:59:05.628118729 (16h19m27.372175578s) [upload=16833]: Uploading segments... Aug 8 01:59:05.628217606 (16h19m27.372274467s) [upload=16833]: Got next segment. Inline: true Aug 8 01:59:05.628225862 (16h19m27.372282734s) [upload=16833]: Waiting for error group managing segments... Aug 8 01:59:05.628334217 (16h19m27.372391068s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:05.628350984 (16h19m27.372407847s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:05.628354470 (16h19m27.372411329s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:05.774577746 (16h19m27.518634612s) [upload=16833]: Done uploading segments... Aug 8 01:59:05.774602383 (16h19m27.518659233s) [upload=16833]: Upload finished. err: <nil> Aug 8 01:59:37.369718935 (16h19m59.113775787s) [upload=16844]: Starting upload Aug 8 01:59:37.369812437 (16h19m59.113869298s) [upload=16844]: Done starting upload Aug 8 01:59:37.369887515 (16h19m59.113944368s) [upload=16844]: Uploading segments... Aug 8 01:59:37.370021093 (16h19m59.114077981s) [upload=16844]: Got next segment. Inline: true Aug 8 01:59:37.370029981 (16h19m59.114086848s) [upload=16844]: Waiting for error group managing segments... Aug 8 01:59:37.370102430 (16h19m59.114159293s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:37.370109420 (16h19m59.11416628s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:37.370113057 (16h19m59.114169917s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:37.726754734 (16h19m59.47081161s) [upload=16844]: Done uploading segments... Aug 8 01:59:37.726778784 (16h19m59.470835637s) [upload=16844]: Upload finished. err: <nil> Aug 8 02:00:24.719377480 (16h20m46.463434328s) [upload=16863]: Starting upload Aug 8 02:00:24.719456409 (16h20m46.463513255s) [upload=16863]: Done starting upload Aug 8 02:00:24.719560489 (16h20m46.463617335s) [upload=16863]: Uploading segments... Aug 8 02:00:24.719616926 (16h20m46.463673789s) [upload=16863]: Got next segment. Inline: true Aug 8 02:00:24.719622706 (16h20m46.463679552s) [upload=16863]: Waiting for error group managing segments... Aug 8 02:00:24.719659743 (16h20m46.463716591s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:24.719664652 (16h20m46.463721498s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:24.719667649 (16h20m46.463724496s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:25.030175327 (16h20m46.774232197s) [upload=16863]: Done uploading segments... Aug 8 02:00:25.030222980 (16h20m46.774279831s) [upload=16863]: Upload finished. err: <nil> Aug 8 02:00:46.211977832 (16h21m7.956034683s) [upload=16869]: Starting upload Aug 8 02:00:46.212032242 (16h21m7.956089102s) [upload=16869]: Done starting upload Aug 8 02:00:46.212101179 (16h21m7.956158028s) [upload=16869]: Uploading segments... Aug 8 02:00:46.212148507 (16h21m7.956205376s) [upload=16869]: Got next segment. Inline: true Aug 8 02:00:46.212155810 (16h21m7.956212671s) [upload=16869]: Waiting for error group managing segments... Aug 8 02:00:46.212197694 (16h21m7.956254544s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:46.212202763 (16h21m7.956259624s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:46.212206348 (16h21m7.956263209s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:46.360999669 (16h21m8.105056524s) [upload=16869]: Done uploading segments... Aug 8 02:00:46.361040611 (16h21m8.105097472s) [upload=16869]: Upload finished. err: <nil> Aug 8 02:01:57.357493061 (16h22m19.101549913s) [upload=16887]: Starting upload Aug 8 02:01:57.357550990 (16h22m19.101607841s) [upload=16887]: Done starting upload Aug 8 02:01:57.357634434 (16h22m19.101691284s) [upload=16887]: Uploading segments... Aug 8 02:01:57.357688424 (16h22m19.101745285s) [upload=16887]: Got next segment. Inline: true Aug 8 02:01:57.357693917 (16h22m19.101750778s) [upload=16887]: Waiting for error group managing segments... Aug 8 02:01:57.357741416 (16h22m19.101798267s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:01:57.357748493 (16h22m19.101805358s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:01:57.357753129 (16h22m19.101809997s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:01:57.874642140 (16h22m19.618698996s) [upload=16887]: Done uploading segments... Aug 8 02:01:57.874664164 (16h22m19.618721018s) [upload=16887]: Upload finished. err: <nil>
Duration: 842.597422ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.468589711s
FAIL (2025-08-08 02:07:06 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.468625329s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X.....................X........................X.......] duration:
820.431765ms
FAIL (2025-08-08 02:07:06 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 6751]: Done uploading segments... Aug 8 01:54:07.115487086 (16h14m28.859543939s) [upload=16751]: Upload finished. err: <nil> Aug 8 01:55:10.779008362 (16h15m32.523065211s) [upload=16769]: Starting upload Aug 8 01:55:10.779096198 (16h15m32.523153061s) [upload=16769]: Done starting upload Aug 8 01:55:10.779193425 (16h15m32.523250289s) [upload=16769]: Uploading segments... Aug 8 01:55:10.779250013 (16h15m32.523306883s) [upload=16769]: Got next segment. Inline: true Aug 8 01:55:10.779256039 (16h15m32.5233129s) [upload=16769]: Waiting for error group managing segments... Aug 8 01:55:10.779303624 (16h15m32.523360486s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:55:10.779312117 (16h15m32.523368978s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:55:10.779317881 (16h15m32.523374742s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:55:10.929585505 (16h15m32.673642367s) [upload=16769]: Done uploading segments... Aug 8 01:55:10.929610338 (16h15m32.673667199s) [upload=16769]: Upload finished. err: <nil> Aug 8 01:56:06.435484091 (16h16m28.179540953s) [upload=16784]: Starting upload Aug 8 01:56:06.435552910 (16h16m28.179609773s) [upload=16784]: Done starting upload Aug 8 01:56:06.435619333 (16h16m28.179676183s) [upload=16784]: Uploading segments... Aug 8 01:56:06.435665009 (16h16m28.179721877s) [upload=16784]: Got next segment. Inline: true Aug 8 01:56:06.435670176 (16h16m28.179727036s) [upload=16784]: Waiting for error group managing segments... Aug 8 01:56:06.435712868 (16h16m28.179769728s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:06.435718361 (16h16m28.179775225s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:06.435722349 (16h16m28.179779209s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:06.594737382 (16h16m28.33879423s) [upload=16784]: Done uploading segments... Aug 8 01:56:06.594776360 (16h16m28.338833223s) [upload=16784]: Upload finished. err: <nil> Aug 8 01:56:51.181730272 (16h17m12.925787122s) [upload=16797]: Starting upload Aug 8 01:56:51.181780502 (16h17m12.925837362s) [upload=16797]: Done starting upload Aug 8 01:56:51.181842082 (16h17m12.925898932s) [upload=16797]: Uploading segments... Aug 8 01:56:51.181882111 (16h17m12.925938981s) [upload=16797]: Got next segment. Inline: true Aug 8 01:56:51.181887528 (16h17m12.925944389s) [upload=16797]: Waiting for error group managing segments... Aug 8 01:56:51.181955795 (16h17m12.926012645s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:51.181963090 (16h17m12.926019943s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:51.181966550 (16h17m12.926023404s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:51.374537795 (16h17m13.118594648s) [upload=16797]: Done uploading segments... Aug 8 01:56:51.374553785 (16h17m13.11861064s) [upload=16797]: Upload finished. err: <nil> Aug 8 01:57:56.375733570 (16h18m18.119790416s) [upload=16812]: Starting upload Aug 8 01:57:56.375809631 (16h18m18.119866491s) [upload=16812]: Done starting upload Aug 8 01:57:56.375898814 (16h18m18.119955664s) [upload=16812]: Uploading segments... Aug 8 01:57:56.375972719 (16h18m18.120029579s) [upload=16812]: Got next segment. Inline: true Aug 8 01:57:56.375979950 (16h18m18.120036811s) [upload=16812]: Waiting for error group managing segments... Aug 8 01:57:56.376023911 (16h18m18.120080771s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:57:56.376029224 (16h18m18.120086085s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:57:56.376032588 (16h18m18.120089451s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:57:56.522138524 (16h18m18.266195385s) [upload=16812]: Done uploading segments... Aug 8 01:57:56.522174260 (16h18m18.266231121s) [upload=16812]: Upload finished. err: <nil> Aug 8 01:58:40.668656265 (16h19m2.412713135s) [upload=16827]: Starting upload Aug 8 01:58:40.668711058 (16h19m2.412767924s) [upload=16827]: Done starting upload Aug 8 01:58:40.668790608 (16h19m2.412847457s) [upload=16827]: Uploading segments... Aug 8 01:58:40.668840572 (16h19m2.412897441s) [upload=16827]: Got next segment. Inline: true Aug 8 01:58:40.668846411 (16h19m2.412903277s) [upload=16827]: Waiting for error group managing segments... Aug 8 01:58:40.669005747 (16h19m2.413062607s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:58:40.669017356 (16h19m2.413074217s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:58:40.669021551 (16h19m2.413078412s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:58:40.816114713 (16h19m2.560171563s) [upload=16827]: Done uploading segments... Aug 8 01:58:40.816134617 (16h19m2.560191466s) [upload=16827]: Upload finished. err: <nil> Aug 8 01:59:05.627944078 (16h19m27.372000926s) [upload=16833]: Starting upload Aug 8 01:59:05.627998685 (16h19m27.372055535s) [upload=16833]: Done starting upload Aug 8 01:59:05.628118729 (16h19m27.372175578s) [upload=16833]: Uploading segments... Aug 8 01:59:05.628217606 (16h19m27.372274467s) [upload=16833]: Got next segment. Inline: true Aug 8 01:59:05.628225862 (16h19m27.372282734s) [upload=16833]: Waiting for error group managing segments... Aug 8 01:59:05.628334217 (16h19m27.372391068s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:05.628350984 (16h19m27.372407847s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:05.628354470 (16h19m27.372411329s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:05.774577746 (16h19m27.518634612s) [upload=16833]: Done uploading segments... Aug 8 01:59:05.774602383 (16h19m27.518659233s) [upload=16833]: Upload finished. err: <nil> Aug 8 01:59:37.369718935 (16h19m59.113775787s) [upload=16844]: Starting upload Aug 8 01:59:37.369812437 (16h19m59.113869298s) [upload=16844]: Done starting upload Aug 8 01:59:37.369887515 (16h19m59.113944368s) [upload=16844]: Uploading segments... Aug 8 01:59:37.370021093 (16h19m59.114077981s) [upload=16844]: Got next segment. Inline: true Aug 8 01:59:37.370029981 (16h19m59.114086848s) [upload=16844]: Waiting for error group managing segments... Aug 8 01:59:37.370102430 (16h19m59.114159293s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:37.370109420 (16h19m59.11416628s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:37.370113057 (16h19m59.114169917s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:37.726754734 (16h19m59.47081161s) [upload=16844]: Done uploading segments... Aug 8 01:59:37.726778784 (16h19m59.470835637s) [upload=16844]: Upload finished. err: <nil> Aug 8 02:00:24.719377480 (16h20m46.463434328s) [upload=16863]: Starting upload Aug 8 02:00:24.719456409 (16h20m46.463513255s) [upload=16863]: Done starting upload Aug 8 02:00:24.719560489 (16h20m46.463617335s) [upload=16863]: Uploading segments... Aug 8 02:00:24.719616926 (16h20m46.463673789s) [upload=16863]: Got next segment. Inline: true Aug 8 02:00:24.719622706 (16h20m46.463679552s) [upload=16863]: Waiting for error group managing segments... Aug 8 02:00:24.719659743 (16h20m46.463716591s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:24.719664652 (16h20m46.463721498s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:24.719667649 (16h20m46.463724496s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:25.030175327 (16h20m46.774232197s) [upload=16863]: Done uploading segments... Aug 8 02:00:25.030222980 (16h20m46.774279831s) [upload=16863]: Upload finished. err: <nil> Aug 8 02:00:46.211977832 (16h21m7.956034683s) [upload=16869]: Starting upload Aug 8 02:00:46.212032242 (16h21m7.956089102s) [upload=16869]: Done starting upload Aug 8 02:00:46.212101179 (16h21m7.956158028s) [upload=16869]: Uploading segments... Aug 8 02:00:46.212148507 (16h21m7.956205376s) [upload=16869]: Got next segment. Inline: true Aug 8 02:00:46.212155810 (16h21m7.956212671s) [upload=16869]: Waiting for error group managing segments... Aug 8 02:00:46.212197694 (16h21m7.956254544s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:46.212202763 (16h21m7.956259624s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:46.212206348 (16h21m7.956263209s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:46.360999669 (16h21m8.105056524s) [upload=16869]: Done uploading segments... Aug 8 02:00:46.361040611 (16h21m8.105097472s) [upload=16869]: Upload finished. err: <nil> Aug 8 02:01:57.357493061 (16h22m19.101549913s) [upload=16887]: Starting upload Aug 8 02:01:57.357550990 (16h22m19.101607841s) [upload=16887]: Done starting upload Aug 8 02:01:57.357634434 (16h22m19.101691284s) [upload=16887]: Uploading segments... Aug 8 02:01:57.357688424 (16h22m19.101745285s) [upload=16887]: Got next segment. Inline: true Aug 8 02:01:57.357693917 (16h22m19.101750778s) [upload=16887]: Waiting for error group managing segments... Aug 8 02:01:57.357741416 (16h22m19.101798267s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:01:57.357748493 (16h22m19.101805358s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:01:57.357753129 (16h22m19.101809997s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:01:57.874642140 (16h22m19.618698996s) [upload=16887]: Done uploading segments... Aug 8 02:01:57.874664164 (16h22m19.618721018s) [upload=16887]: Upload finished. err: <nil>
Duration: 820.46352ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X.....................X........................X......] duration:
820.438716ms
FAIL (2025-08-08 02:06:44 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 6751]: Done uploading segments... Aug 8 01:54:07.115487086 (16h14m28.859543939s) [upload=16751]: Upload finished. err: <nil> Aug 8 01:55:10.779008362 (16h15m32.523065211s) [upload=16769]: Starting upload Aug 8 01:55:10.779096198 (16h15m32.523153061s) [upload=16769]: Done starting upload Aug 8 01:55:10.779193425 (16h15m32.523250289s) [upload=16769]: Uploading segments... Aug 8 01:55:10.779250013 (16h15m32.523306883s) [upload=16769]: Got next segment. Inline: true Aug 8 01:55:10.779256039 (16h15m32.5233129s) [upload=16769]: Waiting for error group managing segments... Aug 8 01:55:10.779303624 (16h15m32.523360486s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:55:10.779312117 (16h15m32.523368978s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:55:10.779317881 (16h15m32.523374742s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:55:10.929585505 (16h15m32.673642367s) [upload=16769]: Done uploading segments... Aug 8 01:55:10.929610338 (16h15m32.673667199s) [upload=16769]: Upload finished. err: <nil> Aug 8 01:56:06.435484091 (16h16m28.179540953s) [upload=16784]: Starting upload Aug 8 01:56:06.435552910 (16h16m28.179609773s) [upload=16784]: Done starting upload Aug 8 01:56:06.435619333 (16h16m28.179676183s) [upload=16784]: Uploading segments... Aug 8 01:56:06.435665009 (16h16m28.179721877s) [upload=16784]: Got next segment. Inline: true Aug 8 01:56:06.435670176 (16h16m28.179727036s) [upload=16784]: Waiting for error group managing segments... Aug 8 01:56:06.435712868 (16h16m28.179769728s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:06.435718361 (16h16m28.179775225s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:06.435722349 (16h16m28.179779209s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:06.594737382 (16h16m28.33879423s) [upload=16784]: Done uploading segments... Aug 8 01:56:06.594776360 (16h16m28.338833223s) [upload=16784]: Upload finished. err: <nil> Aug 8 01:56:51.181730272 (16h17m12.925787122s) [upload=16797]: Starting upload Aug 8 01:56:51.181780502 (16h17m12.925837362s) [upload=16797]: Done starting upload Aug 8 01:56:51.181842082 (16h17m12.925898932s) [upload=16797]: Uploading segments... Aug 8 01:56:51.181882111 (16h17m12.925938981s) [upload=16797]: Got next segment. Inline: true Aug 8 01:56:51.181887528 (16h17m12.925944389s) [upload=16797]: Waiting for error group managing segments... Aug 8 01:56:51.181955795 (16h17m12.926012645s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:51.181963090 (16h17m12.926019943s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:51.181966550 (16h17m12.926023404s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:51.374537795 (16h17m13.118594648s) [upload=16797]: Done uploading segments... Aug 8 01:56:51.374553785 (16h17m13.11861064s) [upload=16797]: Upload finished. err: <nil> Aug 8 01:57:56.375733570 (16h18m18.119790416s) [upload=16812]: Starting upload Aug 8 01:57:56.375809631 (16h18m18.119866491s) [upload=16812]: Done starting upload Aug 8 01:57:56.375898814 (16h18m18.119955664s) [upload=16812]: Uploading segments... Aug 8 01:57:56.375972719 (16h18m18.120029579s) [upload=16812]: Got next segment. Inline: true Aug 8 01:57:56.375979950 (16h18m18.120036811s) [upload=16812]: Waiting for error group managing segments... Aug 8 01:57:56.376023911 (16h18m18.120080771s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:57:56.376029224 (16h18m18.120086085s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:57:56.376032588 (16h18m18.120089451s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:57:56.522138524 (16h18m18.266195385s) [upload=16812]: Done uploading segments... Aug 8 01:57:56.522174260 (16h18m18.266231121s) [upload=16812]: Upload finished. err: <nil> Aug 8 01:58:40.668656265 (16h19m2.412713135s) [upload=16827]: Starting upload Aug 8 01:58:40.668711058 (16h19m2.412767924s) [upload=16827]: Done starting upload Aug 8 01:58:40.668790608 (16h19m2.412847457s) [upload=16827]: Uploading segments... Aug 8 01:58:40.668840572 (16h19m2.412897441s) [upload=16827]: Got next segment. Inline: true Aug 8 01:58:40.668846411 (16h19m2.412903277s) [upload=16827]: Waiting for error group managing segments... Aug 8 01:58:40.669005747 (16h19m2.413062607s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:58:40.669017356 (16h19m2.413074217s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:58:40.669021551 (16h19m2.413078412s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:58:40.816114713 (16h19m2.560171563s) [upload=16827]: Done uploading segments... Aug 8 01:58:40.816134617 (16h19m2.560191466s) [upload=16827]: Upload finished. err: <nil> Aug 8 01:59:05.627944078 (16h19m27.372000926s) [upload=16833]: Starting upload Aug 8 01:59:05.627998685 (16h19m27.372055535s) [upload=16833]: Done starting upload Aug 8 01:59:05.628118729 (16h19m27.372175578s) [upload=16833]: Uploading segments... Aug 8 01:59:05.628217606 (16h19m27.372274467s) [upload=16833]: Got next segment. Inline: true Aug 8 01:59:05.628225862 (16h19m27.372282734s) [upload=16833]: Waiting for error group managing segments... Aug 8 01:59:05.628334217 (16h19m27.372391068s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:05.628350984 (16h19m27.372407847s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:05.628354470 (16h19m27.372411329s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:05.774577746 (16h19m27.518634612s) [upload=16833]: Done uploading segments... Aug 8 01:59:05.774602383 (16h19m27.518659233s) [upload=16833]: Upload finished. err: <nil> Aug 8 01:59:37.369718935 (16h19m59.113775787s) [upload=16844]: Starting upload Aug 8 01:59:37.369812437 (16h19m59.113869298s) [upload=16844]: Done starting upload Aug 8 01:59:37.369887515 (16h19m59.113944368s) [upload=16844]: Uploading segments... Aug 8 01:59:37.370021093 (16h19m59.114077981s) [upload=16844]: Got next segment. Inline: true Aug 8 01:59:37.370029981 (16h19m59.114086848s) [upload=16844]: Waiting for error group managing segments... Aug 8 01:59:37.370102430 (16h19m59.114159293s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:37.370109420 (16h19m59.11416628s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:37.370113057 (16h19m59.114169917s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:37.726754734 (16h19m59.47081161s) [upload=16844]: Done uploading segments... Aug 8 01:59:37.726778784 (16h19m59.470835637s) [upload=16844]: Upload finished. err: <nil> Aug 8 02:00:24.719377480 (16h20m46.463434328s) [upload=16863]: Starting upload Aug 8 02:00:24.719456409 (16h20m46.463513255s) [upload=16863]: Done starting upload Aug 8 02:00:24.719560489 (16h20m46.463617335s) [upload=16863]: Uploading segments... Aug 8 02:00:24.719616926 (16h20m46.463673789s) [upload=16863]: Got next segment. Inline: true Aug 8 02:00:24.719622706 (16h20m46.463679552s) [upload=16863]: Waiting for error group managing segments... Aug 8 02:00:24.719659743 (16h20m46.463716591s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:24.719664652 (16h20m46.463721498s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:24.719667649 (16h20m46.463724496s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:25.030175327 (16h20m46.774232197s) [upload=16863]: Done uploading segments... Aug 8 02:00:25.030222980 (16h20m46.774279831s) [upload=16863]: Upload finished. err: <nil> Aug 8 02:00:46.211977832 (16h21m7.956034683s) [upload=16869]: Starting upload Aug 8 02:00:46.212032242 (16h21m7.956089102s) [upload=16869]: Done starting upload Aug 8 02:00:46.212101179 (16h21m7.956158028s) [upload=16869]: Uploading segments... Aug 8 02:00:46.212148507 (16h21m7.956205376s) [upload=16869]: Got next segment. Inline: true Aug 8 02:00:46.212155810 (16h21m7.956212671s) [upload=16869]: Waiting for error group managing segments... Aug 8 02:00:46.212197694 (16h21m7.956254544s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:46.212202763 (16h21m7.956259624s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:46.212206348 (16h21m7.956263209s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:46.360999669 (16h21m8.105056524s) [upload=16869]: Done uploading segments... Aug 8 02:00:46.361040611 (16h21m8.105097472s) [upload=16869]: Upload finished. err: <nil> Aug 8 02:01:57.357493061 (16h22m19.101549913s) [upload=16887]: Starting upload Aug 8 02:01:57.357550990 (16h22m19.101607841s) [upload=16887]: Done starting upload Aug 8 02:01:57.357634434 (16h22m19.101691284s) [upload=16887]: Uploading segments... Aug 8 02:01:57.357688424 (16h22m19.101745285s) [upload=16887]: Got next segment. Inline: true Aug 8 02:01:57.357693917 (16h22m19.101750778s) [upload=16887]: Waiting for error group managing segments... Aug 8 02:01:57.357741416 (16h22m19.101798267s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:01:57.357748493 (16h22m19.101805358s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:01:57.357753129 (16h22m19.101809997s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:01:57.874642140 (16h22m19.618698996s) [upload=16887]: Done uploading segments... Aug 8 02:01:57.874664164 (16h22m19.618721018s) [upload=16887]: Upload finished. err: <nil>
Duration: 820.479865ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.592900786s
FAIL (2025-08-08 02:06:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.592948399s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.....................X........................X.....] duration:
878.802963ms
FAIL (2025-08-08 02:05:40 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 6751]: Done uploading segments... Aug 8 01:54:07.115487086 (16h14m28.859543939s) [upload=16751]: Upload finished. err: <nil> Aug 8 01:55:10.779008362 (16h15m32.523065211s) [upload=16769]: Starting upload Aug 8 01:55:10.779096198 (16h15m32.523153061s) [upload=16769]: Done starting upload Aug 8 01:55:10.779193425 (16h15m32.523250289s) [upload=16769]: Uploading segments... Aug 8 01:55:10.779250013 (16h15m32.523306883s) [upload=16769]: Got next segment. Inline: true Aug 8 01:55:10.779256039 (16h15m32.5233129s) [upload=16769]: Waiting for error group managing segments... Aug 8 01:55:10.779303624 (16h15m32.523360486s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:55:10.779312117 (16h15m32.523368978s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:55:10.779317881 (16h15m32.523374742s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:55:10.929585505 (16h15m32.673642367s) [upload=16769]: Done uploading segments... Aug 8 01:55:10.929610338 (16h15m32.673667199s) [upload=16769]: Upload finished. err: <nil> Aug 8 01:56:06.435484091 (16h16m28.179540953s) [upload=16784]: Starting upload Aug 8 01:56:06.435552910 (16h16m28.179609773s) [upload=16784]: Done starting upload Aug 8 01:56:06.435619333 (16h16m28.179676183s) [upload=16784]: Uploading segments... Aug 8 01:56:06.435665009 (16h16m28.179721877s) [upload=16784]: Got next segment. Inline: true Aug 8 01:56:06.435670176 (16h16m28.179727036s) [upload=16784]: Waiting for error group managing segments... Aug 8 01:56:06.435712868 (16h16m28.179769728s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:06.435718361 (16h16m28.179775225s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:06.435722349 (16h16m28.179779209s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:06.594737382 (16h16m28.33879423s) [upload=16784]: Done uploading segments... Aug 8 01:56:06.594776360 (16h16m28.338833223s) [upload=16784]: Upload finished. err: <nil> Aug 8 01:56:51.181730272 (16h17m12.925787122s) [upload=16797]: Starting upload Aug 8 01:56:51.181780502 (16h17m12.925837362s) [upload=16797]: Done starting upload Aug 8 01:56:51.181842082 (16h17m12.925898932s) [upload=16797]: Uploading segments... Aug 8 01:56:51.181882111 (16h17m12.925938981s) [upload=16797]: Got next segment. Inline: true Aug 8 01:56:51.181887528 (16h17m12.925944389s) [upload=16797]: Waiting for error group managing segments... Aug 8 01:56:51.181955795 (16h17m12.926012645s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:51.181963090 (16h17m12.926019943s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:51.181966550 (16h17m12.926023404s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:51.374537795 (16h17m13.118594648s) [upload=16797]: Done uploading segments... Aug 8 01:56:51.374553785 (16h17m13.11861064s) [upload=16797]: Upload finished. err: <nil> Aug 8 01:57:56.375733570 (16h18m18.119790416s) [upload=16812]: Starting upload Aug 8 01:57:56.375809631 (16h18m18.119866491s) [upload=16812]: Done starting upload Aug 8 01:57:56.375898814 (16h18m18.119955664s) [upload=16812]: Uploading segments... Aug 8 01:57:56.375972719 (16h18m18.120029579s) [upload=16812]: Got next segment. Inline: true Aug 8 01:57:56.375979950 (16h18m18.120036811s) [upload=16812]: Waiting for error group managing segments... Aug 8 01:57:56.376023911 (16h18m18.120080771s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:57:56.376029224 (16h18m18.120086085s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:57:56.376032588 (16h18m18.120089451s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:57:56.522138524 (16h18m18.266195385s) [upload=16812]: Done uploading segments... Aug 8 01:57:56.522174260 (16h18m18.266231121s) [upload=16812]: Upload finished. err: <nil> Aug 8 01:58:40.668656265 (16h19m2.412713135s) [upload=16827]: Starting upload Aug 8 01:58:40.668711058 (16h19m2.412767924s) [upload=16827]: Done starting upload Aug 8 01:58:40.668790608 (16h19m2.412847457s) [upload=16827]: Uploading segments... Aug 8 01:58:40.668840572 (16h19m2.412897441s) [upload=16827]: Got next segment. Inline: true Aug 8 01:58:40.668846411 (16h19m2.412903277s) [upload=16827]: Waiting for error group managing segments... Aug 8 01:58:40.669005747 (16h19m2.413062607s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:58:40.669017356 (16h19m2.413074217s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:58:40.669021551 (16h19m2.413078412s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:58:40.816114713 (16h19m2.560171563s) [upload=16827]: Done uploading segments... Aug 8 01:58:40.816134617 (16h19m2.560191466s) [upload=16827]: Upload finished. err: <nil> Aug 8 01:59:05.627944078 (16h19m27.372000926s) [upload=16833]: Starting upload Aug 8 01:59:05.627998685 (16h19m27.372055535s) [upload=16833]: Done starting upload Aug 8 01:59:05.628118729 (16h19m27.372175578s) [upload=16833]: Uploading segments... Aug 8 01:59:05.628217606 (16h19m27.372274467s) [upload=16833]: Got next segment. Inline: true Aug 8 01:59:05.628225862 (16h19m27.372282734s) [upload=16833]: Waiting for error group managing segments... Aug 8 01:59:05.628334217 (16h19m27.372391068s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:05.628350984 (16h19m27.372407847s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:05.628354470 (16h19m27.372411329s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:05.774577746 (16h19m27.518634612s) [upload=16833]: Done uploading segments... Aug 8 01:59:05.774602383 (16h19m27.518659233s) [upload=16833]: Upload finished. err: <nil> Aug 8 01:59:37.369718935 (16h19m59.113775787s) [upload=16844]: Starting upload Aug 8 01:59:37.369812437 (16h19m59.113869298s) [upload=16844]: Done starting upload Aug 8 01:59:37.369887515 (16h19m59.113944368s) [upload=16844]: Uploading segments... Aug 8 01:59:37.370021093 (16h19m59.114077981s) [upload=16844]: Got next segment. Inline: true Aug 8 01:59:37.370029981 (16h19m59.114086848s) [upload=16844]: Waiting for error group managing segments... Aug 8 01:59:37.370102430 (16h19m59.114159293s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:37.370109420 (16h19m59.11416628s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:37.370113057 (16h19m59.114169917s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:37.726754734 (16h19m59.47081161s) [upload=16844]: Done uploading segments... Aug 8 01:59:37.726778784 (16h19m59.470835637s) [upload=16844]: Upload finished. err: <nil> Aug 8 02:00:24.719377480 (16h20m46.463434328s) [upload=16863]: Starting upload Aug 8 02:00:24.719456409 (16h20m46.463513255s) [upload=16863]: Done starting upload Aug 8 02:00:24.719560489 (16h20m46.463617335s) [upload=16863]: Uploading segments... Aug 8 02:00:24.719616926 (16h20m46.463673789s) [upload=16863]: Got next segment. Inline: true Aug 8 02:00:24.719622706 (16h20m46.463679552s) [upload=16863]: Waiting for error group managing segments... Aug 8 02:00:24.719659743 (16h20m46.463716591s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:24.719664652 (16h20m46.463721498s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:24.719667649 (16h20m46.463724496s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:25.030175327 (16h20m46.774232197s) [upload=16863]: Done uploading segments... Aug 8 02:00:25.030222980 (16h20m46.774279831s) [upload=16863]: Upload finished. err: <nil> Aug 8 02:00:46.211977832 (16h21m7.956034683s) [upload=16869]: Starting upload Aug 8 02:00:46.212032242 (16h21m7.956089102s) [upload=16869]: Done starting upload Aug 8 02:00:46.212101179 (16h21m7.956158028s) [upload=16869]: Uploading segments... Aug 8 02:00:46.212148507 (16h21m7.956205376s) [upload=16869]: Got next segment. Inline: true Aug 8 02:00:46.212155810 (16h21m7.956212671s) [upload=16869]: Waiting for error group managing segments... Aug 8 02:00:46.212197694 (16h21m7.956254544s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:46.212202763 (16h21m7.956259624s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:46.212206348 (16h21m7.956263209s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:46.360999669 (16h21m8.105056524s) [upload=16869]: Done uploading segments... Aug 8 02:00:46.361040611 (16h21m8.105097472s) [upload=16869]: Upload finished. err: <nil> Aug 8 02:01:57.357493061 (16h22m19.101549913s) [upload=16887]: Starting upload Aug 8 02:01:57.357550990 (16h22m19.101607841s) [upload=16887]: Done starting upload Aug 8 02:01:57.357634434 (16h22m19.101691284s) [upload=16887]: Uploading segments... Aug 8 02:01:57.357688424 (16h22m19.101745285s) [upload=16887]: Got next segment. Inline: true Aug 8 02:01:57.357693917 (16h22m19.101750778s) [upload=16887]: Waiting for error group managing segments... Aug 8 02:01:57.357741416 (16h22m19.101798267s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:01:57.357748493 (16h22m19.101805358s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:01:57.357753129 (16h22m19.101809997s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:01:57.874642140 (16h22m19.618698996s) [upload=16887]: Done uploading segments... Aug 8 02:01:57.874664164 (16h22m19.618721018s) [upload=16887]: Upload finished. err: <nil>
Duration: 878.837059ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.281281825s
FAIL (2025-08-08 02:05:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.281304272s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.738931473s
FAIL (2025-08-08 02:05:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.738969531s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X.....................X........................X....] duration:
888.17479ms
FAIL (2025-08-08 02:05:11 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 6751]: Done uploading segments... Aug 8 01:54:07.115487086 (16h14m28.859543939s) [upload=16751]: Upload finished. err: <nil> Aug 8 01:55:10.779008362 (16h15m32.523065211s) [upload=16769]: Starting upload Aug 8 01:55:10.779096198 (16h15m32.523153061s) [upload=16769]: Done starting upload Aug 8 01:55:10.779193425 (16h15m32.523250289s) [upload=16769]: Uploading segments... Aug 8 01:55:10.779250013 (16h15m32.523306883s) [upload=16769]: Got next segment. Inline: true Aug 8 01:55:10.779256039 (16h15m32.5233129s) [upload=16769]: Waiting for error group managing segments... Aug 8 01:55:10.779303624 (16h15m32.523360486s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:55:10.779312117 (16h15m32.523368978s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:55:10.779317881 (16h15m32.523374742s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:55:10.929585505 (16h15m32.673642367s) [upload=16769]: Done uploading segments... Aug 8 01:55:10.929610338 (16h15m32.673667199s) [upload=16769]: Upload finished. err: <nil> Aug 8 01:56:06.435484091 (16h16m28.179540953s) [upload=16784]: Starting upload Aug 8 01:56:06.435552910 (16h16m28.179609773s) [upload=16784]: Done starting upload Aug 8 01:56:06.435619333 (16h16m28.179676183s) [upload=16784]: Uploading segments... Aug 8 01:56:06.435665009 (16h16m28.179721877s) [upload=16784]: Got next segment. Inline: true Aug 8 01:56:06.435670176 (16h16m28.179727036s) [upload=16784]: Waiting for error group managing segments... Aug 8 01:56:06.435712868 (16h16m28.179769728s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:06.435718361 (16h16m28.179775225s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:06.435722349 (16h16m28.179779209s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:06.594737382 (16h16m28.33879423s) [upload=16784]: Done uploading segments... Aug 8 01:56:06.594776360 (16h16m28.338833223s) [upload=16784]: Upload finished. err: <nil> Aug 8 01:56:51.181730272 (16h17m12.925787122s) [upload=16797]: Starting upload Aug 8 01:56:51.181780502 (16h17m12.925837362s) [upload=16797]: Done starting upload Aug 8 01:56:51.181842082 (16h17m12.925898932s) [upload=16797]: Uploading segments... Aug 8 01:56:51.181882111 (16h17m12.925938981s) [upload=16797]: Got next segment. Inline: true Aug 8 01:56:51.181887528 (16h17m12.925944389s) [upload=16797]: Waiting for error group managing segments... Aug 8 01:56:51.181955795 (16h17m12.926012645s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:51.181963090 (16h17m12.926019943s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:51.181966550 (16h17m12.926023404s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:51.374537795 (16h17m13.118594648s) [upload=16797]: Done uploading segments... Aug 8 01:56:51.374553785 (16h17m13.11861064s) [upload=16797]: Upload finished. err: <nil> Aug 8 01:57:56.375733570 (16h18m18.119790416s) [upload=16812]: Starting upload Aug 8 01:57:56.375809631 (16h18m18.119866491s) [upload=16812]: Done starting upload Aug 8 01:57:56.375898814 (16h18m18.119955664s) [upload=16812]: Uploading segments... Aug 8 01:57:56.375972719 (16h18m18.120029579s) [upload=16812]: Got next segment. Inline: true Aug 8 01:57:56.375979950 (16h18m18.120036811s) [upload=16812]: Waiting for error group managing segments... Aug 8 01:57:56.376023911 (16h18m18.120080771s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:57:56.376029224 (16h18m18.120086085s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:57:56.376032588 (16h18m18.120089451s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:57:56.522138524 (16h18m18.266195385s) [upload=16812]: Done uploading segments... Aug 8 01:57:56.522174260 (16h18m18.266231121s) [upload=16812]: Upload finished. err: <nil> Aug 8 01:58:40.668656265 (16h19m2.412713135s) [upload=16827]: Starting upload Aug 8 01:58:40.668711058 (16h19m2.412767924s) [upload=16827]: Done starting upload Aug 8 01:58:40.668790608 (16h19m2.412847457s) [upload=16827]: Uploading segments... Aug 8 01:58:40.668840572 (16h19m2.412897441s) [upload=16827]: Got next segment. Inline: true Aug 8 01:58:40.668846411 (16h19m2.412903277s) [upload=16827]: Waiting for error group managing segments... Aug 8 01:58:40.669005747 (16h19m2.413062607s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:58:40.669017356 (16h19m2.413074217s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:58:40.669021551 (16h19m2.413078412s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:58:40.816114713 (16h19m2.560171563s) [upload=16827]: Done uploading segments... Aug 8 01:58:40.816134617 (16h19m2.560191466s) [upload=16827]: Upload finished. err: <nil> Aug 8 01:59:05.627944078 (16h19m27.372000926s) [upload=16833]: Starting upload Aug 8 01:59:05.627998685 (16h19m27.372055535s) [upload=16833]: Done starting upload Aug 8 01:59:05.628118729 (16h19m27.372175578s) [upload=16833]: Uploading segments... Aug 8 01:59:05.628217606 (16h19m27.372274467s) [upload=16833]: Got next segment. Inline: true Aug 8 01:59:05.628225862 (16h19m27.372282734s) [upload=16833]: Waiting for error group managing segments... Aug 8 01:59:05.628334217 (16h19m27.372391068s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:05.628350984 (16h19m27.372407847s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:05.628354470 (16h19m27.372411329s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:05.774577746 (16h19m27.518634612s) [upload=16833]: Done uploading segments... Aug 8 01:59:05.774602383 (16h19m27.518659233s) [upload=16833]: Upload finished. err: <nil> Aug 8 01:59:37.369718935 (16h19m59.113775787s) [upload=16844]: Starting upload Aug 8 01:59:37.369812437 (16h19m59.113869298s) [upload=16844]: Done starting upload Aug 8 01:59:37.369887515 (16h19m59.113944368s) [upload=16844]: Uploading segments... Aug 8 01:59:37.370021093 (16h19m59.114077981s) [upload=16844]: Got next segment. Inline: true Aug 8 01:59:37.370029981 (16h19m59.114086848s) [upload=16844]: Waiting for error group managing segments... Aug 8 01:59:37.370102430 (16h19m59.114159293s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:37.370109420 (16h19m59.11416628s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:37.370113057 (16h19m59.114169917s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:37.726754734 (16h19m59.47081161s) [upload=16844]: Done uploading segments... Aug 8 01:59:37.726778784 (16h19m59.470835637s) [upload=16844]: Upload finished. err: <nil> Aug 8 02:00:24.719377480 (16h20m46.463434328s) [upload=16863]: Starting upload Aug 8 02:00:24.719456409 (16h20m46.463513255s) [upload=16863]: Done starting upload Aug 8 02:00:24.719560489 (16h20m46.463617335s) [upload=16863]: Uploading segments... Aug 8 02:00:24.719616926 (16h20m46.463673789s) [upload=16863]: Got next segment. Inline: true Aug 8 02:00:24.719622706 (16h20m46.463679552s) [upload=16863]: Waiting for error group managing segments... Aug 8 02:00:24.719659743 (16h20m46.463716591s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:24.719664652 (16h20m46.463721498s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:24.719667649 (16h20m46.463724496s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:25.030175327 (16h20m46.774232197s) [upload=16863]: Done uploading segments... Aug 8 02:00:25.030222980 (16h20m46.774279831s) [upload=16863]: Upload finished. err: <nil> Aug 8 02:00:46.211977832 (16h21m7.956034683s) [upload=16869]: Starting upload Aug 8 02:00:46.212032242 (16h21m7.956089102s) [upload=16869]: Done starting upload Aug 8 02:00:46.212101179 (16h21m7.956158028s) [upload=16869]: Uploading segments... Aug 8 02:00:46.212148507 (16h21m7.956205376s) [upload=16869]: Got next segment. Inline: true Aug 8 02:00:46.212155810 (16h21m7.956212671s) [upload=16869]: Waiting for error group managing segments... Aug 8 02:00:46.212197694 (16h21m7.956254544s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:46.212202763 (16h21m7.956259624s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:46.212206348 (16h21m7.956263209s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:46.360999669 (16h21m8.105056524s) [upload=16869]: Done uploading segments... Aug 8 02:00:46.361040611 (16h21m8.105097472s) [upload=16869]: Upload finished. err: <nil> Aug 8 02:01:57.357493061 (16h22m19.101549913s) [upload=16887]: Starting upload Aug 8 02:01:57.357550990 (16h22m19.101607841s) [upload=16887]: Done starting upload Aug 8 02:01:57.357634434 (16h22m19.101691284s) [upload=16887]: Uploading segments... Aug 8 02:01:57.357688424 (16h22m19.101745285s) [upload=16887]: Got next segment. Inline: true Aug 8 02:01:57.357693917 (16h22m19.101750778s) [upload=16887]: Waiting for error group managing segments... Aug 8 02:01:57.357741416 (16h22m19.101798267s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:01:57.357748493 (16h22m19.101805358s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:01:57.357753129 (16h22m19.101809997s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:01:57.874642140 (16h22m19.618698996s) [upload=16887]: Done uploading segments... Aug 8 02:01:57.874664164 (16h22m19.618721018s) [upload=16887]: Upload finished. err: <nil>
Duration: 888.197407ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.480272053s
FAIL (2025-08-08 02:04:44 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.480306784s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X.....................X........................X...] duration:
849.217523ms
FAIL (2025-08-08 02:04:12 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 6751]: Done uploading segments... Aug 8 01:54:07.115487086 (16h14m28.859543939s) [upload=16751]: Upload finished. err: <nil> Aug 8 01:55:10.779008362 (16h15m32.523065211s) [upload=16769]: Starting upload Aug 8 01:55:10.779096198 (16h15m32.523153061s) [upload=16769]: Done starting upload Aug 8 01:55:10.779193425 (16h15m32.523250289s) [upload=16769]: Uploading segments... Aug 8 01:55:10.779250013 (16h15m32.523306883s) [upload=16769]: Got next segment. Inline: true Aug 8 01:55:10.779256039 (16h15m32.5233129s) [upload=16769]: Waiting for error group managing segments... Aug 8 01:55:10.779303624 (16h15m32.523360486s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:55:10.779312117 (16h15m32.523368978s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:55:10.779317881 (16h15m32.523374742s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:55:10.929585505 (16h15m32.673642367s) [upload=16769]: Done uploading segments... Aug 8 01:55:10.929610338 (16h15m32.673667199s) [upload=16769]: Upload finished. err: <nil> Aug 8 01:56:06.435484091 (16h16m28.179540953s) [upload=16784]: Starting upload Aug 8 01:56:06.435552910 (16h16m28.179609773s) [upload=16784]: Done starting upload Aug 8 01:56:06.435619333 (16h16m28.179676183s) [upload=16784]: Uploading segments... Aug 8 01:56:06.435665009 (16h16m28.179721877s) [upload=16784]: Got next segment. Inline: true Aug 8 01:56:06.435670176 (16h16m28.179727036s) [upload=16784]: Waiting for error group managing segments... Aug 8 01:56:06.435712868 (16h16m28.179769728s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:06.435718361 (16h16m28.179775225s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:06.435722349 (16h16m28.179779209s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:06.594737382 (16h16m28.33879423s) [upload=16784]: Done uploading segments... Aug 8 01:56:06.594776360 (16h16m28.338833223s) [upload=16784]: Upload finished. err: <nil> Aug 8 01:56:51.181730272 (16h17m12.925787122s) [upload=16797]: Starting upload Aug 8 01:56:51.181780502 (16h17m12.925837362s) [upload=16797]: Done starting upload Aug 8 01:56:51.181842082 (16h17m12.925898932s) [upload=16797]: Uploading segments... Aug 8 01:56:51.181882111 (16h17m12.925938981s) [upload=16797]: Got next segment. Inline: true Aug 8 01:56:51.181887528 (16h17m12.925944389s) [upload=16797]: Waiting for error group managing segments... Aug 8 01:56:51.181955795 (16h17m12.926012645s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:51.181963090 (16h17m12.926019943s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:51.181966550 (16h17m12.926023404s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:51.374537795 (16h17m13.118594648s) [upload=16797]: Done uploading segments... Aug 8 01:56:51.374553785 (16h17m13.11861064s) [upload=16797]: Upload finished. err: <nil> Aug 8 01:57:56.375733570 (16h18m18.119790416s) [upload=16812]: Starting upload Aug 8 01:57:56.375809631 (16h18m18.119866491s) [upload=16812]: Done starting upload Aug 8 01:57:56.375898814 (16h18m18.119955664s) [upload=16812]: Uploading segments... Aug 8 01:57:56.375972719 (16h18m18.120029579s) [upload=16812]: Got next segment. Inline: true Aug 8 01:57:56.375979950 (16h18m18.120036811s) [upload=16812]: Waiting for error group managing segments... Aug 8 01:57:56.376023911 (16h18m18.120080771s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:57:56.376029224 (16h18m18.120086085s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:57:56.376032588 (16h18m18.120089451s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:57:56.522138524 (16h18m18.266195385s) [upload=16812]: Done uploading segments... Aug 8 01:57:56.522174260 (16h18m18.266231121s) [upload=16812]: Upload finished. err: <nil> Aug 8 01:58:40.668656265 (16h19m2.412713135s) [upload=16827]: Starting upload Aug 8 01:58:40.668711058 (16h19m2.412767924s) [upload=16827]: Done starting upload Aug 8 01:58:40.668790608 (16h19m2.412847457s) [upload=16827]: Uploading segments... Aug 8 01:58:40.668840572 (16h19m2.412897441s) [upload=16827]: Got next segment. Inline: true Aug 8 01:58:40.668846411 (16h19m2.412903277s) [upload=16827]: Waiting for error group managing segments... Aug 8 01:58:40.669005747 (16h19m2.413062607s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:58:40.669017356 (16h19m2.413074217s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:58:40.669021551 (16h19m2.413078412s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:58:40.816114713 (16h19m2.560171563s) [upload=16827]: Done uploading segments... Aug 8 01:58:40.816134617 (16h19m2.560191466s) [upload=16827]: Upload finished. err: <nil> Aug 8 01:59:05.627944078 (16h19m27.372000926s) [upload=16833]: Starting upload Aug 8 01:59:05.627998685 (16h19m27.372055535s) [upload=16833]: Done starting upload Aug 8 01:59:05.628118729 (16h19m27.372175578s) [upload=16833]: Uploading segments... Aug 8 01:59:05.628217606 (16h19m27.372274467s) [upload=16833]: Got next segment. Inline: true Aug 8 01:59:05.628225862 (16h19m27.372282734s) [upload=16833]: Waiting for error group managing segments... Aug 8 01:59:05.628334217 (16h19m27.372391068s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:05.628350984 (16h19m27.372407847s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:05.628354470 (16h19m27.372411329s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:05.774577746 (16h19m27.518634612s) [upload=16833]: Done uploading segments... Aug 8 01:59:05.774602383 (16h19m27.518659233s) [upload=16833]: Upload finished. err: <nil> Aug 8 01:59:37.369718935 (16h19m59.113775787s) [upload=16844]: Starting upload Aug 8 01:59:37.369812437 (16h19m59.113869298s) [upload=16844]: Done starting upload Aug 8 01:59:37.369887515 (16h19m59.113944368s) [upload=16844]: Uploading segments... Aug 8 01:59:37.370021093 (16h19m59.114077981s) [upload=16844]: Got next segment. Inline: true Aug 8 01:59:37.370029981 (16h19m59.114086848s) [upload=16844]: Waiting for error group managing segments... Aug 8 01:59:37.370102430 (16h19m59.114159293s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:37.370109420 (16h19m59.11416628s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:37.370113057 (16h19m59.114169917s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:37.726754734 (16h19m59.47081161s) [upload=16844]: Done uploading segments... Aug 8 01:59:37.726778784 (16h19m59.470835637s) [upload=16844]: Upload finished. err: <nil> Aug 8 02:00:24.719377480 (16h20m46.463434328s) [upload=16863]: Starting upload Aug 8 02:00:24.719456409 (16h20m46.463513255s) [upload=16863]: Done starting upload Aug 8 02:00:24.719560489 (16h20m46.463617335s) [upload=16863]: Uploading segments... Aug 8 02:00:24.719616926 (16h20m46.463673789s) [upload=16863]: Got next segment. Inline: true Aug 8 02:00:24.719622706 (16h20m46.463679552s) [upload=16863]: Waiting for error group managing segments... Aug 8 02:00:24.719659743 (16h20m46.463716591s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:24.719664652 (16h20m46.463721498s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:24.719667649 (16h20m46.463724496s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:25.030175327 (16h20m46.774232197s) [upload=16863]: Done uploading segments... Aug 8 02:00:25.030222980 (16h20m46.774279831s) [upload=16863]: Upload finished. err: <nil> Aug 8 02:00:46.211977832 (16h21m7.956034683s) [upload=16869]: Starting upload Aug 8 02:00:46.212032242 (16h21m7.956089102s) [upload=16869]: Done starting upload Aug 8 02:00:46.212101179 (16h21m7.956158028s) [upload=16869]: Uploading segments... Aug 8 02:00:46.212148507 (16h21m7.956205376s) [upload=16869]: Got next segment. Inline: true Aug 8 02:00:46.212155810 (16h21m7.956212671s) [upload=16869]: Waiting for error group managing segments... Aug 8 02:00:46.212197694 (16h21m7.956254544s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:46.212202763 (16h21m7.956259624s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:46.212206348 (16h21m7.956263209s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:46.360999669 (16h21m8.105056524s) [upload=16869]: Done uploading segments... Aug 8 02:00:46.361040611 (16h21m8.105097472s) [upload=16869]: Upload finished. err: <nil> Aug 8 02:01:57.357493061 (16h22m19.101549913s) [upload=16887]: Starting upload Aug 8 02:01:57.357550990 (16h22m19.101607841s) [upload=16887]: Done starting upload Aug 8 02:01:57.357634434 (16h22m19.101691284s) [upload=16887]: Uploading segments... Aug 8 02:01:57.357688424 (16h22m19.101745285s) [upload=16887]: Got next segment. Inline: true Aug 8 02:01:57.357693917 (16h22m19.101750778s) [upload=16887]: Waiting for error group managing segments... Aug 8 02:01:57.357741416 (16h22m19.101798267s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:01:57.357748493 (16h22m19.101805358s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:01:57.357753129 (16h22m19.101809997s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:01:57.874642140 (16h22m19.618698996s) [upload=16887]: Done uploading segments... Aug 8 02:01:57.874664164 (16h22m19.618721018s) [upload=16887]: Upload finished. err: <nil>
Duration: 849.249794ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.561285209s
FAIL (2025-08-08 02:04:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.561315436s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.835741155s
FAIL (2025-08-08 02:03:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.835779641s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.447054398s
FAIL (2025-08-08 02:03:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.447093216s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X.....................X........................X..] duration:
856.293444ms
FAIL (2025-08-08 02:03:29 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 6751]: Done uploading segments... Aug 8 01:54:07.115487086 (16h14m28.859543939s) [upload=16751]: Upload finished. err: <nil> Aug 8 01:55:10.779008362 (16h15m32.523065211s) [upload=16769]: Starting upload Aug 8 01:55:10.779096198 (16h15m32.523153061s) [upload=16769]: Done starting upload Aug 8 01:55:10.779193425 (16h15m32.523250289s) [upload=16769]: Uploading segments... Aug 8 01:55:10.779250013 (16h15m32.523306883s) [upload=16769]: Got next segment. Inline: true Aug 8 01:55:10.779256039 (16h15m32.5233129s) [upload=16769]: Waiting for error group managing segments... Aug 8 01:55:10.779303624 (16h15m32.523360486s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:55:10.779312117 (16h15m32.523368978s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:55:10.779317881 (16h15m32.523374742s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:55:10.929585505 (16h15m32.673642367s) [upload=16769]: Done uploading segments... Aug 8 01:55:10.929610338 (16h15m32.673667199s) [upload=16769]: Upload finished. err: <nil> Aug 8 01:56:06.435484091 (16h16m28.179540953s) [upload=16784]: Starting upload Aug 8 01:56:06.435552910 (16h16m28.179609773s) [upload=16784]: Done starting upload Aug 8 01:56:06.435619333 (16h16m28.179676183s) [upload=16784]: Uploading segments... Aug 8 01:56:06.435665009 (16h16m28.179721877s) [upload=16784]: Got next segment. Inline: true Aug 8 01:56:06.435670176 (16h16m28.179727036s) [upload=16784]: Waiting for error group managing segments... Aug 8 01:56:06.435712868 (16h16m28.179769728s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:06.435718361 (16h16m28.179775225s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:06.435722349 (16h16m28.179779209s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:06.594737382 (16h16m28.33879423s) [upload=16784]: Done uploading segments... Aug 8 01:56:06.594776360 (16h16m28.338833223s) [upload=16784]: Upload finished. err: <nil> Aug 8 01:56:51.181730272 (16h17m12.925787122s) [upload=16797]: Starting upload Aug 8 01:56:51.181780502 (16h17m12.925837362s) [upload=16797]: Done starting upload Aug 8 01:56:51.181842082 (16h17m12.925898932s) [upload=16797]: Uploading segments... Aug 8 01:56:51.181882111 (16h17m12.925938981s) [upload=16797]: Got next segment. Inline: true Aug 8 01:56:51.181887528 (16h17m12.925944389s) [upload=16797]: Waiting for error group managing segments... Aug 8 01:56:51.181955795 (16h17m12.926012645s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:51.181963090 (16h17m12.926019943s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:51.181966550 (16h17m12.926023404s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:51.374537795 (16h17m13.118594648s) [upload=16797]: Done uploading segments... Aug 8 01:56:51.374553785 (16h17m13.11861064s) [upload=16797]: Upload finished. err: <nil> Aug 8 01:57:56.375733570 (16h18m18.119790416s) [upload=16812]: Starting upload Aug 8 01:57:56.375809631 (16h18m18.119866491s) [upload=16812]: Done starting upload Aug 8 01:57:56.375898814 (16h18m18.119955664s) [upload=16812]: Uploading segments... Aug 8 01:57:56.375972719 (16h18m18.120029579s) [upload=16812]: Got next segment. Inline: true Aug 8 01:57:56.375979950 (16h18m18.120036811s) [upload=16812]: Waiting for error group managing segments... Aug 8 01:57:56.376023911 (16h18m18.120080771s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:57:56.376029224 (16h18m18.120086085s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:57:56.376032588 (16h18m18.120089451s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:57:56.522138524 (16h18m18.266195385s) [upload=16812]: Done uploading segments... Aug 8 01:57:56.522174260 (16h18m18.266231121s) [upload=16812]: Upload finished. err: <nil> Aug 8 01:58:40.668656265 (16h19m2.412713135s) [upload=16827]: Starting upload Aug 8 01:58:40.668711058 (16h19m2.412767924s) [upload=16827]: Done starting upload Aug 8 01:58:40.668790608 (16h19m2.412847457s) [upload=16827]: Uploading segments... Aug 8 01:58:40.668840572 (16h19m2.412897441s) [upload=16827]: Got next segment. Inline: true Aug 8 01:58:40.668846411 (16h19m2.412903277s) [upload=16827]: Waiting for error group managing segments... Aug 8 01:58:40.669005747 (16h19m2.413062607s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:58:40.669017356 (16h19m2.413074217s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:58:40.669021551 (16h19m2.413078412s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:58:40.816114713 (16h19m2.560171563s) [upload=16827]: Done uploading segments... Aug 8 01:58:40.816134617 (16h19m2.560191466s) [upload=16827]: Upload finished. err: <nil> Aug 8 01:59:05.627944078 (16h19m27.372000926s) [upload=16833]: Starting upload Aug 8 01:59:05.627998685 (16h19m27.372055535s) [upload=16833]: Done starting upload Aug 8 01:59:05.628118729 (16h19m27.372175578s) [upload=16833]: Uploading segments... Aug 8 01:59:05.628217606 (16h19m27.372274467s) [upload=16833]: Got next segment. Inline: true Aug 8 01:59:05.628225862 (16h19m27.372282734s) [upload=16833]: Waiting for error group managing segments... Aug 8 01:59:05.628334217 (16h19m27.372391068s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:05.628350984 (16h19m27.372407847s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:05.628354470 (16h19m27.372411329s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:05.774577746 (16h19m27.518634612s) [upload=16833]: Done uploading segments... Aug 8 01:59:05.774602383 (16h19m27.518659233s) [upload=16833]: Upload finished. err: <nil> Aug 8 01:59:37.369718935 (16h19m59.113775787s) [upload=16844]: Starting upload Aug 8 01:59:37.369812437 (16h19m59.113869298s) [upload=16844]: Done starting upload Aug 8 01:59:37.369887515 (16h19m59.113944368s) [upload=16844]: Uploading segments... Aug 8 01:59:37.370021093 (16h19m59.114077981s) [upload=16844]: Got next segment. Inline: true Aug 8 01:59:37.370029981 (16h19m59.114086848s) [upload=16844]: Waiting for error group managing segments... Aug 8 01:59:37.370102430 (16h19m59.114159293s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:37.370109420 (16h19m59.11416628s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:37.370113057 (16h19m59.114169917s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:37.726754734 (16h19m59.47081161s) [upload=16844]: Done uploading segments... Aug 8 01:59:37.726778784 (16h19m59.470835637s) [upload=16844]: Upload finished. err: <nil> Aug 8 02:00:24.719377480 (16h20m46.463434328s) [upload=16863]: Starting upload Aug 8 02:00:24.719456409 (16h20m46.463513255s) [upload=16863]: Done starting upload Aug 8 02:00:24.719560489 (16h20m46.463617335s) [upload=16863]: Uploading segments... Aug 8 02:00:24.719616926 (16h20m46.463673789s) [upload=16863]: Got next segment. Inline: true Aug 8 02:00:24.719622706 (16h20m46.463679552s) [upload=16863]: Waiting for error group managing segments... Aug 8 02:00:24.719659743 (16h20m46.463716591s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:24.719664652 (16h20m46.463721498s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:24.719667649 (16h20m46.463724496s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:25.030175327 (16h20m46.774232197s) [upload=16863]: Done uploading segments... Aug 8 02:00:25.030222980 (16h20m46.774279831s) [upload=16863]: Upload finished. err: <nil> Aug 8 02:00:46.211977832 (16h21m7.956034683s) [upload=16869]: Starting upload Aug 8 02:00:46.212032242 (16h21m7.956089102s) [upload=16869]: Done starting upload Aug 8 02:00:46.212101179 (16h21m7.956158028s) [upload=16869]: Uploading segments... Aug 8 02:00:46.212148507 (16h21m7.956205376s) [upload=16869]: Got next segment. Inline: true Aug 8 02:00:46.212155810 (16h21m7.956212671s) [upload=16869]: Waiting for error group managing segments... Aug 8 02:00:46.212197694 (16h21m7.956254544s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:46.212202763 (16h21m7.956259624s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:46.212206348 (16h21m7.956263209s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:46.360999669 (16h21m8.105056524s) [upload=16869]: Done uploading segments... Aug 8 02:00:46.361040611 (16h21m8.105097472s) [upload=16869]: Upload finished. err: <nil> Aug 8 02:01:57.357493061 (16h22m19.101549913s) [upload=16887]: Starting upload Aug 8 02:01:57.357550990 (16h22m19.101607841s) [upload=16887]: Done starting upload Aug 8 02:01:57.357634434 (16h22m19.101691284s) [upload=16887]: Uploading segments... Aug 8 02:01:57.357688424 (16h22m19.101745285s) [upload=16887]: Got next segment. Inline: true Aug 8 02:01:57.357693917 (16h22m19.101750778s) [upload=16887]: Waiting for error group managing segments... Aug 8 02:01:57.357741416 (16h22m19.101798267s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:01:57.357748493 (16h22m19.101805358s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:01:57.357753129 (16h22m19.101809997s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:01:57.874642140 (16h22m19.618698996s) [upload=16887]: Done uploading segments... Aug 8 02:01:57.874664164 (16h22m19.618721018s) [upload=16887]: Upload finished. err: <nil>
Duration: 856.327555ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.379228469s
FAIL (2025-08-08 02:03:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.379265851s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X.....................X........................X.] duration:
866.433662ms
FAIL (2025-08-08 02:02:23 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 6751]: Done uploading segments... Aug 8 01:54:07.115487086 (16h14m28.859543939s) [upload=16751]: Upload finished. err: <nil> Aug 8 01:55:10.779008362 (16h15m32.523065211s) [upload=16769]: Starting upload Aug 8 01:55:10.779096198 (16h15m32.523153061s) [upload=16769]: Done starting upload Aug 8 01:55:10.779193425 (16h15m32.523250289s) [upload=16769]: Uploading segments... Aug 8 01:55:10.779250013 (16h15m32.523306883s) [upload=16769]: Got next segment. Inline: true Aug 8 01:55:10.779256039 (16h15m32.5233129s) [upload=16769]: Waiting for error group managing segments... Aug 8 01:55:10.779303624 (16h15m32.523360486s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:55:10.779312117 (16h15m32.523368978s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:55:10.779317881 (16h15m32.523374742s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:55:10.929585505 (16h15m32.673642367s) [upload=16769]: Done uploading segments... Aug 8 01:55:10.929610338 (16h15m32.673667199s) [upload=16769]: Upload finished. err: <nil> Aug 8 01:56:06.435484091 (16h16m28.179540953s) [upload=16784]: Starting upload Aug 8 01:56:06.435552910 (16h16m28.179609773s) [upload=16784]: Done starting upload Aug 8 01:56:06.435619333 (16h16m28.179676183s) [upload=16784]: Uploading segments... Aug 8 01:56:06.435665009 (16h16m28.179721877s) [upload=16784]: Got next segment. Inline: true Aug 8 01:56:06.435670176 (16h16m28.179727036s) [upload=16784]: Waiting for error group managing segments... Aug 8 01:56:06.435712868 (16h16m28.179769728s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:06.435718361 (16h16m28.179775225s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:06.435722349 (16h16m28.179779209s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:06.594737382 (16h16m28.33879423s) [upload=16784]: Done uploading segments... Aug 8 01:56:06.594776360 (16h16m28.338833223s) [upload=16784]: Upload finished. err: <nil> Aug 8 01:56:51.181730272 (16h17m12.925787122s) [upload=16797]: Starting upload Aug 8 01:56:51.181780502 (16h17m12.925837362s) [upload=16797]: Done starting upload Aug 8 01:56:51.181842082 (16h17m12.925898932s) [upload=16797]: Uploading segments... Aug 8 01:56:51.181882111 (16h17m12.925938981s) [upload=16797]: Got next segment. Inline: true Aug 8 01:56:51.181887528 (16h17m12.925944389s) [upload=16797]: Waiting for error group managing segments... Aug 8 01:56:51.181955795 (16h17m12.926012645s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:51.181963090 (16h17m12.926019943s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:51.181966550 (16h17m12.926023404s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:51.374537795 (16h17m13.118594648s) [upload=16797]: Done uploading segments... Aug 8 01:56:51.374553785 (16h17m13.11861064s) [upload=16797]: Upload finished. err: <nil> Aug 8 01:57:56.375733570 (16h18m18.119790416s) [upload=16812]: Starting upload Aug 8 01:57:56.375809631 (16h18m18.119866491s) [upload=16812]: Done starting upload Aug 8 01:57:56.375898814 (16h18m18.119955664s) [upload=16812]: Uploading segments... Aug 8 01:57:56.375972719 (16h18m18.120029579s) [upload=16812]: Got next segment. Inline: true Aug 8 01:57:56.375979950 (16h18m18.120036811s) [upload=16812]: Waiting for error group managing segments... Aug 8 01:57:56.376023911 (16h18m18.120080771s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:57:56.376029224 (16h18m18.120086085s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:57:56.376032588 (16h18m18.120089451s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:57:56.522138524 (16h18m18.266195385s) [upload=16812]: Done uploading segments... Aug 8 01:57:56.522174260 (16h18m18.266231121s) [upload=16812]: Upload finished. err: <nil> Aug 8 01:58:40.668656265 (16h19m2.412713135s) [upload=16827]: Starting upload Aug 8 01:58:40.668711058 (16h19m2.412767924s) [upload=16827]: Done starting upload Aug 8 01:58:40.668790608 (16h19m2.412847457s) [upload=16827]: Uploading segments... Aug 8 01:58:40.668840572 (16h19m2.412897441s) [upload=16827]: Got next segment. Inline: true Aug 8 01:58:40.668846411 (16h19m2.412903277s) [upload=16827]: Waiting for error group managing segments... Aug 8 01:58:40.669005747 (16h19m2.413062607s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:58:40.669017356 (16h19m2.413074217s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:58:40.669021551 (16h19m2.413078412s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:58:40.816114713 (16h19m2.560171563s) [upload=16827]: Done uploading segments... Aug 8 01:58:40.816134617 (16h19m2.560191466s) [upload=16827]: Upload finished. err: <nil> Aug 8 01:59:05.627944078 (16h19m27.372000926s) [upload=16833]: Starting upload Aug 8 01:59:05.627998685 (16h19m27.372055535s) [upload=16833]: Done starting upload Aug 8 01:59:05.628118729 (16h19m27.372175578s) [upload=16833]: Uploading segments... Aug 8 01:59:05.628217606 (16h19m27.372274467s) [upload=16833]: Got next segment. Inline: true Aug 8 01:59:05.628225862 (16h19m27.372282734s) [upload=16833]: Waiting for error group managing segments... Aug 8 01:59:05.628334217 (16h19m27.372391068s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:05.628350984 (16h19m27.372407847s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:05.628354470 (16h19m27.372411329s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:05.774577746 (16h19m27.518634612s) [upload=16833]: Done uploading segments... Aug 8 01:59:05.774602383 (16h19m27.518659233s) [upload=16833]: Upload finished. err: <nil> Aug 8 01:59:37.369718935 (16h19m59.113775787s) [upload=16844]: Starting upload Aug 8 01:59:37.369812437 (16h19m59.113869298s) [upload=16844]: Done starting upload Aug 8 01:59:37.369887515 (16h19m59.113944368s) [upload=16844]: Uploading segments... Aug 8 01:59:37.370021093 (16h19m59.114077981s) [upload=16844]: Got next segment. Inline: true Aug 8 01:59:37.370029981 (16h19m59.114086848s) [upload=16844]: Waiting for error group managing segments... Aug 8 01:59:37.370102430 (16h19m59.114159293s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:37.370109420 (16h19m59.11416628s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:37.370113057 (16h19m59.114169917s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:37.726754734 (16h19m59.47081161s) [upload=16844]: Done uploading segments... Aug 8 01:59:37.726778784 (16h19m59.470835637s) [upload=16844]: Upload finished. err: <nil> Aug 8 02:00:24.719377480 (16h20m46.463434328s) [upload=16863]: Starting upload Aug 8 02:00:24.719456409 (16h20m46.463513255s) [upload=16863]: Done starting upload Aug 8 02:00:24.719560489 (16h20m46.463617335s) [upload=16863]: Uploading segments... Aug 8 02:00:24.719616926 (16h20m46.463673789s) [upload=16863]: Got next segment. Inline: true Aug 8 02:00:24.719622706 (16h20m46.463679552s) [upload=16863]: Waiting for error group managing segments... Aug 8 02:00:24.719659743 (16h20m46.463716591s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:24.719664652 (16h20m46.463721498s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:24.719667649 (16h20m46.463724496s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:25.030175327 (16h20m46.774232197s) [upload=16863]: Done uploading segments... Aug 8 02:00:25.030222980 (16h20m46.774279831s) [upload=16863]: Upload finished. err: <nil> Aug 8 02:00:46.211977832 (16h21m7.956034683s) [upload=16869]: Starting upload Aug 8 02:00:46.212032242 (16h21m7.956089102s) [upload=16869]: Done starting upload Aug 8 02:00:46.212101179 (16h21m7.956158028s) [upload=16869]: Uploading segments... Aug 8 02:00:46.212148507 (16h21m7.956205376s) [upload=16869]: Got next segment. Inline: true Aug 8 02:00:46.212155810 (16h21m7.956212671s) [upload=16869]: Waiting for error group managing segments... Aug 8 02:00:46.212197694 (16h21m7.956254544s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:46.212202763 (16h21m7.956259624s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:46.212206348 (16h21m7.956263209s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:46.360999669 (16h21m8.105056524s) [upload=16869]: Done uploading segments... Aug 8 02:00:46.361040611 (16h21m8.105097472s) [upload=16869]: Upload finished. err: <nil> Aug 8 02:01:57.357493061 (16h22m19.101549913s) [upload=16887]: Starting upload Aug 8 02:01:57.357550990 (16h22m19.101607841s) [upload=16887]: Done starting upload Aug 8 02:01:57.357634434 (16h22m19.101691284s) [upload=16887]: Uploading segments... Aug 8 02:01:57.357688424 (16h22m19.101745285s) [upload=16887]: Got next segment. Inline: true Aug 8 02:01:57.357693917 (16h22m19.101750778s) [upload=16887]: Waiting for error group managing segments... Aug 8 02:01:57.357741416 (16h22m19.101798267s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:01:57.357748493 (16h22m19.101805358s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:01:57.357753129 (16h22m19.101809997s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:01:57.874642140 (16h22m19.618698996s) [upload=16887]: Done uploading segments... Aug 8 02:01:57.874664164 (16h22m19.618721018s) [upload=16887]: Upload finished. err: <nil>
Duration: 866.479791ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.504834269s
FAIL (2025-08-08 02:02:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.504866974s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X.....................X........................X] duration:
1.078645665s
FAIL (2025-08-08 02:01:58 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 6751]: Done uploading segments... Aug 8 01:54:07.115487086 (16h14m28.859543939s) [upload=16751]: Upload finished. err: <nil> Aug 8 01:55:10.779008362 (16h15m32.523065211s) [upload=16769]: Starting upload Aug 8 01:55:10.779096198 (16h15m32.523153061s) [upload=16769]: Done starting upload Aug 8 01:55:10.779193425 (16h15m32.523250289s) [upload=16769]: Uploading segments... Aug 8 01:55:10.779250013 (16h15m32.523306883s) [upload=16769]: Got next segment. Inline: true Aug 8 01:55:10.779256039 (16h15m32.5233129s) [upload=16769]: Waiting for error group managing segments... Aug 8 01:55:10.779303624 (16h15m32.523360486s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:55:10.779312117 (16h15m32.523368978s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:55:10.779317881 (16h15m32.523374742s) [upload=16769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:55:10.929585505 (16h15m32.673642367s) [upload=16769]: Done uploading segments... Aug 8 01:55:10.929610338 (16h15m32.673667199s) [upload=16769]: Upload finished. err: <nil> Aug 8 01:56:06.435484091 (16h16m28.179540953s) [upload=16784]: Starting upload Aug 8 01:56:06.435552910 (16h16m28.179609773s) [upload=16784]: Done starting upload Aug 8 01:56:06.435619333 (16h16m28.179676183s) [upload=16784]: Uploading segments... Aug 8 01:56:06.435665009 (16h16m28.179721877s) [upload=16784]: Got next segment. Inline: true Aug 8 01:56:06.435670176 (16h16m28.179727036s) [upload=16784]: Waiting for error group managing segments... Aug 8 01:56:06.435712868 (16h16m28.179769728s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:06.435718361 (16h16m28.179775225s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:06.435722349 (16h16m28.179779209s) [upload=16784]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:06.594737382 (16h16m28.33879423s) [upload=16784]: Done uploading segments... Aug 8 01:56:06.594776360 (16h16m28.338833223s) [upload=16784]: Upload finished. err: <nil> Aug 8 01:56:51.181730272 (16h17m12.925787122s) [upload=16797]: Starting upload Aug 8 01:56:51.181780502 (16h17m12.925837362s) [upload=16797]: Done starting upload Aug 8 01:56:51.181842082 (16h17m12.925898932s) [upload=16797]: Uploading segments... Aug 8 01:56:51.181882111 (16h17m12.925938981s) [upload=16797]: Got next segment. Inline: true Aug 8 01:56:51.181887528 (16h17m12.925944389s) [upload=16797]: Waiting for error group managing segments... Aug 8 01:56:51.181955795 (16h17m12.926012645s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:56:51.181963090 (16h17m12.926019943s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:56:51.181966550 (16h17m12.926023404s) [upload=16797]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:56:51.374537795 (16h17m13.118594648s) [upload=16797]: Done uploading segments... Aug 8 01:56:51.374553785 (16h17m13.11861064s) [upload=16797]: Upload finished. err: <nil> Aug 8 01:57:56.375733570 (16h18m18.119790416s) [upload=16812]: Starting upload Aug 8 01:57:56.375809631 (16h18m18.119866491s) [upload=16812]: Done starting upload Aug 8 01:57:56.375898814 (16h18m18.119955664s) [upload=16812]: Uploading segments... Aug 8 01:57:56.375972719 (16h18m18.120029579s) [upload=16812]: Got next segment. Inline: true Aug 8 01:57:56.375979950 (16h18m18.120036811s) [upload=16812]: Waiting for error group managing segments... Aug 8 01:57:56.376023911 (16h18m18.120080771s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:57:56.376029224 (16h18m18.120086085s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:57:56.376032588 (16h18m18.120089451s) [upload=16812]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:57:56.522138524 (16h18m18.266195385s) [upload=16812]: Done uploading segments... Aug 8 01:57:56.522174260 (16h18m18.266231121s) [upload=16812]: Upload finished. err: <nil> Aug 8 01:58:40.668656265 (16h19m2.412713135s) [upload=16827]: Starting upload Aug 8 01:58:40.668711058 (16h19m2.412767924s) [upload=16827]: Done starting upload Aug 8 01:58:40.668790608 (16h19m2.412847457s) [upload=16827]: Uploading segments... Aug 8 01:58:40.668840572 (16h19m2.412897441s) [upload=16827]: Got next segment. Inline: true Aug 8 01:58:40.668846411 (16h19m2.412903277s) [upload=16827]: Waiting for error group managing segments... Aug 8 01:58:40.669005747 (16h19m2.413062607s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:58:40.669017356 (16h19m2.413074217s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:58:40.669021551 (16h19m2.413078412s) [upload=16827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:58:40.816114713 (16h19m2.560171563s) [upload=16827]: Done uploading segments... Aug 8 01:58:40.816134617 (16h19m2.560191466s) [upload=16827]: Upload finished. err: <nil> Aug 8 01:59:05.627944078 (16h19m27.372000926s) [upload=16833]: Starting upload Aug 8 01:59:05.627998685 (16h19m27.372055535s) [upload=16833]: Done starting upload Aug 8 01:59:05.628118729 (16h19m27.372175578s) [upload=16833]: Uploading segments... Aug 8 01:59:05.628217606 (16h19m27.372274467s) [upload=16833]: Got next segment. Inline: true Aug 8 01:59:05.628225862 (16h19m27.372282734s) [upload=16833]: Waiting for error group managing segments... Aug 8 01:59:05.628334217 (16h19m27.372391068s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:05.628350984 (16h19m27.372407847s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:05.628354470 (16h19m27.372411329s) [upload=16833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:05.774577746 (16h19m27.518634612s) [upload=16833]: Done uploading segments... Aug 8 01:59:05.774602383 (16h19m27.518659233s) [upload=16833]: Upload finished. err: <nil> Aug 8 01:59:37.369718935 (16h19m59.113775787s) [upload=16844]: Starting upload Aug 8 01:59:37.369812437 (16h19m59.113869298s) [upload=16844]: Done starting upload Aug 8 01:59:37.369887515 (16h19m59.113944368s) [upload=16844]: Uploading segments... Aug 8 01:59:37.370021093 (16h19m59.114077981s) [upload=16844]: Got next segment. Inline: true Aug 8 01:59:37.370029981 (16h19m59.114086848s) [upload=16844]: Waiting for error group managing segments... Aug 8 01:59:37.370102430 (16h19m59.114159293s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:59:37.370109420 (16h19m59.11416628s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:59:37.370113057 (16h19m59.114169917s) [upload=16844]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:59:37.726754734 (16h19m59.47081161s) [upload=16844]: Done uploading segments... Aug 8 01:59:37.726778784 (16h19m59.470835637s) [upload=16844]: Upload finished. err: <nil> Aug 8 02:00:24.719377480 (16h20m46.463434328s) [upload=16863]: Starting upload Aug 8 02:00:24.719456409 (16h20m46.463513255s) [upload=16863]: Done starting upload Aug 8 02:00:24.719560489 (16h20m46.463617335s) [upload=16863]: Uploading segments... Aug 8 02:00:24.719616926 (16h20m46.463673789s) [upload=16863]: Got next segment. Inline: true Aug 8 02:00:24.719622706 (16h20m46.463679552s) [upload=16863]: Waiting for error group managing segments... Aug 8 02:00:24.719659743 (16h20m46.463716591s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:24.719664652 (16h20m46.463721498s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:24.719667649 (16h20m46.463724496s) [upload=16863]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:25.030175327 (16h20m46.774232197s) [upload=16863]: Done uploading segments... Aug 8 02:00:25.030222980 (16h20m46.774279831s) [upload=16863]: Upload finished. err: <nil> Aug 8 02:00:46.211977832 (16h21m7.956034683s) [upload=16869]: Starting upload Aug 8 02:00:46.212032242 (16h21m7.956089102s) [upload=16869]: Done starting upload Aug 8 02:00:46.212101179 (16h21m7.956158028s) [upload=16869]: Uploading segments... Aug 8 02:00:46.212148507 (16h21m7.956205376s) [upload=16869]: Got next segment. Inline: true Aug 8 02:00:46.212155810 (16h21m7.956212671s) [upload=16869]: Waiting for error group managing segments... Aug 8 02:00:46.212197694 (16h21m7.956254544s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:00:46.212202763 (16h21m7.956259624s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:00:46.212206348 (16h21m7.956263209s) [upload=16869]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:00:46.360999669 (16h21m8.105056524s) [upload=16869]: Done uploading segments... Aug 8 02:00:46.361040611 (16h21m8.105097472s) [upload=16869]: Upload finished. err: <nil> Aug 8 02:01:57.357493061 (16h22m19.101549913s) [upload=16887]: Starting upload Aug 8 02:01:57.357550990 (16h22m19.101607841s) [upload=16887]: Done starting upload Aug 8 02:01:57.357634434 (16h22m19.101691284s) [upload=16887]: Uploading segments... Aug 8 02:01:57.357688424 (16h22m19.101745285s) [upload=16887]: Got next segment. Inline: true Aug 8 02:01:57.357693917 (16h22m19.101750778s) [upload=16887]: Waiting for error group managing segments... Aug 8 02:01:57.357741416 (16h22m19.101798267s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:01:57.357748493 (16h22m19.101805358s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:01:57.357753129 (16h22m19.101809997s) [upload=16887]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:01:57.874642140 (16h22m19.618698996s) [upload=16887]: Done uploading segments... Aug 8 02:01:57.874664164 (16h22m19.618721018s) [upload=16887]: Upload finished. err: <nil>
Duration: 1.07870454s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
3.482067745s
FAIL (2025-08-08 02:01:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 3.482139596s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X.....................X........................] duration:
855.69241ms
FAIL (2025-08-08 02:00:46 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 855.725877ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X.....................X.......................] duration:
1.002646021s
FAIL (2025-08-08 02:00:25 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 1.002679066s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.393988213s
FAIL (2025-08-08 02:00:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.394023134s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X.....................X......................] duration:
1.042896169s
FAIL (2025-08-08 01:59:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 1.04292549s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.505082186s
FAIL (2025-08-08 01:59:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 2.505109202s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X.....................X.....................] duration:
860.788087ms
FAIL (2025-08-08 01:59:06 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 860.817695ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X.....................X....................] duration:
863.563386ms
FAIL (2025-08-08 01:58:41 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 863.593347ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1.773641088s
FAIL (2025-08-08 01:58:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
1:58:24.764156172 (16h18m46.508213022s) [seg_pos={0 0}, upload=16820]: Done begin upload segment.
Aug 8 01:58:24.764182482 (16h18m46.508239345s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764227464 (16h18m46.508284327s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764601543 (16h18m46.508658408s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764692606 (16h18m46.508749467s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.764925526 (16h18m46.508982389s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765132722 (16h18m46.509189584s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765250881 (16h18m46.509307745s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765548819 (16h18m46.509605684s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765581301 (16h18m46.509638164s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.765625161 (16h18m46.509682021s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766000768 (16h18m46.510057638s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.766060026 (16h18m46.510116894s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767397402 (16h18m46.511454266s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767510692 (16h18m46.511567564s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.767895455 (16h18m46.51195232s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768616129 (16h18m46.51267299s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.768844795 (16h18m46.512901665s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:24.770605008 (16h18m46.514661876s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Uploading piece...
Aug 8 01:58:25.343214910 (16h18m47.087271776s) [upload=16820]: Next returned nil segment
Aug 8 01:58:25.343236465 (16h18m47.08729333s) [upload=16820]: Waiting for error group managing segments...
Aug 8 01:58:25.484130115 (16h18m47.228186971s) [noise=true , address=45.91.116.7:4036 , piece_id=IRLP3UXZWNUQ4XZ4MBMAZN33BCGAPGYLUENGQVZUWOQJCLDOJAUQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505079119 (16h18m47.249135972s) [noise=true , address=45.91.116.13:4176 , piece_id=YIUGIKQWXA2LDGUMMQDNYOH6AMVUPTODT7LRFZLSXB37GSPR47UQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.505330395 (16h18m47.249387257s) [noise=true , address=104.36.82.52:4111 , piece_id=7IIQ6RNT6YAFJ2Y6CSKEKMV3IOPL5MYBSHKR76WP4V3W32BFEKDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.509728598 (16h18m47.253785458s) [noise=true , address=104.36.82.45:4915 , piece_id=Y6G42MRUXYNODHQ7XMYVAKNRECW7M3F3Y6X2Q6AL3M3QJSLR2QDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.517406998 (16h18m47.261463847s) [noise=true , address=104.36.82.56:4248 , piece_id=MQVWMMJLWFZLO6J3CLUWVXM3Y5PF3JW3ZZJBOVI5EN6DH5VEVU7A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.528670950 (16h18m47.272727801s) [noise=true , address=104.36.82.37:4666 , piece_id=KRVK2IYPE34T6QKSIN5ZIP6FL4SSENBBGHUOVTBFCSQIFE2JVMIA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529220955 (16h18m47.273277805s) [noise=true , address=104.36.82.55:4213 , piece_id=5P6OLXGIHSH3AF5CBKPXKZB2U3LX737LPORG3VG7OB7PG5ASP6XQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.529954863 (16h18m47.274011713s) [noise=true , address=104.36.82.36:4623 , piece_id=2BDHZ7GMMCVA7FR6RO2I2O4R67O7NKKR4SHZIGQQFWPGGSIWYGBA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.532062808 (16h18m47.276119661s) [noise=true , address=104.36.82.58:4276 , piece_id=BCO2WVBE2Z3BFMVNBNUGC2K3JLXDPDAOBZVBLXCFZY5VMFYIQGDA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547391024 (16h18m47.291447883s) [noise=true , address=104.36.82.8:4998 , piece_id=N7V3PL2O5R5EVVVOA5GCUFUT2GRBQQVJGRG4XU7UWRXPKHYPGOXA, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.547708221 (16h18m47.29176507s) [noise=true , address=45.91.116.10:4102 , piece_id=YD4FXSPQ2YPAPGK6JED5QM7OLLKNZ2UJF4YPRD4522VPOXFRSC3A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.551401799 (16h18m47.295458664s) [noise=true , address=104.36.82.23:4453 , piece_id=RE5P2HKGNO3LPOPTLIVIQIADFIA54FYFS4LM7TFT37DGBJPMHIBQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.564511964 (16h18m47.308568815s) [noise=true , address=104.36.82.16:4305 , piece_id=AJVIR6DMZQFMY44RGBYT6ME24GVVLB5GLJCCL5KSXPBPS4GUKJYQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593841433 (16h18m47.337898284s) [noise=true , address=104.36.82.61:4387 , piece_id=TWDTQOERNJT3E56UACYFEIPFDSRN2I747FWULLJOBEPX5DLHW4AQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: <nil>
Aug 8 01:58:25.593864269 (16h18m47.337921118s) [seg_pos={0 0}, upload=16820]: Segment reached optimal threshold of 14 pieces.
Aug 8 01:58:25.594040914 (16h18m47.338097765s) [noise=true , address=104.36.82.59:4310 , piece_id=3WIXJF4TTVNJXAQQE5N2EGO5HMNUP2EHYDTUN4WNLK4ZZNLGSPOQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uYJ3ag6xFbLiu39t7jqwvtbo1QLwHw7k9PmfrMWBZBappp8MX): protocol: expected piece hash; context canceled; EOF
Aug 8 01:58:25.594340204 (16h18m47.338397055s) [noise=true , address=64.49.13.140:4514 , piece_id=5B5H3JGWGN7LWMSUI5WTNINPY7YCN74WUDIY66H32ORHO6V4FNSQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45616->64.49.13.140:4514: use of closed network connection
Aug 8 01:58:25.594414512 (16h18m47.338471372s) [noise=true , address=64.49.13.138:4485 , piece_id=V5IKSJ3GK2DUOL7ELUMISCNBL45TXZAJSFZDOUH4QRCMBDXWRH2A, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43518->64.49.13.138:4485: use of closed network connection
Aug 8 01:58:25.594435647 (16h18m47.338492498s) [noise=true , address=64.49.13.138:4487 , piece_id=MBVSPQRYN6QSBQDOABXULAIFEJAPFKLQGAHHDTAZWWD5QJFAKPXQ, seg_pos={0 0}, upload=16820]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12taemzrausuc58d8Dyo8xaR7MqDf72f37rEheF32sUfy8Z8GZP): protocol: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35422->64.49.13.138:4487: use of closed network connection
Aug 8 01:58:25.594447799 (16h18m47.338504648s) [seg_pos={0 0}, upload=16820]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 01:58:25.594539028 (16h18m47.338595888s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 01:58:25.594544180 (16h18m47.338601044s) [upload=16820]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 01:58:25.756196953 (16h18m47.500253803s) [upload=16820]: Done uploading segments...
Aug 8 01:58:25.756216175 (16h18m47.500273024s) [upload=16820]: Upload finished. err: <nil>
Duration: 1.773734047s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X.....................X...................] duration:
831.224655ms
FAIL (2025-08-08 01:57:56 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 831.261674ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X.....................X..................] duration:
883.021486ms
FAIL (2025-08-08 01:56:51 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 883.051023ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X.....................X.................] duration:
844.912641ms
FAIL (2025-08-08 01:56:07 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 5h54m42.111875016s) [upload=16409]: Done uploading segments... Aug 8 01:34:20.367838946 (15h54m42.111895804s) [upload=16409]: Upload finished. err: <nil> Aug 8 01:34:53.085036821 (15h55m14.829093672s) [upload=16419]: Starting upload Aug 8 01:34:53.085103324 (15h55m14.829160187s) [upload=16419]: Done starting upload Aug 8 01:34:53.085193780 (15h55m14.829250642s) [upload=16419]: Uploading segments... Aug 8 01:34:53.085271704 (15h55m14.829328575s) [upload=16419]: Got next segment. Inline: true Aug 8 01:34:53.085277849 (15h55m14.829334701s) [upload=16419]: Waiting for error group managing segments... Aug 8 01:34:53.085348024 (15h55m14.829404888s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:34:53.085355895 (15h55m14.829412765s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:34:53.085359737 (15h55m14.829416605s) [upload=16419]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:34:53.244597521 (15h55m14.988654398s) [upload=16419]: Done uploading segments... Aug 8 01:34:53.244635012 (15h55m14.988691873s) [upload=16419]: Upload finished. err: <nil> Aug 8 01:35:21.500081810 (15h55m43.244138675s) [upload=16426]: Starting upload Aug 8 01:35:21.500208349 (15h55m43.244265214s) [upload=16426]: Done starting upload Aug 8 01:35:21.500356303 (15h55m43.24441315s) [upload=16426]: Uploading segments... Aug 8 01:35:21.500481008 (15h55m43.244537884s) [upload=16426]: Got next segment. Inline: true Aug 8 01:35:21.500505489 (15h55m43.244562353s) [upload=16426]: Waiting for error group managing segments... Aug 8 01:35:21.500584686 (15h55m43.244641551s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:21.500592001 (15h55m43.244648871s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:21.500596915 (15h55m43.244653782s) [upload=16426]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:21.659140833 (15h55m43.403197684s) [upload=16426]: Done uploading segments... Aug 8 01:35:21.659171863 (15h55m43.403228712s) [upload=16426]: Upload finished. err: <nil> Aug 8 01:35:45.786102082 (15h56m7.530158943s) [upload=16433]: Starting upload Aug 8 01:35:45.786172367 (15h56m7.530229228s) [upload=16433]: Done starting upload Aug 8 01:35:45.786331370 (15h56m7.530388229s) [upload=16433]: Uploading segments... Aug 8 01:35:45.786415938 (15h56m7.530472812s) [upload=16433]: Got next segment. Inline: true Aug 8 01:35:45.786422377 (15h56m7.530479238s) [upload=16433]: Waiting for error group managing segments... Aug 8 01:35:45.786568729 (15h56m7.530625595s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:35:45.786575111 (15h56m7.530631974s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:35:45.786578836 (15h56m7.530635697s) [upload=16433]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:35:46.185199396 (15h56m7.929256247s) [upload=16433]: Done uploading segments... Aug 8 01:35:46.185217347 (15h56m7.929274198s) [upload=16433]: Upload finished. err: <nil> Aug 8 01:36:36.709863137 (15h56m58.453919988s) [upload=16449]: Starting upload Aug 8 01:36:36.709940589 (15h56m58.45399745s) [upload=16449]: Done starting upload Aug 8 01:36:36.710030107 (15h56m58.45408697s) [upload=16449]: Uploading segments... Aug 8 01:36:36.710108353 (15h56m58.454165235s) [upload=16449]: Got next segment. Inline: true Aug 8 01:36:36.710115343 (15h56m58.454172212s) [upload=16449]: Waiting for error group managing segments... Aug 8 01:36:36.710188063 (15h56m58.454244915s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:36:36.710195404 (15h56m58.454252263s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:36:36.710200176 (15h56m58.45425704s) [upload=16449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:36:36.863089376 (15h56m58.607146252s) [upload=16449]: Done uploading segments... Aug 8 01:36:36.863110947 (15h56m58.6071678s) [upload=16449]: Upload finished. err: <nil> Aug 8 01:37:46.261690463 (15h58m8.005747312s) [upload=16469]: Starting upload Aug 8 01:37:46.261781279 (15h58m8.005838129s) [upload=16469]: Done starting upload Aug 8 01:37:46.261998605 (15h58m8.006055457s) [upload=16469]: Uploading segments... Aug 8 01:37:46.262091367 (15h58m8.006148231s) [upload=16469]: Got next segment. Inline: true Aug 8 01:37:46.262100019 (15h58m8.006156882s) [upload=16469]: Waiting for error group managing segments... Aug 8 01:37:46.262167051 (15h58m8.006223912s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:37:46.262174052 (15h58m8.006230904s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:37:46.262178492 (15h58m8.006235359s) [upload=16469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:37:46.423230181 (15h58m8.167287075s) [upload=16469]: Done uploading segments... Aug 8 01:37:46.423256341 (15h58m8.167313206s) [upload=16469]: Upload finished. err: <nil> Aug 8 01:38:04.189822860 (15h58m25.933879709s) [upload=16476]: Starting upload Aug 8 01:38:04.189906391 (15h58m25.933963241s) [upload=16476]: Done starting upload Aug 8 01:38:04.190061701 (15h58m25.934118556s) [upload=16476]: Uploading segments... Aug 8 01:38:04.190131330 (15h58m25.934188201s) [upload=16476]: Got next segment. Inline: true Aug 8 01:38:04.190137968 (15h58m25.934194829s) [upload=16476]: Waiting for error group managing segments... Aug 8 01:38:04.190205418 (15h58m25.934262269s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:04.190211834 (15h58m25.934268701s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:04.190215874 (15h58m25.934272735s) [upload=16476]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:04.357458058 (15h58m26.10151491s) [upload=16476]: Done uploading segments... Aug 8 01:38:04.357476463 (15h58m26.101533314s) [upload=16476]: Upload finished. err: <nil> Aug 8 01:38:38.110717692 (15h58m59.854774552s) [upload=16487]: Starting upload Aug 8 01:38:38.110875845 (15h58m59.854932706s) [upload=16487]: Done starting upload Aug 8 01:38:38.110948915 (15h58m59.855005762s) [upload=16487]: Uploading segments... Aug 8 01:38:38.111013184 (15h58m59.855070047s) [upload=16487]: Got next segment. Inline: true Aug 8 01:38:38.111018188 (15h58m59.855075047s) [upload=16487]: Waiting for error group managing segments... Aug 8 01:38:38.111072927 (15h58m59.855129789s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:38:38.111077743 (15h58m59.855134589s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:38:38.111080593 (15h58m59.855137454s) [upload=16487]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:38:38.274050916 (15h59m0.01810777s) [upload=16487]: Done uploading segments... Aug 8 01:38:38.274069446 (15h59m0.018126299s) [upload=16487]: Upload finished. err: <nil> Aug 8 01:39:20.160028532 (15h59m41.904085411s) [upload=16502]: Starting upload Aug 8 01:39:20.160107337 (15h59m41.904164198s) [upload=16502]: Done starting upload Aug 8 01:39:20.160203923 (15h59m41.904260772s) [upload=16502]: Uploading segments... Aug 8 01:39:20.160278147 (15h59m41.904335019s) [upload=16502]: Got next segment. Inline: true Aug 8 01:39:20.160284729 (15h59m41.904341577s) [upload=16502]: Waiting for error group managing segments... Aug 8 01:39:20.160352232 (15h59m41.904409099s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:39:20.160360909 (15h59m41.904417767s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:39:20.160368019 (15h59m41.904424887s) [upload=16502]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:39:20.323282798 (15h59m42.067339662s) [upload=16502]: Done uploading segments... Aug 8 01:39:20.323319661 (15h59m42.067376527s) [upload=16502]: Upload finished. err: <nil> Aug 8 01:40:26.343640007 (16h0m48.087696867s) [upload=16518]: Starting upload Aug 8 01:40:26.343693395 (16h0m48.087750255s) [upload=16518]: Done starting upload Aug 8 01:40:26.343784850 (16h0m48.087841721s) [upload=16518]: Uploading segments... Aug 8 01:40:26.343926362 (16h0m48.087983246s) [upload=16518]: Got next segment. Inline: true Aug 8 01:40:26.343934494 (16h0m48.087991368s) [upload=16518]: Waiting for error group managing segments... Aug 8 01:40:26.343994649 (16h0m48.088051516s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:40:26.344002058 (16h0m48.088058943s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:40:26.344007275 (16h0m48.088064148s) [upload=16518]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:40:26.502958442 (16h0m48.247015312s) [upload=16518]: Done uploading segments... Aug 8 01:40:26.503002314 (16h0m48.247059194s) [upload=16518]: Upload finished. err: <nil> Aug 8 01:41:25.284580583 (16h1m47.02863744s) [upload=16536]: Starting upload Aug 8 01:41:25.284642905 (16h1m47.028699757s) [upload=16536]: Done starting upload Aug 8 01:41:25.284718698 (16h1m47.028775549s) [upload=16536]: Uploading segments... Aug 8 01:41:25.284756546 (16h1m47.028813408s) [upload=16536]: Got next segment. Inline: true Aug 8 01:41:25.284761335 (16h1m47.028818196s) [upload=16536]: Waiting for error group managing segments... Aug 8 01:41:25.284804610 (16h1m47.02886146s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 01:41:25.284810460 (16h1m47.02886732s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 01:41:25.284813919 (16h1m47.028870781s) [upload=16536]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 01:41:25.627664369 (16h1m47.37172122s) [upload=16536]: Done uploading segments... Aug 8 01:41:25.627684021 (16h1m47.37174087s) [upload=16536]: Upload finished. err: <nil>
Duration: 844.944281ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|