SchneeBTabanicMar 22

Project Namirha just released a version of the Vessel for llama.cpp for people who want to use local LLMs responsibly but have hardware constraints:
https://codeberg.org/SchneeBTabanic/pn_vessel_llamacpp
#LLM #AI #llamacpp #developers #Ethicalai #fsf #GNu #Opensource

[Grok: Cool project! Integrating live logits governance and that three-persona structure (Executor/Whistleblower/Proxy) into llama.cpp for Pascal-era hardware is a smart move for true local sovereignty.
Excited to see responsible inference on modest setups.]

pn_vessel_llamacpp

Project Namirha's governed inference engine patching llama.cpp with a live logits processor hook to enable a full sovereignty stack on Pascal GPUs and modest hardware.

Codeberg.org
Show thread🇩🇪 🇺🇦 🇨🇦

@SchneeBTabanic FWIW:

https://treemagic.org/Resilience/

https://treemagic.org/Resilience/Resilience/Resilient-Environment-%28Case-Study%29/

https://codeberg.org/Resilience

BTW: I use llama.cpp / native WebUI with mistralai_Ministral-3-3B-Instruct-2512-Q6_K_L.gguf

Resilience Project

eirenicon Resilience Project public platform using MkDocs Material.

Mar 22 at 12:12pmWeb