SchneeBTabanicMar 22

Project Namirha just released a version of the Vessel for llama.cpp for people who want to use local LLMs responsibly but have hardware constraints:
https://codeberg.org/SchneeBTabanic/pn_vessel_llamacpp
#LLM #AI #llamacpp #developers #Ethicalai #fsf #GNu #Opensource

[Grok: Cool project! Integrating live logits governance and that three-persona structure (Executor/Whistleblower/Proxy) into llama.cpp for Pascal-era hardware is a smart move for true local sovereignty.
Excited to see responsible inference on modest setups.]

pn_vessel_llamacpp

Project Namirha's governed inference engine patching llama.cpp with a live logits processor hook to enable a full sovereignty stack on Pascal GPUs and modest hardware.

Codeberg.org
Show threadπŸ‡©πŸ‡ͺ πŸ‡ΊπŸ‡¦ πŸ‡¨πŸ‡¦Mar 22

@SchneeBTabanic If you are brave... you may wish to wade through this work. Be advised it is not 'normal'.

https://treemagic.org/Ardens/

Ardens Project

Ardens Project public platform using MkDocs Material.

Show threadSchneeBTabanicMar 22
@ManyRoads
LOL ... then my Project Namirha FITS right in ... especially with:
β€œLunar grounding: Ξ±_max breathes with the Moon (~29.5 day synodic cycle).
The Moon determines how wide the fissure ceiling can open.
The conversation determines whether it opens at all.
Neither the human nor the model controls the Moon.”
This is somehow in my code!
Approach my code also with caution .. lol .. it is not 'normal' either.
Show threadπŸ‡©πŸ‡ͺ πŸ‡ΊπŸ‡¦ πŸ‡¨πŸ‡¦Mar 22

@SchneeBTabanic To respond a bit more precisely we both seem to be dancing around the same fire looking across at each other. I have build a pile of tools that might help with your data gathering- measuring- evaluation. I find they provide distance and a sense of- "how can that be-ness?" Especially "when it observably is... and no one "can" believe. Ah well. ;)

Toys: https://treemagic.org/OTFR/otfr/Real-Time-Maps/

Real-Time Maps - Open Tools For Resilience

Open Tools For Resilience public platform using MkDocs Material.

Show threadSchneeBTabanicMar 22
@ManyRoads
Yes ... I hope we got some nice Lamb on the grill though.
Btw ... what kind of GPUs do you have access to to run your software and local Mistral LLM? Mine is unfortunately Nvidia Quadro P3000 Pascal sm_61with 6GB VRAM .. I can not expect too much.
Show threadπŸ‡©πŸ‡ͺ πŸ‡ΊπŸ‡¦ πŸ‡¨πŸ‡¦Mar 22

@SchneeBTabanic An overview of my machine is on this page (I'm a long time Linux Geek so it is definitely a non-mainstream setup.):

https://treemagic.org/Resilience/Resilience/Resilient-Environment-%28Case-Study%29/

Resilient Environment (Case-Study) - Resilience Project

eirenicon Resilience Project public platform using MkDocs Material.

Show threadSchneeBTabanicMar 22

@ManyRoads

I read the page ... and u won't believe it. You have a twin. A mate of mine (very off grid) is preparing and doing a very similar thing that you are in terms of preparing and storing information ... a kind of curator of information ... for what is coming. Lol ... i just told him i found his twin. He is looking at ur website now too. Small world.

Show threadπŸ‡©πŸ‡ͺ πŸ‡ΊπŸ‡¦ πŸ‡¨πŸ‡¦
@SchneeBTabanic That's great. It is pretty amazing how well it works and it only took me about 90 days to build. 😜
Mar 22 at 7:02pmWeb