K. Ryabitsev-Prime 🍁If an LLM is used for military purposes, then the datacenters hosting the LLM become legitimate military targets.
ale canque@monsieuricon that's why we need small federated, street or neighbourhood level appropriate civic tech data nodes rather than big commercial data centres. They could still access citizen data for a fee and if the data owners agree..
Peter B.@alecanque @monsieuricon I'd invite #digital #longterm #preservation and #GLAM institutions to take this on 😄
At a recent professional convention, I hosted a workshop on local LLMs for in-house training:
Imagine #GLAM with #publicmoneypubliccode offers those "local" nodes and services to people.
#ZFS + #Nextcloud + #Ollama + #OpenWebUI, etc: Setup by (#ansible) #pianoRollHowtos and "apt install ..."
@p3ter @monsieuricon absolutely, with exo and llamafile you could efficiently share resources across well connected mid or low end devices. Really good for data/tech sovereignty, privacy and availability even if the wider internet is cut off
@alecanque @monsieuricon It would make perfect sense to build that up together with schools and unis: so kids and local providers can learn and work on-site.
We know how internet-stuff works, and giving resources to #foss makes sense IMO.