cerebrix#HomeLab, #SelfHosting, #DevOps, #LLM, #AtProto
So if you happened to have an extra M1 8gb Mac mini, would you install a small LLM (and which one would you use) or would you host your own AtProto PDS with it?
lapt0r@cerebrix most of the good models are at least 14gb - if that doesn't fit in RAM or VRAM (preferably) not worth