The debate about #localai is kinda amusing. On the one hand prudent people that want private, local inference of #opensource #llm be the norm, on the other, "AI" psychos that can no longer imagine life without access to "SOTA"
Running these gargantuan models locally is currently barely possible in high end desktops. But there is vast space of less demanding tools that we could have on #linux and we don't.
For the longest time the only project in this space has been amazing #recoll / #xapian