Giving myself a break from coding today so setting up the StyloBot cluster (3 old laptops with Ubuntu Server) it's RIDICULOUS how efficient modern laptops are. *4w*; cloudflare tunnel running on my NAS, 3 old Laptops (all with little 6-8Gb GPUs) - laptops even have little built in uninterruptable power supplies.
Can't use it long term for StyloBot hosting but great for staging. (I need proper non-tunneled connections for TLS termination etc to get THOSE signals).
So with this and smart use of LLM hosting (vLLM / Ollama etc) I can run the likes of lucidRAG (which needs GPUs) for FREE (well energy prices)...
Local LLM FTW!
#localllama