Right-sizes LLM models to your system's RAM, CPU, and GPU
https://github.com/AlexsJones/llmfit
#HackerNews #LLMmodels #RAM #CPU #GPU #optimization
Hundreds of models & providers. One command to find what runs on your hardware. - AlexsJones/llmfit
Hacker News
synlogic4242