vermatercFeb 25

llmfit - find best model that runs on your computer

https://lemmy.ml/post/43700680

llmfit - find best model that runs on your computer - Lemmy

“A terminal tool that right-sizes LLM models to your system’s RAM, CPU, and GPU. Detects your hardware, scores each model across quality, speed, fit, and context dimensions, and tells you which ones will actually run well on your machine.”

Show threadAcklavidianFeb 25
I don’t know about that username tho.
Show threadThePowerOfGeek

Yeah, I didn’t see the ‘s’ at first and imagined the code’s output screamed at you about gay frogs and wokeness if you selected certain LLMs.

Seems like a really good idea though, and I could definitely find this useful.

Feb 25 at 7:27pmWeb