jonimartin

inferbench leveled up: a new Serve mode + MCP server. Keep local LLMs resident and expose them to any MCP client — now with local image generation (sd.cpp) and CSV/JSON benchmark export.

https://jonimartin27.github.io/inferbench

#llm #localai

InferBench — Benchmarkea LLMs locales con un click

Descarga, arranca y benchmarkea motores de inferencia LLM locales con un solo click. Sin tocar la terminal. Tus datos nunca salen de tu máquina. Gratis y open-source.

InferBench
Jun 15 at 10:08amlookspan