PasLLM is finally publicly released!

A high-performance LLM inference engine written in pure Object Pascal.

✨ No Python dependencies
🎯 Advanced 4-bit quantization
🖥️ Cross-platform (Delphi & FreePascal)
⚡ Native performance

Supports Llama 3.x, Qwen, Phi-3, Mixtral, DeepSeek R1 & more!

Open source (AGPL 3.0): https://github.com/BeRo1985/pasllm (synced from my private repo on my on server)

#ObjectPascal #Delphi #FreePascal #LLM #AI

GitHub - BeRo1985/pasllm: PasLLM - LLM interference engine in Object Pascal (synced from my private work repository)

PasLLM - LLM interference engine in Object Pascal (synced from my private work repository) - BeRo1985/pasllm

GitHub