Federico Viticci 3d ago

Not sure who's going to find this useful given the model's...shall we say, "constraints"… but here's a CLI to use Apple Intelligence's Foundation on-device model from the shell:

https://apfel.franzai.com/

apfel - Free AI on Your Mac

Use Apple's built-in AI from the terminal. No API keys, no cloud, no subscriptions. The LLM is already on your Mac.

apfel
Show threadLars 2d ago

@viticci This is actually pretty amazing.

1. brew install Arthur-Ficial/tap/apfel
2. brew install --cask macai
3. apfel --serve
4. Run the macai app and configure as shown in the screenshot (URL is http://127.0.0.1:11434/v1/chat/completions)

Boom, you have a fully local, offline, private, and environmental-friendly chatbot app for basic tasks at zero cost.

Show threadRafi Saar1d ago
@lonzo @viticci Thanks!
May I suggest to run step 3 in the background so the terminal isn’t locked:
3. apfel —serve &
And maybe also make sure it runs again at every reboot of the Mac?
Show threadLars 
@rsaar @viticci Yeah makes sense, I just wanted to outline the steps to get started ✌️
Apr 6 at 7:59amIvory for iOS