MacBook M5 Pro and Qwen3.5 = Local AI Security System

https://www.sharpai.org/benchmark/

HomeSec-Bench — Local AI vs Cloud Benchmark | SharpAI Aegis

Qwen3.5-9B scores 93.8% on 96 real security AI tests — within 4 points of GPT-5.4 — running entirely on Apple Silicon. Full benchmark results and methodology.

Currently the barrier to entry for local models is about $2500. Funny thing is $2500 is about the amount my parents paid for a 166 MHZ machine in 1995.
Entry level is actually MAC MINI 16GB at <$499, I have models running on M2 MINI 16GB, it's working with small models.
If "small models" is the bar, then you can run inference for ~$50 on Raspberry Pi like hardware. I do that with 1.8b-4b models.
LFM 450M for vision task, QWEN 9B Q4 for Orchestration, this provides a good result.