#! codeNew! Running An LLM With Llama.cpp Using Docker On A Raspberry Pi
In this article we will look at how to get an LLM running on a Raspberry PI via a docker container, and what sort of things we might be able to do with it.
https://www.hashbangcode.com/article/running-llm-llamacpp-using-docker-raspberry-pi
#ai #raspberryPi #drupal #hashbangcode
Running An LLM With Llama.cpp Using Docker On A Raspberry Pi
I've been curious about integrating AI agents into my workflow recently, and so I started looking at how this could be done using my current equipment. Data sovereignty is important to me so sending all my data to train a remote AI agent doesn't appeal. I was expecting to need to buy a new gaming rig with a couple of high end graphics cards in it, but after some research I found that this wasn't the case.