Ollama in a container? Yes, it's doable!
https://itsfoss.com/ollama-docker/
Learn to run Ollama in Docker container in this tutorial. Yes, Nvidia GPU can also be used in this setup.