Luigi 💚Jul 11, 2023
Hello #homelab and #selfhosted community! I want some basic orchestration for my homelab and in another toot some users told me they`re using #nomad.
How are you using nomad? My idea was using a single VM for server + client agent, but there's minimum resources about this deployment, I don't need enterprise high availibity as I'm running a homelab, but maybe I can run a VM for host and another for agent? So I have better allocated resources?
Show threadItzTrainJul 11, 2023
@luigi @mmeier is a nomad user in #homelab! He's a great resource to ask!!
Show threadLuigi 💚Jul 11, 2023
@train @mmeier Thanks for tagging him! Hope to hear about how nomad is used by you @mmeier
Show threadMichael

@luigi @train I've had Nomad running in two different configurations. The first one was what you describe, having one VM for the server agent (I used the same VM for Consul and Vault agents too), and then several additional VMs, each as a Nomad worker with a client agent.

Today, I'm running my Homelab (mostly) on a fleet of 13 Raspberry Pi's, including both the server and client agents for Nomad.

Jul 11, 2023 at 5:11pmWeb
Show threadMichaelJul 11, 2023

@luigi @train But this is not necessary. I do it because I want high availability, mostly so that I can easily update each host, without having to take down the entire Homelab.

But Nomad has actually improved a lot recently for more resource-constgrained envs. Clients can now survive for a bit when there's no server reachable. And, more importantly, you can now run Nomad agents in both server and client mode at the same time, which is now officially supported.

2/3

Show threadMichaelJul 11, 2023

@luigi @train But, I must admit that I never did so. I initially planned to, to end up with three server agents, but I found enough other things to run on three "control plane" Pis that I decided to dedicate three Pis to the Control plane.

So now I have three Nomad server agents, and eight workers in my cluster.

But it also ran perfectly fine back when I only had one VM with the server, and one with the client agent.

If you want to keep it simple, I'd advise to just try the combined deploy.

Show threadLuigi 💚Jul 12, 2023
@mmeier @train thanks very much, helped me a lot and based on your experience and tips I'll start to install and migrate my services to nomad at my next free time :) I don't know if I'll keep this idea but with the server/client agent at same server thing, I'll try to get a hybrid of simplicity and high availability for fun using one small VM for server (maybe consul and vault aswell?) And one VM for server/agent where my services will stand.
Show threadMichaelJul 12, 2023

@luigi @train I'd recommend trying Consul and Vault as well! I found both pretty useful.

Although these days, you don't necessarily need them, as Nomad now has both secrets and service discovery build-in, which it didn't have when I set up my Homelab cluster.

Show threadLuigi 💚Jul 12, 2023
@mmeier @train I've already use vault in my work and it's pretty useful. I'm thinking on adding as well, about Consul from what I see I don't know If really is needed but I will try to implement as well just for fun :D yolo