Ben Hardill6d ago

Wet, windy Saturday, perfect day to try and upgrade my microk8s cluster, but it appears that I can't get my new Ubuntu 26.04 node to join my old 1.24 cluster at 1.25 because it can't find the yaml python module.

I thought the point of a snap was that all the dependencies were bundled in?

#k8s #kubernetes #microk8s

Show threadBen Hardill6d ago
Ahhh, this might be the bloody rust version of sudo...
Show threadBen Hardill6d ago
Yep, forcing it back to a sensible version of a core utility works...
Show threadBen Hardill6d ago
And I now technically have a "HA" cluster so should be able to start taking other nodes down to upgrade them
Show threadAnton Piatek6d ago
@ben every now and again I wonder if I should put in the effort to make on out of the 3 pi 4's I have. But then both unifi and homeassistant are pushing full os installs really hard rather than containers, so not sure if it's worth even starting...
Show threadBen Hardill6d ago

@sldrant My excuse is I use it for testing work stuff,

But it also runs:

- Mastodon
- Forgejo
- Influx
- Roundcube
- Grafana
- S3 server
- LibreTranslate
- Keycloak

On 2 8g Pi4 and 2 16g N150s.

I'm adding a 8g Pi 5 to make the upgrade easier

Show threadAnton Piatek6d ago
@ben have you got a write up of the setup? I'd love to know a bit more as I dip a toe in
Show threadBen Hardill6d ago

@sldrant A very old one (but also some of these choices are why really need to do an upgrade...)

https://blog.hardill.me.uk/2022/06/19/home-microk8s-cluster/

Home MicroK8s Cluster

I started to write about my home test environment for FlowForge a while ago, having just had to rebuild my K8s cluster due to a node failure I thought I should come back to this and document how I …

Ben's Place
Show threadAnton Piatek6d ago
@ben thanks! How's the NAS/NFS? I've been unable to decide if I do local ssd's on the pi's or use my Intel box as nfs. I did have more on pi's but then moved to a more capable lenovo mini pc, but wondering about going back to pi's for core services for more HA
Show threadBen Hardill

@sldrant NFS works well for volumes most things, but the S3 server wanted a more "real" file system so these days I mount iSCSI or NVMEoTCP volumes from a different NAS as well asl NFS.

But the Pi 4s all have USB HDs for the OS to prevent SD card wear and the Pi5 has a NVMe for local storage.

Jun 6 at 4:54pmWeb
Show threadBen Hardill6d ago
@sldrant I also iSCSI network boot a couple of appliance Pis so I don't have to worry about SD cards failing
Show threadBen Hardill6d ago

@sldrant Also don't use the CSI driver in that post, use democratic-csi as it is much better and supports way more storage backends.

https://github.com/democratic-csi/democratic-csi

GitHub - democratic-csi/democratic-csi: csi storage for container orchestration systems

csi storage for container orchestration systems. Contribute to democratic-csi/democratic-csi development by creating an account on GitHub.

GitHub