I've shut down my Matrix chat server for now. I really haven't used it a lot, and there's all sorts of questions about the security of the secret messaging the service claims to provide.

https://furry.engineer/@soatok/116094123496968392

I haven't _deleted_ the VM, but it's powered off, and monitoring it is disabled.

#AdventuresInSelfHosting

Days since I mistook the system shutdown button for the VM shutdown button in Proxmox: 0 😅

Fortunately, the two nodes on the K3s cluster that I pin to the system restarted normally and the databases recovered fine.

#AdventuresInSelfHosting

Reminder for later

system advanced update kernel_extra_options="ixgbe.allow_unsupported_sfp=1"

or

midclt call system.advanced.update '{"kernel_extra_options":"ixgbe.allow_unsupported_sfp=1"}'

#truenas #adventuresInSelfHosting

After bumping #mastodon server OS to #alpinelinux 3.23, the web server and sidekiq failed to run due to some library version getting upgraded and not found by the gem anymore.

I found someone with a similar issue and saw they were able to re-download all the gems to solve their issue. This worked for me, as well.

Saving this note for later.

#AdventuresInSelfHosting

I’m slowly starting to figure out Kerberos and LDAP integration, LDAP in general and how to setup ACLs in OpenLDAP.

Now if only I could figure out why Apache Directory Studio (just a tool for browsing LDAP) more often than not has issues connecting using encrypted protocols. The native tools work flawlessly.

#AdventuresInSelfHosting

Time to abandon the Broadcom-owned "Bitnami" Helm chart and pgSQL images for CloudNative-PG to the CNCF's own charts and images.

Initial deployment in the test cluster seems positive, but now I want to test if I can remove the operator and CRDs without destroying the running cluster. That will be key before I try this on the prod clusters.

#AdventuresInSelfHosting

I started playing with Kerberos and thus AD, simply because I wanted to be able to mount my nextcloud NFS volume on the server without having it show up as owned "_apt:82" on the NAS. But this has been an extremely frustrating #AdventuresInSelfHosting

- I need to get kdc, openldap and idmap to all work together.
- I figured samba would make that easier.
- Nope, I can't seem to get working krb5 keytabs at the system level to mount the volumes.

Hnng.

Nextcloud decided to stop mounting its NFS datastore yesterday, and kept throwing "mount(2): operation not permitted".

Now this morning I get up to troubleshoot it, and it's decided to just start working.

wtf #AdventuresInSelfHosting

Something went amiss on one of my kubernetes workload nodes, which brought down this instance.

Due to the setup, however, it failed over -automatically!- in a few minutes. I think the downtime was mostly in promoting the secondary PG instances when the primary vanished.

But I didn't have to intervene other than to restart the k3s services on the failed node. I'm not sure what happened, but "Killed" makes me think it hit an unrecoverable OOM condition.

#AdventuresInSelfHosting