New fun experience with #azure #aks.
Suddenly #xfs #mount of a new #pvc in a pod does not work anymore.

dmesg output:

[42449.910213] XFS (sdb): Superblock has unknown incompatible features (0x20) enabled.
[42449.910217] XFS (sdb): Filesystem cannot be safely mounted by this kernel.
[42449.910228] XFS (sdb): SB validate failed with error -22.

recreating the filesystem with "mkfs.xfs -f" on the #k8s #node does the trick but #wtf ?!

#Azure disk #snapshots, directly taken in #aks clusters, are broken for weeks now.

Sometimes it works in a cluster and sometimes not.

We now have to do disk snapshots via azure #api directly, which still works.

What else can be the problem, but the #csi driver part, which is manged by azure?

Nobody at azure #support cares or understands the problem.

#AzureClownComputing together with the #AzureSupportComedyClub makes my day! 🤦

Sent my 6 years old #Google #Pixel3 in, when buying the #Pixel9 Pro in the Google store, and still got 224€ for it!

The battery lasted about 30 minutes and the backside was quite scratched :D

Thanks! :)

Building #docker containers in 2024. How not to do it:

- use #supervisord
- use multiple processes
- use multiple users
- use sudo
- write logs to the containers filessystem
- make the imagesize as big as possible (~1.8GB)

After you have done all that just call your container #terraform #enterprise and release it.

What a pile of shit! Great job #hashicorp

#wtf #omg #k8s

#Azure disk snapshot completion in percent can be "0.0" or "100.0" 🙄

Why not just make it competed = true/false? 🤷

https://github.com/kubernetes-sigs/azuredisk-csi-driver/blob/master/pkg/azuredisk/azuredisk.go#L500-L518

Coming back from vacation and there is the next #Azure disaster 😭

Changing the storageclasses of our #kubernetes #pvcs to the new #PremiumV2 one means that #pvc #snapshots are taking 10 min now, instead of 3 sec as with the old storageclass, resulting in #velero #backups to fail (global timeout).

This even happens with #Azures managed backups which also use #Velero in the background 🤦

As always #azure support is no help too :(

#wtf #fml #k8s

Don't use #EntraId login for #kubectl on #Azure #aks or you add a delay of several seconds to to your cli commands.

This sucks big time. Especialy as it is non deterministic.

You'll also see erros like this regulary: "E0815 18:55:51.093416 962504 memcache.go:265] couldn't get current server API group list: the server has asked for the client to provide credentials"

#wtf