I figured out multiarch container images hosted on forgejo.

In this case I cross compile all golang binaries in one job and then use buildah --arch to build container images for different architectures.
This saves a lot of time compared to building the go binaries inside the architecture emulation.

With both images in the manifest, docker/podman pull/run works on amd64 and arm64 with the same image name.

#codeberg #forgejo #buildah #golang #podman #docker

So in short: Running buildah builds for amd64+arm64 on a CephFS RBD backed by an SSD pool sequentially with the OverlayFS driver is faster than running the same build, on CephFS backed by HDDs with the VFS driver, with the arm64 and amd64 builds running in parallel.

#HomeLab #WoodpeckerCI #buildah

Putting the data roots for each buildah container into a separate directory on the shared CephFS volume did work and reduced the overall build time for the FluentD container from 23 minutes to 15 minutes. So the shared dir was part of the problem. But it's still rather slow, and I'm still pretty sure it's because of the VFS driver and CephFS. So let's see whether I can come up with something better.

#HomeLab #Ceph #buildah