Hi everyone, On 18.03.22 at 17:47 Johannes Kastl wrote:

On 11.03.22 at 08:49 Johannes Kastl wrote:

...

The buildah call still does not work, but now I get another error message...

...

$ buildah bud --arch arm64 . STEP 1/2: FROM registry.access.redhat.com/ubi8:latest STEP 2/2: RUN uname -a error building at STEP "RUN uname -a": error while running runtime: exit status 255 ERRO[0003] exit status 255

I opened both a bugzilla for qemu as well as an issue with buildah upstream. More information on the binfmt thingy would be nice, and a check to see if it is set up properly would be even better.

https://bugzilla.opensuse.org/show_bug.cgi?id=1197298 https://github.com/containers/buildah/issues/3827

The result from the buildah bugreport is that apparently the binaries in the qemu-linux-user package are dynamically linked and thus not working in this scenario. (I cannot verify if that is true, but I believe it is.) An alternative would be to run a privileged container that then registers the binaries: podman run --rm --privileged docker.io/multiarch/qemu-user-static --reset --persistent yes I just tested this on a Tumbleweed VM and could successfully "build" the examples from the podman example. Question to the ones with more knowledge on qemu and related packages: Could we have a subpackage of qemu containing statically linked binaries for this usecase? Or change the existing package to contain statically linked binaries? Or is that already existing in OBS but not in Tumbleweed? Or it is but I did not find it? I don't like the idea of having to run a container with root permissions on each boot of the OS just to register those binfmt thingies. Thanks in advance and have a nice weekend! Johannes -- Johannes Kastl Linux Consultant & Trainer Tel.: +49 (0) 151 2372 5802 Mail: kastl@b1-systems.de B1 Systems GmbH Osterfeldstraße 7 / 85088 Vohburg http://www.b1-systems.de GF: Ralph Dehner Unternehmenssitz: Vohburg / AG: Ingolstadt,HRB 3537

On 3/11/22 08:49, Johannes Kastl wrote:

Good morning,

I asked this on the kubic list already, but we found no solution, hence once again in a broader round:

How to setup binfmt properly so one can build multi-arch containers with buildah/podman or docker buildx? https://podman.io/blogs/2021/10/11/multiarch.html

For 'docker buildx' you can use this, prior to running 'docker buildx' docker run --privileged --rm tonistiigi/binfmt --install arm64

Hi Michael, thanks for your answer! On 19.03.22 at 14:38 Michael Pujos wrote:

For 'docker buildx' you can use this, prior to running 'docker buildx'

docker run --privileged --rm tonistiigi/binfmt --install arm64

That is basically the same as the workaround that upstream recommended to work around the limitations that apparently come from the qemu-linux-user binaries in Tumbleweed (that are "dynamically linked" and this breaks the use case). I do not know how you feel, but I would strongly prefer to have a package from openSUSE, installed via RPM, that does the magic for me, rather than having to run a docker container with root permissions that is modifying my system, each time I need to build a multi-arch image... :-) Kind Regards, Johannes -- Johannes Kastl Linux Consultant & Trainer Tel.: +49 (0) 151 2372 5802 Mail: kastl@b1-systems.de B1 Systems GmbH Osterfeldstraße 7 / 85088 Vohburg http://www.b1-systems.de GF: Ralph Dehner Unternehmenssitz: Vohburg / AG: Ingolstadt,HRB 3537

Hi Cristian, hi all, On 19.03.22 at 15:30 Johannes Kastl wrote: [ binaries usable for multi-arch containers] Sorry if my last comment came off rude, that was not intended. And I'll have to eat my words anyway. The binaries are already statically linked. In the meantime the other bugreport, the openSUSE one, got a reply from Fabian stating that while the binaries are already statically linked, there is a downstream patch that introduces a regression. https://bugzilla.opensuse.org/show_bug.cgi?id=1197298 So it looks like we have some progress on this. Have a nice weekend, everyone! Johannes -- Johannes Kastl Linux Consultant & Trainer Tel.: +49 (0) 151 2372 5802 Mail: kastl@b1-systems.de B1 Systems GmbH Osterfeldstraße 7 / 85088 Vohburg http://www.b1-systems.de GF: Ralph Dehner Unternehmenssitz: Vohburg / AG: Ingolstadt,HRB 3537

On Sat, 2022-03-19 at 15:34 +0100, Johannes Kastl wrote:

I do not know how you feel, but I would strongly prefer to have a package from openSUSE, installed via RPM, that does the magic for me, rather than having to run a docker container with root permissions that is modifying my system, each time I need to build a multi-arch image... :-)

On Factory or SLE15-SP4 beta, you should be able to obtain the desired effect by running qemu-binfmt-conf.sh with '--qemu-suffix ""': qemu-binfmt-conf.sh --systemd $ARCH --persistent yes --qemu-suffix "" Regards Martin

On Sun, Mar 20, 2022 at 4:24 AM John Paul Adrian Glaubitz wrote:

Debian has been shipping statically linked qemu-user binaries for quite a while now to be used within a chroot.

As long as it doesn't end calling nss then it will work. otherwise bets are off.