Issues with openSUSE images and ignition: either firstboot assistant or crash on boot?
Hi all, I can write up the details on Friday, but has anyone use the MicroOS or Leap Micro images successfully in libvirt using ignition? No matter what I tried, I either end up in the firstboot assistant (asking to set a root password etc., as no ignition config was found) or the boot ends with a crash due to ignition devices not being found. I am using virt-install with something like the following: --qemu-commandline="-fw_cfg name=opt/com.coreos/config,file=/path/to/config.ign" I tried some of the examples from this page, to rule out errors in my config, but those also fail. https://en.opensuse.org/Kubic:MicroOS/Ignition The virt-install works fine when installing e.g. Fedora CoreOS or flatcarlinux (using opt/org.flatcar-linux instead of opt/com.coreos), so in general this should do the right thing. I found lots of old bugs, some sounded similar, but I doubt this is broken since 2021 without anyone noticing... Kind Regards, Johannes
Hello Johannes, yes with usb redirection on I did make some Leap Micro / virt-manager demos with ignition on youtube. This will not work with the gnome-boxes flatpak version ... Lubos On Wed, May 8, 2024 at 8:46 PM Johannes Kastl <mail@johannes-kastl.de> wrote:
Hi all,
I can write up the details on Friday, but has anyone use the MicroOS or Leap Micro images successfully in libvirt using ignition?
No matter what I tried, I either end up in the firstboot assistant (asking to set a root password etc., as no ignition config was found) or the boot ends with a crash due to ignition devices not being found.
I am using virt-install with something like the following:
--qemu-commandline="-fw_cfg name=opt/com.coreos/config,file=/path/to/config.ign"
I tried some of the examples from this page, to rule out errors in my config, but those also fail. https://en.opensuse.org/Kubic:MicroOS/Ignition
The virt-install works fine when installing e.g. Fedora CoreOS or flatcarlinux (using opt/org.flatcar-linux instead of opt/com.coreos), so in general this should do the right thing.
I found lots of old bugs, some sounded similar, but I doubt this is broken since 2021 without anyone noticing...
Kind Regards, Johannes
-- Best regards Luboš Kocman openSUSE Leap Release Manager
Hi Lubos, On 09.05.24 13:37 Lubos Kocman via openSUSE Factory wrote:
yes with usb redirection on I did make some Leap Micro / virt-manager demos with ignition on youtube.
I know, you mean like this one? https://yt.artemislena.eu/watch?v=j8kWT7HSjbw I also used this successfully in the past (Micro 5.2 or something), I was just asking for confirmation if it is **currently** broken. I found one bug that sounds suspiciously like my problems, but in my case it errors out even without touching things in /etc. https://bugzilla.opensuse.org/show_bug.cgi?id=1222202 Kind Regards, Johannes
Correct. To be honest most ignition/combustion demos were originally with 5.2. So you might be right! LeapMicro 5.5 had mostly demos focused on containers/cockpit. I recall we did play with combustion with SUSE IT on Leap 15.4 https://build.opensuse.org/projects/isv:SUSE:suse-it-infra/packages/livecd-o... which is similar timing (around Micro 5.2 / 5.3). And then when fuel-ignition was introduced (the online ignition generator). Lubos On Thu, May 9, 2024 at 4:26 PM Johannes Kastl <mail@johannes-kastl.de> wrote:
Hi Lubos,
On 09.05.24 13:37 Lubos Kocman via openSUSE Factory wrote:
yes with usb redirection on I did make some Leap Micro / virt-manager demos with ignition on youtube.
I know, you mean like this one?
https://yt.artemislena.eu/watch?v=j8kWT7HSjbw
I also used this successfully in the past (Micro 5.2 or something), I was just asking for confirmation if it is **currently** broken.
I found one bug that sounds suspiciously like my problems, but in my case it errors out even without touching things in /etc.
https://bugzilla.opensuse.org/show_bug.cgi?id=1222202
Kind Regards, Johannes
-- Best regards Luboš Kocman openSUSE Leap Release Manager
Hi, Am Mittwoch, 8. Mai 2024, 20:46:00 MESZ schrieb Johannes Kastl:
Hi all,
I can write up the details on Friday, but has anyone use the MicroOS or Leap Micro images successfully in libvirt using ignition?
No matter what I tried, I either end up in the firstboot assistant (asking to set a root password etc., as no ignition config was found) or the boot ends with a crash due to ignition devices not being found.
More details would be nice. Using fw_cfg with ignition and combustion works fine for me on MicroOS. Cheers, Fabian
I am using virt-install with something like the following:
--qemu-commandline="-fw_cfg name=opt/com.coreos/config,file=/path/to/config.ign"
I tried some of the examples from this page, to rule out errors in my config, but those also fail. https://en.opensuse.org/Kubic:MicroOS/Ignition
The virt-install works fine when installing e.g. Fedora CoreOS or flatcarlinux (using opt/org.flatcar-linux instead of opt/com.coreos), so in general this should do the right thing.
I found lots of old bugs, some sounded similar, but I doubt this is broken since 2021 without anyone noticing...
Kind Regards, Johannes
Hi Fabian, On 10.05.24 15:03 Fabian Vogt wrote:
More details would be nice.
I can try to get the exact error message for the "crash" when not finding the combustion device. This bug sounds familiar, but even without modifying files in /etc I always get either the JeOS firstboot wizard or the "crash". https://bugzilla.opensuse.org/show_bug.cgi?id=1222202
Using fw_cfg with ignition and combustion works fine for me on MicroOS.
On libvirt? How are you installing? virt-install? With an existing disk or via ISO? Could you share your ignition file (redacted, of course)? (offlist would be ok) Kind Regards, Johannes
On 10.05.24 15:14 Johannes Kastl wrote:
I can try to get the exact error message for the "crash" when not finding the combustion device.
OK, I did some more debugging. I end up in a emergency-style shell, as the device with the "ignition" label could not be found. I checked the sosreport thingy and found some lines with "loading QEMU firmware config module. The next couple of lines are roughly (can't copy, for some reason...): parsing config with SHA512... fetched base config firom "system" fetched user config from "qemu" fetch-offline: fetch-offline passed Ignition finished successfully FInished Ignition (fetch-offline) ... combustion[623]: No config source found ... But then some lines below, my ignition file is shown. So it **was** found after all. Apparently there is an issue with creating/modifying the user. Using an ignition file that only modifies the root user (passwordHash and sshAuthorizedKeys) spits out warnings due to ignition and combustion devices not being found, but after a loooooong boot shows a screen where I can successfully log in. I'll check, why the user modification/creation fails. Kind Regards, Johannes For the records, this was the original file that threw the errors: { "ignition": { "version": "3.1.0" }, "passwd": { "users": [ { "name": "opensuse", "sshAuthorizedKeys": [ "ssh-ed25519 ..." ] } ] } }
Hi all, On 10.05.24 18:40 Johannes Kastl wrote:
I'll check, why the user modification/creation fails.
I can install openSUSE Leap Micro 5.5, 6.0a and MicroOS successfully, if I do not create/modify users other than root. As soon as I create an unprivileged user, the boot process is aborted due to errors. The only error I can find in the logs is that the creation of the user's home directory fails. Unfortunately there are no more details on why this fails... Kind Regards, Johannes
Hi, Am Freitag, 10. Mai 2024, 21:23:05 MESZ schrieb Johannes Kastl:
Hi all,
On 10.05.24 18:40 Johannes Kastl wrote:
I'll check, why the user modification/creation fails.
I can install openSUSE Leap Micro 5.5, 6.0a and MicroOS successfully, if I do not create/modify users other than root.
As soon as I create an unprivileged user, the boot process is aborted due to errors.
The only error I can find in the logs is that the creation of the user's home directory fails. Unfortunately there are no more details on why this fails...
That means you did not include /home in the ignition config. See https://en.opensuse.org/Portal:MicroOS/Ignition#Create_new_users Unfortunately ignition requires it to be done that way, while with combustion you can just do "mount /home". Cheers, Fabian
Kind Regards, Johannes
Hi Fabian, On 13.05.24 09:38 Fabian Vogt wrote:
The only error I can find in the logs is that the creation of the user's home directory fails. Unfortunately there are no more details on why this fails...
That means you did not include /home in the ignition config. See https://en.opensuse.org/Portal:MicroOS/Ignition#Create_new_users
Thanks for the hint, that solved the issue. I'll add a reminder to adjust the wiki page (or maybe just read it thoroughly once again), to make sure the next user does not fall into the same trap as me... Have a nice week! Kind Regards, Johannes
participants (3)
-
Fabian Vogt
-
Johannes Kastl
-
Lubos Kocman