[opensuse-arm] Local ARM JeOS image build fails (kiwi problem?)

older
[opensuse-arm] armv5 build broken?

Guillaume Gardet

28 Feb 2013 28 Feb '13

15:20

Hi, I tried to rebuild factory JeOS-beagle image as usual with : osc build images armv7l JeOS-beagle.kiwi But I get this problem of "$pdev uninitialized" and it increase disk size by 10M and loops again: ******************************************************************* [ 9534s] Feb-28 15:13:32 <1> : Increasing disk size by 10M to: 2011M [ 9534s] . [ 9534s] Feb-28 15:13:32 <1> : EXEC [qemu-img create /usr/src/packages/KIWI-oem/oem/openSUSE-Factory-ARM-JeOS-beagle.armv7l-1.12.1.raw 2011M 2>&1] [ 9534s] Feb-28 15:13:32 <1> : EXEC [/sbin/losetup -f --show /usr/src/packages/KIWI-oem/oem/openSUSE-Factory-ARM-JeOS-beagle.armv7l-1.12.1.raw 2>&1] [ 9534s] Feb-28 15:13:32 <1> : EXEC [bash -c "PATH=$PATH:/sbin which parted" 2>&1] [ 9534s] Feb-28 15:13:32 <1> : EXEC [bash -c "PATH=$PATH:/sbin which parted" 2>&1] [ 9534s] Feb-28 15:13:32 <1> : EXEC [dd if=/dev/zero of=/dev/loop0 bs=512 count=1 2>&1] [ 9534s] Feb-28 15:13:32 <1> : EXEC [/usr/sbin/parted -s /dev/loop0 mklabel msdos 2>&1] [ 9535s] Feb-28 15:13:33 <1> : EXEC [/usr/sbin/parted -m /dev/loop0 unit s print | head -n 3 | tail -n 1 | cut -f2 -d:] [ 9535s] Feb-28 15:13:33 <1> : Disk Sector count is: 4118527 [ 9535s] Feb-28 15:13:33 <1> : PARTED input: /dev/loop0 [mkpart primary 2048 411655] [ 9535s] Feb-28 15:13:33 <1> : EXEC [/usr/sbin/parted -s /dev/loop0 unit s mkpart primary 2048 411655 2>&1] [ 9536s] Feb-28 15:13:34 <1> : EXEC [bash -c "PATH=$PATH:/sbin which parted" 2>&1] [ 9536s] Feb-28 15:13:34 <1> : EXEC [/usr/sbin/parted -m /dev/loop0 unit s print | grep :2048 | cut -f3 -d:] [ 9536s] Feb-28 15:13:34 <1> : PARTED input: /dev/loop0 [mkpart primary 411656 4118527] [ 9536s] Feb-28 15:13:34 <1> : EXEC [/usr/sbin/parted -s /dev/loop0 unit s mkpart primary 411656 4118527 2>&1] [ 9537s] Feb-28 15:13:34 <1> : PARTED input: /dev/loop0 [set 1 type 0x83] [ 9537s] Feb-28 15:13:34 <1> : EXEC [/usr/sbin/parted -s /dev/loop0 unit s set 1 type 0x83 2>&1] [ 9537s] Feb-28 15:13:35 <1> : PARTED input: /dev/loop0 [set 2 type 0x83] [ 9537s] Feb-28 15:13:35 <1> : EXEC [/usr/sbin/parted -s /dev/loop0 unit s set 2 type 0x83 2>&1] [ 9537s] Feb-28 15:13:35 <1> : PARTED input: /dev/loop0 [set 1 boot on] [ 9537s] Feb-28 15:13:35 <1> : EXEC [/usr/sbin/parted -s /dev/loop0 unit s set 1 boot on 2>&1] [ 9537s] Feb-28 15:13:35 <1> : EXEC [/sbin/kpartx -a /dev/loop0 2>&1] [ 9537s] Use of uninitialized value $pdev in concatenation (.) or string at /usr/share/kiwi/modules/KIWIBoot.pm line 5872. [ 9537s] Feb-28 15:13:35 <1> : EXEC [blockdev --getsize64 2>&1] [ 9538s] Feb-28 15:13:36 <1> : EXEC [sync] [ 9539s] Feb-28 15:13:37 <1> : EXEC [sync] [ 9539s] Feb-28 15:13:37 <1> : EXEC [kpartx -d /dev/loop0 2>&1] [ 9539s] Feb-28 15:13:37 <1> : EXEC [losetup -d /dev/loop0 2>&1] [ 9539s] Feb-28 15:13:37 <1> : Increasing disk size by 10M to: 2021M [ 9539s] . ******************************************************************* Seems a kiwi problem to me. Anybody has this error too? Any idea to solve this? Guillaume -- To unsubscribe, e-mail: opensuse-arm+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-arm+owner@opensuse.org

Show replies by date

Marcus Schäfer

28 Feb 28 Feb

15:28

New subject: [opensuse-arm] Re: Local ARM JeOS image build fails (kiwi problem?)

Hi,

...

I tried to rebuild factory JeOS-beagle image as usual with : osc build images armv7l JeOS-beagle.kiwi

But I get this problem of "$pdev uninitialized" and it increase disk size by 10M and loops again:

which kiwi version is used here ? I will test a build on my panda board with the latest release Regards, Marcus -- Public Key available gpg --keyserver pgp.mit.edu --recv-keys 0xCCE3C6A2 ------------------------------------------------------- Marcus Schäfer (Res. & Dev.) SUSE LINUX Products GmbH Tel: 0911-740 53 0 Maxfeldstrasse 5 FAX: 0911-740 53 479 D-90409 Nürnberg GF: Jeff Hawn,Jennifer Guild, Felix Imendörffer HRB: 21284 (AG Nürnberg) Germany http://www.suse.de ------------------------------------------------------- -- To unsubscribe, e-mail: opensuse-arm+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-arm+owner@opensuse.org

Marcus Schäfer

15:46

New subject: [opensuse-arm] Re: Local ARM JeOS image build fails (kiwi problem?)

Hi,

...

...
I tried to rebuild factory JeOS-beagle image as usual with : osc build images armv7l JeOS-beagle.kiwi

But I get this problem of "$pdev uninitialized" and it increase disk size by 10M and loops again:

which kiwi version is used here ? I will test a build on my panda board with the latest release

my build finished successfully Regards Marcus -- Public Key available gpg --keyserver pgp.mit.edu --recv-keys 0xCCE3C6A2 ------------------------------------------------------- Marcus Schäfer (Res. & Dev.) SUSE LINUX Products GmbH Tel: 0911-740 53 0 Maxfeldstrasse 5 FAX: 0911-740 53 479 D-90409 Nürnberg GF: Jeff Hawn,Jennifer Guild, Felix Imendörffer HRB: 21284 (AG Nürnberg) Germany http://www.suse.de ------------------------------------------------------- -- To unsubscribe, e-mail: opensuse-arm+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-arm+owner@opensuse.org

Guillaume Gardet

16:17

New subject: [opensuse-arm] Re: Local ARM JeOS image build fails (kiwi problem?)

Le 28/02/2013 16:46, Marcus Schäfer a écrit :

...

Hi,

...
...
I tried to rebuild factory JeOS-beagle image as usual with : osc build images armv7l JeOS-beagle.kiwi

But I get this problem of "$pdev uninitialized" and it increase disk size by 10M and loops again: which kiwi version is used here ? I will test a build on my panda board with the latest release my build finished successfully

I tried 12.2 successfully with kiwi 5.04.21, and Factory fails with kiwi 5.04.53. My host is not native ARM but x86_64. Guillaume

...

Regards Marcus

-- To unsubscribe, e-mail: opensuse-arm+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-arm+owner@opensuse.org

Alexander Graf

16:20

New subject: [opensuse-arm] Re: Local ARM JeOS image build fails (kiwi problem?)

On 28.02.2013, at 17:17, Guillaume Gardet wrote:

...

Le 28/02/2013 16:46, Marcus Schäfer a écrit :

...
Hi,

...
...
I tried to rebuild factory JeOS-beagle image as usual with : osc build images armv7l JeOS-beagle.kiwi

But I get this problem of "$pdev uninitialized" and it increase disk size by 10M and loops again: which kiwi version is used here ? I will test a build on my panda board with the latest release my build finished successfully

I tried 12.2 successfully with kiwi 5.04.21, and Factory fails with kiwi 5.04.53. My host is not native ARM but x86_64.

I think I've seen this one before. It's probably a bug in my loop detection ioctl emulation. Could you please make sure that /dev/loop0 is free to use? Alex -- To unsubscribe, e-mail: opensuse-arm+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-arm+owner@opensuse.org

Guillaume Gardet

16:23

New subject: [opensuse-arm] Re: Local ARM JeOS image build fails (kiwi problem?)

Le 28/02/2013 17:20, Alexander Graf a écrit :

...

On 28.02.2013, at 17:17, Guillaume Gardet wrote:

...
Le 28/02/2013 16:46, Marcus Schäfer a écrit :

...
Hi,

...
...
I tried to rebuild factory JeOS-beagle image as usual with : osc build images armv7l JeOS-beagle.kiwi

But I get this problem of "$pdev uninitialized" and it increase disk size by 10M and loops again: which kiwi version is used here ? I will test a build on my panda board with the latest release my build finished successfully I tried 12.2 successfully with kiwi 5.04.21, and Factory fails with kiwi 5.04.53. My host is not native ARM but x86_64. I think I've seen this one before. It's probably a bug in my loop detection ioctl emulation. Could you please make sure that /dev/loop0 is free to use?

Yes, /dev/loop0 is free. Guillaume

...

Alex

-- To unsubscribe, e-mail: opensuse-arm+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-arm+owner@opensuse.org

Marcus Schäfer

1 Mar 1 Mar

09:14

New subject: [opensuse-arm] Re: Local ARM JeOS image build fails (kiwi problem?)

Hi,

...

...
I tried 12.2 successfully with kiwi 5.04.21, and Factory fails with kiwi 5.04.53. My host is not native ARM but x86_64.

I have tested only on real hardware with 12.2 and the latest (12.3) version of kiwi. I will try to reproduce this with osc and factory Regards, Marcus -- Public Key available gpg --keyserver pgp.mit.edu --recv-keys 0xCCE3C6A2 ------------------------------------------------------- Marcus Schäfer (Res. & Dev.) SUSE LINUX Products GmbH Tel: 0911-740 53 0 Maxfeldstrasse 5 FAX: 0911-740 53 479 D-90409 Nürnberg GF: Jeff Hawn,Jennifer Guild, Felix Imendörffer HRB: 21284 (AG Nürnberg) Germany http://www.suse.de ------------------------------------------------------- -- To unsubscribe, e-mail: opensuse-arm+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-arm+owner@opensuse.org

Dirk Müller

09:17

New subject: [opensuse-arm] Re: Local ARM JeOS image build fails (kiwi problem?)

2013/3/1 Marcus Schäfer :

...

...
...
I tried 12.2 successfully with kiwi 5.04.21, and Factory fails with kiwi 5.04.53. My host is not native ARM but x86_64. I have tested only on real hardware with 12.2 and the latest (12.3) version of kiwi. I will try to reproduce this with osc and factory

There is definitely something wrong when using qemu, it happens in the build service for 12.3 as well: https://build.opensuse.org/package/live_build_log?arch=armv7l&package=JeOS-beagle&project=openSUSE%3A12.3%3APorts&repository=images I would love to be able to build the official 12.3 images without using qemu :( Thanks, Dirk -- To unsubscribe, e-mail: opensuse-arm+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-arm+owner@opensuse.org

Guillaume Gardet

12:58

New subject: [opensuse-arm] Re: Local ARM JeOS image build fails (kiwi problem?)

Le 01/03/2013 10:17, Dirk Müller a écrit :

...

2013/3/1 Marcus Schäfer :

...
...
...
I tried 12.2 successfully with kiwi 5.04.21, and Factory fails with kiwi 5.04.53. My host is not native ARM but x86_64. I have tested only on real hardware with 12.2 and the latest (12.3) version of kiwi. I will try to reproduce this with osc and factory There is definitely something wrong when using qemu, it happens in the build service for 12.3 as well:

https://build.opensuse.org/package/live_build_log?arch=armv7l&package=JeOS-beagle&project=openSUSE%3A12.3%3APorts&repository=images

I would love to be able to build the official 12.3 images without using qemu :(

Good news for Marcus. Nothing wrong with kiwi apparently. ;) But we need a qemu guru! (Alex or Adrian?) Guillaume

...

Thanks, Dirk

-- To unsubscribe, e-mail: opensuse-arm+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-arm+owner@opensuse.org

Alexander Graf

7 Mar 7 Mar

10:46

On 01.03.2013, at 13:58, Guillaume GARDET wrote:

...

Le 01/03/2013 10:17, Dirk Müller a écrit :

...
2013/3/1 Marcus Schäfer :

...
...
...
I tried 12.2 successfully with kiwi 5.04.21, and Factory fails with kiwi 5.04.53. My host is not native ARM but x86_64. I have tested only on real hardware with 12.2 and the latest (12.3) version of kiwi. I will try to reproduce this with osc and factory There is definitely something wrong when using qemu, it happens in the build service for 12.3 as well:

https://build.opensuse.org/package/live_build_log?arch=armv7l&package=JeOS-beagle&project=openSUSE%3A12.3%3APorts&repository=images

I would love to be able to build the official 12.3 images without using qemu :(

Good news for Marcus. Nothing wrong with kiwi apparently. ;)

But we need a qemu guru! (Alex or Adrian?)

It'd help dramatically if someone could do the commands kiwi calls by hand and find the faulty one. Some comparison in kiwi apparently fails, otherwise it wouldn't go into the loop again. I'd think it's either the kpartx -a that's broken or the blockdev --getsize64. Once you isolated the broken command, it's most likely broken because of incorrect / incomplete syscall emulation. So please run that command using QEMU_STRACE=1 <command> Also run the same command on a real ARM machine with strace -f. Then compare the 2 runs and see where it differs. Once you've isolated it down, I'm more than happy to find a fix :). Alex -- To unsubscribe, e-mail: opensuse-arm+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-arm+owner@opensuse.org

Dirk Müller

11 Mar 11 Mar

12:25

2013/3/7 Alexander Graf :

...

...
...
I would love to be able to build the official 12.3 images without using qemu :( Good news for Marcus. Nothing wrong with kiwi apparently. ;)

Hi, unfortunately the problem also occurs on native build, so it is not a qemu problem but a kiwi problem. I've debugged it further. the issue is that apparently kiwi does some kpartx -a magic, and then later reads through /dev/mapper/* to find out about the mappings (that it just created itself). For reasons that I don't understand, the /dev inside the build chroot does not get any files inside /dev/mapper/*. (it seems to be a local mount with only very few files in it. not the same /dev that you get via mounting devtmpfs or --bind mounting the /dev from outside the chroot). so, the issue is that kiwi never finds the /dev/mapper/* output, doesn't try any other method (like kpartx -l or dmsetup), and then hangs in an endless loop. Marcus, any idea how to solve this? Thanks, Dirk -- To unsubscribe, e-mail: opensuse-arm+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-arm+owner@opensuse.org

Dirk Müller

13:34

2013/3/11 Dirk Müller :

...

I've debugged it further. the issue is that apparently kiwi does some kpartx -a magic, and then later reads through /dev/mapper/* to find out about the mappings (that it just created itself). For reasons that I don't understand, the /dev inside the build chroot does not get any files inside /dev/mapper/*.

With the help from Alex we potentially found a fix: it seems the default of kpartx for "sync mode" changed between 12.2 and 12.3. changing the kpartx -a/-d calls to -sa/-sd (for enabling sync mode) might fix the issue (not fully tested yet, but a quick try looked promising). Marcus, any opinion about this patch? Thanks, Dirk

Marcus Schäfer

14:01

Hi Dirk, Hi Alex

...

...
I've debugged it further. the issue is that apparently kiwi does some kpartx -a magic, and then later reads through /dev/mapper/* to find out about the mappings (that it just created itself). For reasons that I don't understand, the /dev inside the build chroot does not get any files inside /dev/mapper/*.

With the help from Alex we potentially found a fix: it seems the default of kpartx for "sync mode" changed between 12.2 and 12.3. changing the kpartx -a/-d calls to -sa/-sd (for enabling sync mode) might fix the issue (not fully tested yet, but a quick try looked promising).

Marcus, any opinion about this patch?

Thanks much for the patch makes a lot sense. I also stumbled over that problem and could solve it by waiting for the udev queue to finish. looks like on 12.3 the creation of the devices is done via udev ? The sync mode seems to be fine in addition to that patch is added to master, will cherry pick to 12.3 as well Regards, Marcus -- Public Key available gpg --keyserver pgp.mit.edu --recv-keys 0xCCE3C6A2 ------------------------------------------------------- Marcus Schäfer (Res. & Dev.) SUSE LINUX Products GmbH Tel: 0911-740 53 0 Maxfeldstrasse 5 FAX: 0911-740 53 479 D-90409 Nürnberg GF: Jeff Hawn,Jennifer Guild, Felix Imendörffer HRB: 21284 (AG Nürnberg) Germany http://www.suse.de ------------------------------------------------------- -- To unsubscribe, e-mail: opensuse-arm+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-arm+owner@opensuse.org

Alexander Graf

14:05

On 03/11/2013 03:01 PM, Marcus Schäfer wrote:

...

Hi Dirk, Hi Alex

...
...
I've debugged it further. the issue is that apparently kiwi does some kpartx -a magic, and then later reads through /dev/mapper/* to find out about the mappings (that it just created itself). For reasons that I don't understand, the /dev inside the build chroot does not get any files inside /dev/mapper/*. With the help from Alex we potentially found a fix: it seems the default of kpartx for "sync mode" changed between 12.2 and 12.3. changing the kpartx -a/-d calls to -sa/-sd (for enabling sync mode) might fix the issue (not fully tested yet, but a quick try looked promising).

Marcus, any opinion about this patch? Thanks much for the patch makes a lot sense. I also stumbled over that problem and could solve it by waiting for the udev queue to finish. looks like on 12.3 the creation of the devices is done via udev ?

Yup :). That fails for chroot mode though. It also fails for qemu-user - probably because the ARM libudev and the x86_64 udev daemon on the host don't understand each other.

...

The sync mode seems to be fine in addition to that

With sync mode, kpartx reverts to its old behavior where it creates the device nodes itself.

...

patch is added to master, will cherry pick to 12.3 as well

Awesome - thanks a lot! Alex -- To unsubscribe, e-mail: opensuse-arm+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-arm+owner@opensuse.org

Dirk Müller

21:47

2013/3/11 Alexander Graf :

...

...
patch is added to master, will cherry pick to 12.3 as well Awesome - thanks a lot!

Hi, patch is working - we finally have images again! Greetings, Dirk -- To unsubscribe, e-mail: opensuse-arm+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-arm+owner@opensuse.org

lists＠lazygranch.com

22:19

I assume this is for the "build" service. If there is an image I can download, I would like to test if the USB patch is working. (You may recall I'm the one with the really buggy Beagleboard XM that needs the USB patch. ) -----Original Message----- From: Dirk Müller Date: Mon, 11 Mar 2013 22:47:11 To: Alexander Graf Cc: Marcus Schäfer; Guillaume GARDET; openSUSE ARM ML Subject: Re: [opensuse-arm] Local ARM JeOS image build fails (kiwi problem?) 2013/3/11 Alexander Graf :

...

...
patch is added to master, will cherry pick to 12.3 as well Awesome - thanks a lot!

Hi, patch is working - we finally have images again! Greetings, Dirk -- To unsubscribe, e-mail: opensuse-arm+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-arm+owner@opensuse.org

Alexander Graf

22:55

I haven't pushed the patch into the openSUSE 12.3 kernel repository yet, so they won't contain the fix :). Alex On 11.03.2013, at 23:19, lists@lazygranch.com wrote:

...

I assume this is for the "build" service. If there is an image I can download, I would like to test if the USB patch is working. (You may recall I'm the one with the really buggy Beagleboard XM that needs the USB patch. )

-----Original Message----- From: Dirk Müller Date: Mon, 11 Mar 2013 22:47:11 To: Alexander Graf Cc: Marcus Schäfer; Guillaume GARDET; openSUSE ARM ML Subject: Re: [opensuse-arm] Local ARM JeOS image build fails (kiwi problem?)

2013/3/11 Alexander Graf :

...
...
patch is added to master, will cherry pick to 12.3 as well Awesome - thanks a lot!

Hi,

patch is working - we finally have images again!

Greetings, Dirk -- To unsubscribe, e-mail: opensuse-arm+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-arm+owner@opensuse.org -- To unsubscribe, e-mail: opensuse-arm+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-arm+owner@opensuse.org

-- To unsubscribe, e-mail: opensuse-arm+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-arm+owner@opensuse.org

Dirk Müller

12 Mar 12 Mar

07:49

2013/3/11 Alexander Graf :

...

I haven't pushed the patch into the openSUSE 12.3 kernel repository yet, so they won't contain the fix :).

Hi, I've added the patch to the kernel-omap2plus since otherwise the board is completely unuseable. Greetings, Dirk -- To unsubscribe, e-mail: opensuse-arm+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-arm+owner@opensuse.org

4064

Age (days ago)

4076

Last active (days ago)

List overview

Download

17 comments

5 participants

participants (5)

Alexander Graf
Dirk Müller
Guillaume Gardet
lists＠lazygranch.com
Marcus Schäfer