[opensuse-buildservice] Problems with aarch64 buildhost[s]
Dear OBS community,
from last night onwards pretty much all of our aarch64 builds are failing
due to what appears to be some serious problems on the buildhost (see attached
mails with log snippets).
among the "interesting" messages are:
[ 328s] [ 291.436030] dracut-initqueue[468]: Warning: Could not boot.
[ 347s] qemu-system-aarch64: terminating on signal 15 from pid 38856 (fuser)
[ 340s] dracut:/# ### WATCHDOG TRIGGERED, KILLING VM ###
[ 18s] objdump: /boot/Image.guest: File format not recognized
[ 322s] Warning: /dev/disk/by-uuid/00750419-b769-40be-aa7a-a81dca13c577 does not exist
This is not critical for us, but I guess somebody will want to have a look at this
at some point :) Thanks!
Regards,
Harald
--
- Harald Welte
Dear OBS community, just FYI: It's now one week later, but aarch64 builds are still failing consistently throughout that period until today. We'll now be disabling our osmocom.org aarch64 builds until further notice, to prevent the dozens of build failure notifications every night. Thanks again for all your efforts. Regards, Harald On Thu, May 10, 2018 at 09:23:47AM +0200, Harald Welte wrote:
Dear OBS community,
from last night onwards pretty much all of our aarch64 builds are failing due to what appears to be some serious problems on the buildhost (see attached mails with log snippets).
among the "interesting" messages are:
[ 328s] [ 291.436030] dracut-initqueue[468]: Warning: Could not boot.
[ 347s] qemu-system-aarch64: terminating on signal 15 from pid 38856 (fuser)
[ 340s] dracut:/# ### WATCHDOG TRIGGERED, KILLING VM ###
[ 18s] objdump: /boot/Image.guest: File format not recognized
[ 322s] Warning: /dev/disk/by-uuid/00750419-b769-40be-aa7a-a81dca13c577 does not exist
This is not critical for us, but I guess somebody will want to have a look at this at some point :) Thanks!
Regards, Harald -- - Harald Welte
http://laforge.gnumonks.org/ ============================================================================ "Privacy in residential applications is a desirable marketing option." (ETSI EN 300 175-7 Ch. A6)
Date: Wed, 09 May 2018 23:56:59 +0000 From: OBS Notification
To: Alexander Couzens , Harald Welte , OpenBSC gerrit-log Mailing List Subject: Build failure of network:osmocom:nightly/osmo-pcap in Debian_9.0/aarch64 X-Mailer: OBS Notification System Visit https://build.opensuse.org/package/live_build_log/network:osmocom:nightly/os...
Package network:osmocom:nightly/osmo-pcap failed to build in Debian_9.0/aarch64
Check out the package for editing: osc checkout network:osmocom:nightly osmo-pcap
Last lines of build log: [ 287s] [ 255.533075] dracut-initqueue[474]: Warning: dracut-initqueue timeout - starting timeout scripts [ 288s] [ 256.340462] dracut-initqueue[474]: Warning: dracut-initqueue timeout - starting timeout scripts [ 288s] [ 256.981985] dracut-initqueue[474]: Warning: dracut-initqueue timeout - starting timeout scripts [ 289s] [ 257.625105] dracut-initqueue[474]: Warning: dracut-initqueue timeout - starting timeout scripts [ 290s] [ 258.463060] dracut-initqueue[474]: Warning: dracut-initqueue timeout - starting timeout scripts [ 290s] [ 258.469300] dracut-initqueue[474]: Warning: Could not boot. [ 290s] Starting Setup Virtual Console... [ 290s] [[0;32m OK [0m] Started Setup Virtual Console. [ 290s] Starting Dracut Emergency Shell... [ 290s] Warning: /dev/disk/by-uuid/00750419-b769-40be-aa7a-a81dca13c577 does not exist [ 290s] [ 290s] Generating "/run/initramfs/rdsosreport.txt" [ 291s] [ 291s] [ 291s] Entering emergency mode. Exit the shell to continue. [ 291s] Type "journalctl" to view system logs. [ 291s] You might want to save "/run/initramfs/rdsosreport.txt" to a USB stick or /boot [ 291s] after mounting them and attach it to a bug report. [ 291s] [ 291s] [ 340s] dracut:/# ### WATCHDOG TRIGGERED, KILLING VM ### [ 342s] /var/cache/obs/worker/root_18/root: 32805 [ 342s] qemu-system-aarch64: terminating on signal 15 from pid 13428 (fuser) [ 342s] ### VM INTERACTION END ### [ 342s] /var/run/obs/worker/18/build/build-vm: line 458: kill: (32796) - No such process [ 342s] No buildstatus set, either the base system is broken (kernel/initrd/udev/glibc/bash/perl) [ 342s] or the build host has a kernel or hardware problem...
gave up after 12 failed build attempts...
-- Configure notifications at https://build.opensuse.org/user/notifications openSUSE Build Service (https://build.opensuse.org/)
Date: Thu, 10 May 2018 00:27:15 +0000 From: OBS Notification
To: Alexander Couzens , Harald Welte , OpenBSC gerrit-log Mailing List Subject: Build failure of network:osmocom:nightly/osmo-sip-connector in Debian_9.0/aarch64 X-Mailer: OBS Notification System Visit https://build.opensuse.org/package/live_build_log/network:osmocom:nightly/os...
Package network:osmocom:nightly/osmo-sip-connector failed to build in Debian_9.0/aarch64
Check out the package for editing: osc checkout network:osmocom:nightly osmo-sip-connector
Last lines of build log: [ 334s] [ 288.635974] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 335s] [ 289.341341] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 335s] [ 290.013001] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 336s] [ 290.725797] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 337s] [ 291.469633] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 338s] [ 292.308498] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 338s] [ 293.053594] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 339s] [ 293.793698] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 340s] [ 294.520236] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 341s] [ 295.339046] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 341s] [ 295.965900] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 342s] [ 296.645742] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 343s] [ 297.425038] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 343s] [ 298.067127] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 344s] ### WATCHDOG TRIGGERED, KILLING VM ### [ 344s] [ 298.729273] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 345s] [ 299.381340] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 345s] [ 299.997850] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 346s] [ 300.716520] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 347s] [ 301.419016] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 347s] [ 302.086701] dracut-initqueue[467]: Warning: dracut-initqueue timeout - starting timeout scripts [ 347s] /var/cache/obs/worker/root_23/root: 17469 [ 347s] qemu-system-aarch64: terminating on signal 15 from pid 38856 (fuser) [ 348s] ### VM INTERACTION END ### [ 348s] /var/run/obs/worker/23/build/build-vm: line 458: kill: (17461) - No such process [ 348s] No buildstatus set, either the base system is broken (kernel/initrd/udev/glibc/bash/perl) [ 348s] or the build host has a kernel or hardware problem...
gave up after 12 failed build attempts...
-- Configure notifications at https://build.opensuse.org/user/notifications openSUSE Build Service (https://build.opensuse.org/)
Date: Thu, 10 May 2018 00:29:50 +0000 From: OBS Notification
To: Alexander Couzens , Harald Welte , OpenBSC gerrit-log Mailing List Subject: Build failure of network:osmocom:nightly/libosmo-netif in Debian_9.0/aarch64 X-Mailer: OBS Notification System Visit https://build.opensuse.org/package/live_build_log/network:osmocom:nightly/li...
Package network:osmocom:nightly/libosmo-netif failed to build in Debian_9.0/aarch64
Check out the package for editing: osc checkout network:osmocom:nightly libosmo-netif
Last lines of build log: [ 326s] [ 288.665100] dracut-initqueue[468]: Warning: dracut-initqueue timeout - starting timeout scripts [ 326s] [ 289.324650] dracut-initqueue[468]: Warning: dracut-initqueue timeout - starting timeout scripts [ 327s] [ 290.003074] dracut-initqueue[468]: Warning: dracut-initqueue timeout - starting timeout scripts [ 328s] [ 290.676055] dracut-initqueue[468]: Warning: dracut-initqueue timeout - starting timeout scripts [ 328s] [ 291.429474] dracut-initqueue[468]: Warning: dracut-initqueue timeout - starting timeout scripts [ 328s] [ 291.436030] dracut-initqueue[468]: Warning: Could not boot. [ 329s] Starting Setup Virtual Console... [ 329s] [[0;32m OK [0m] Started Setup Virtual Console. [ 329s] Starting Dracut Emergency Shell... [ 329s] Warning: /dev/disk/by-uuid/00750419-b769-40be-aa7a-a81dca13c577 does not exist [ 329s] [ 329s] Generating "/run/initramfs/rdsosreport.txt" [ 329s] [ 329s] [ 329s] Entering emergency mode. Exit the shell to continue. [ 329s] Type "journalctl" to view system logs. [ 329s] You might want to save "/run/initramfs/rdsosreport.txt" to a USB stick or /boot [ 329s] after mounting them and attach it to a bug report. [ 329s] [ 329s] [ 339s] dracut:/# ### WATCHDOG TRIGGERED, KILLING VM ### [ 341s] /var/cache/obs/worker/root_15/root: 29927 [ 341s] qemu-system-aarch64: terminating on signal 15 from pid 46684 (fuser) [ 341s] ### VM INTERACTION END ### [ 341s] /var/run/obs/worker/15/build/build-vm: line 458: kill: (29920) - No such process [ 341s] No buildstatus set, either the base system is broken (kernel/initrd/udev/glibc/bash/perl) [ 341s] or the build host has a kernel or hardware problem...
gave up after 12 failed build attempts...
-- Configure notifications at https://build.opensuse.org/user/notifications openSUSE Build Service (https://build.opensuse.org/)
Date: Thu, 10 May 2018 00:34:25 +0000 From: OBS Notification
To: Alexander Couzens , Harald Welte , OpenBSC gerrit-log Mailing List Subject: Build failure of network:osmocom:nightly/osmo-pcu in Debian_9.0/aarch64 X-Mailer: OBS Notification System Visit https://build.opensuse.org/package/live_build_log/network:osmocom:nightly/os...
Package network:osmocom:nightly/osmo-pcu failed to build in Debian_9.0/aarch64
Check out the package for editing: osc checkout network:osmocom:nightly osmo-pcu
Last lines of build log: [ 326s] [ 268.367557] dracut-initqueue[475]: Warning: dracut-initqueue timeout - starting timeout scripts [ 327s] [ 269.051609] dracut-initqueue[475]: Warning: dracut-initqueue timeout - starting timeout scripts [ 327s] [ 269.796728] dracut-initqueue[475]: Warning: dracut-initqueue timeout - starting timeout scripts [ 328s] [ 270.647051] dracut-initqueue[475]: Warning: dracut-initqueue timeout - starting timeout scripts [ 329s] [ 271.235551] dracut-initqueue[475]: Warning: dracut-initqueue timeout - starting timeout scripts [ 329s] [ 271.242228] dracut-initqueue[475]: Warning: Could not boot. [ 329s] Starting Setup Virtual Console... [ 329s] [[0;32m OK [0m] Started Setup Virtual Console. [ 329s] Starting Dracut Emergency Shell... [ 329s] Warning: /dev/disk/by-uuid/00750419-b769-40be-aa7a-a81dca13c577 does not exist [ 329s] [ 329s] Generating "/run/initramfs/rdsosreport.txt" [ 330s] [ 330s] [ 330s] Entering emergency mode. Exit the shell to continue. [ 330s] Type "journalctl" to view system logs. [ 330s] You might want to save "/run/initramfs/rdsosreport.txt" to a USB stick or /boot [ 330s] after mounting them and attach it to a bug report. [ 330s] [ 330s] [ 362s] dracut:/# ### WATCHDOG TRIGGERED, KILLING VM ### [ 363s] /var/cache/obs/worker/root_2/root: 41975 [ 363s] qemu-system-aarch64: terminating on signal 15 from pid 16751 (fuser) [ 363s] ### VM INTERACTION END ### [ 363s] /var/run/obs/worker/2/build/build-vm: line 458: kill: (41946) - No such process [ 363s] No buildstatus set, either the base system is broken (kernel/initrd/udev/glibc/bash/perl) [ 363s] or the build host has a kernel or hardware problem...
gave up after 13 failed build attempts...
-- Configure notifications at https://build.opensuse.org/user/notifications openSUSE Build Service (https://build.opensuse.org/)
Date: Thu, 10 May 2018 01:15:16 +0000 From: OBS Notification
To: Alexander Couzens , Harald Welte , OpenBSC gerrit-log Mailing List Subject: Build failure of network:osmocom:nightly/osmo-trx in Debian_9.0/aarch64 X-Mailer: OBS Notification System Visit https://build.opensuse.org/package/live_build_log/network:osmocom:nightly/os...
Package network:osmocom:nightly/osmo-trx failed to build in Debian_9.0/aarch64
Check out the package for editing: osc checkout network:osmocom:nightly osmo-trx
Last lines of build log: [ 324s] [ 263.146782] dracut-initqueue[462]: Warning: dracut-initqueue timeout - starting timeout scripts [ 324s] [ 263.737183] dracut-initqueue[462]: Warning: dracut-initqueue timeout - starting timeout scripts [ 325s] [ 264.341515] dracut-initqueue[462]: Warning: dracut-initqueue timeout - starting timeout scripts [ 325s] [ 265.010589] dracut-initqueue[462]: Warning: dracut-initqueue timeout - starting timeout scripts [ 326s] [ 265.686389] dracut-initqueue[462]: Warning: dracut-initqueue timeout - starting timeout scripts [ 326s] [ 265.714508] dracut-initqueue[462]: Warning: Could not boot. [ 326s] Starting Setup Virtual Console... [ 326s] [[0;32m OK [0m] Started Setup Virtual Console. [ 326s] Starting Dracut Emergency Shell... [ 326s] Warning: /dev/disk/by-uuid/00750419-b769-40be-aa7a-a81dca13c577 does not exist [ 326s] [ 326s] Generating "/run/initramfs/rdsosreport.txt" [ 327s] [ 327s] [ 327s] Entering emergency mode. Exit the shell to continue. [ 327s] Type "journalctl" to view system logs. [ 327s] You might want to save "/run/initramfs/rdsosreport.txt" to a USB stick or /boot [ 327s] after mounting them and attach it to a bug report. [ 327s] [ 327s] [ 365s] dracut:/# ### WATCHDOG TRIGGERED, KILLING VM ### [ 366s] /var/cache/obs/worker/root_20/root: 27904 [ 366s] qemu-system-aarch64: terminating on signal 15 from pid 4942 (fuser) [ 366s] ### VM INTERACTION END ### [ 366s] /var/run/obs/worker/20/build/build-vm: line 458: kill: (27891) - No such process [ 366s] No buildstatus set, either the base system is broken (kernel/initrd/udev/glibc/bash/perl) [ 366s] or the build host has a kernel or hardware problem...
gave up after 12 failed build attempts...
-- Configure notifications at https://build.opensuse.org/user/notifications openSUSE Build Service (https://build.opensuse.org/)
Date: Thu, 10 May 2018 01:38:59 +0000 From: OBS Notification
To: Alexander Couzens , Harald Welte , OpenBSC gerrit-log Mailing List Subject: Build failure of network:osmocom:nightly/osmo-bts in Debian_9.0/aarch64 X-Mailer: OBS Notification System Visit https://build.opensuse.org/package/live_build_log/network:osmocom:nightly/os...
Package network:osmocom:nightly/osmo-bts failed to build in Debian_9.0/aarch64
Check out the package for editing: osc checkout network:osmocom:nightly osmo-bts
Last lines of build log: [ 288s] [ 252.508226] dracut-initqueue[493]: Warning: dracut-initqueue timeout - starting timeout scripts [ 288s] [ 253.133959] dracut-initqueue[493]: Warning: dracut-initqueue timeout - starting timeout scripts [ 289s] [ 253.830477] dracut-initqueue[493]: Warning: dracut-initqueue timeout - starting timeout scripts [ 290s] [ 254.520365] dracut-initqueue[493]: Warning: dracut-initqueue timeout - starting timeout scripts [ 290s] [ 255.131042] dracut-initqueue[493]: Warning: dracut-initqueue timeout - starting timeout scripts [ 290s] [ 255.137609] dracut-initqueue[493]: Warning: Could not boot. [ 290s] Starting Setup Virtual Console... [ 290s] [[0;32m OK [0m] Started Setup Virtual Console. [ 290s] Starting Dracut Emergency Shell... [ 290s] Warning: /dev/disk/by-uuid/00750419-b769-40be-aa7a-a81dca13c577 does not exist [ 290s] [ 290s] Generating "/run/initramfs/rdsosreport.txt" [ 291s] [ 291s] [ 291s] Entering emergency mode. Exit the shell to continue. [ 291s] Type "journalctl" to view system logs. [ 291s] You might want to save "/run/initramfs/rdsosreport.txt" to a USB stick or /boot [ 291s] after mounting them and attach it to a bug report. [ 291s] [ 291s] [ 341s] dracut:/# ### WATCHDOG TRIGGERED, KILLING VM ### [ 342s] /var/cache/obs/worker/root_6/root: 16372 [ 342s] qemu-system-aarch64: terminating on signal 15 from pid 2275 (<unknown process>) [ 342s] ### VM INTERACTION END ### [ 342s] /var/run/obs/worker/6/build/build-vm: line 458: kill: (16362) - No such process [ 342s] No buildstatus set, either the base system is broken (kernel/initrd/udev/glibc/bash/perl) [ 342s] or the build host has a kernel or hardware problem...
gave up after 13 failed build attempts...
-- Configure notifications at https://build.opensuse.org/user/notifications openSUSE Build Service (https://build.opensuse.org/)
Date: Thu, 10 May 2018 02:12:59 +0000 From: OBS Notification
To: Alexander Couzens , Harald Welte , OpenBSC gerrit-log Mailing List Subject: Build failure of network:osmocom:nightly/osmo-hlr in Debian_9.0/aarch64 X-Mailer: OBS Notification System Visit https://build.opensuse.org/package/live_build_log/network:osmocom:nightly/os...
Package network:osmocom:nightly/osmo-hlr failed to build in Debian_9.0/aarch64
Check out the package for editing: osc checkout network:osmocom:nightly osmo-hlr
Last lines of build log: [ 310s] [ 271.307403] dracut-initqueue[445]: Warning: dracut-initqueue timeout - starting timeout scripts [ 311s] [ 272.035066] dracut-initqueue[445]: Warning: dracut-initqueue timeout - starting timeout scripts [ 312s] [ 272.723359] dracut-initqueue[445]: Warning: dracut-initqueue timeout - starting timeout scripts [ 312s] [ 273.378441] dracut-initqueue[445]: Warning: dracut-initqueue timeout - starting timeout scripts [ 313s] [ 274.077913] dracut-initqueue[445]: Warning: dracut-initqueue timeout - starting timeout scripts [ 313s] [ 274.090871] dracut-initqueue[445]: Warning: Could not boot. [ 313s] Starting Setup Virtual Console... [ 313s] [[0;32m OK [0m] Started Setup Virtual Console. [ 313s] Starting Dracut Emergency Shell... [ 313s] Warning: /dev/disk/by-uuid/00750419-b769-40be-aa7a-a81dca13c577 does not exist [ 313s] [ 313s] Generating "/run/initramfs/rdsosreport.txt" [ 315s] [ 315s] [ 315s] Entering emergency mode. Exit the shell to continue. [ 315s] Type "journalctl" to view system logs. [ 315s] You might want to save "/run/initramfs/rdsosreport.txt" to a USB stick or /boot [ 315s] after mounting them and attach it to a bug report. [ 315s] [ 315s] [ 339s] dracut:/# ### WATCHDOG TRIGGERED, KILLING VM ### [ 340s] /var/cache/obs/worker/root_30/root: 27275 [ 340s] qemu-system-aarch64: terminating on signal 15 from pid 6246 (fuser) [ 340s] ### VM INTERACTION END ### [ 340s] /var/run/obs/worker/30/build/build-vm: line 458: kill: (27268) - No such process [ 340s] No buildstatus set, either the base system is broken (kernel/initrd/udev/glibc/bash/perl) [ 340s] or the build host has a kernel or hardware problem...
gave up after 12 failed build attempts...
-- Configure notifications at https://build.opensuse.org/user/notifications openSUSE Build Service (https://build.opensuse.org/)
Date: Thu, 10 May 2018 03:04:59 +0000 From: OBS Notification
To: Alexander Couzens , Harald Welte , OpenBSC gerrit-log Mailing List Subject: Build failure of network:osmocom:nightly/osmo-iuh in Debian_9.0/aarch64 X-Mailer: OBS Notification System Visit https://build.opensuse.org/package/live_build_log/network:osmocom:nightly/os...
Package network:osmocom:nightly/osmo-iuh failed to build in Debian_9.0/aarch64
Check out the package for editing: osc checkout network:osmocom:nightly osmo-iuh
Last lines of build log: [ 319s] [ 274.220813] dracut-initqueue[458]: Warning: dracut-initqueue timeout - starting timeout scripts [ 320s] [ 274.846570] dracut-initqueue[458]: Warning: dracut-initqueue timeout - starting timeout scripts [ 321s] [ 275.505844] dracut-initqueue[458]: Warning: dracut-initqueue timeout - starting timeout scripts [ 321s] [ 276.146389] dracut-initqueue[458]: Warning: dracut-initqueue timeout - starting timeout scripts [ 322s] [ 276.815662] dracut-initqueue[458]: Warning: dracut-initqueue timeout - starting timeout scripts [ 322s] [ 276.823865] dracut-initqueue[458]: Warning: Could not boot. [ 322s] Starting Setup Virtual Console... [ 322s] [[0;32m OK [0m] Started Setup Virtual Console. [ 322s] Starting Dracut Emergency Shell... [ 322s] Warning: /dev/disk/by-uuid/00750419-b769-40be-aa7a-a81dca13c577 does not exist [ 322s] [ 322s] Generating "/run/initramfs/rdsosreport.txt" [ 322s] [ 322s] [ 322s] Entering emergency mode. Exit the shell to continue. [ 322s] Type "journalctl" to view system logs. [ 322s] You might want to save "/run/initramfs/rdsosreport.txt" to a USB stick or /boot [ 322s] after mounting them and attach it to a bug report. [ 322s] [ 322s] [ 337s] dracut:/# ### WATCHDOG TRIGGERED, KILLING VM ### [ 337s] /var/cache/obs/worker/root_17/root: 42909 [ 337s] qemu-system-aarch64: terminating on signal 15 from pid 31945 () [ 337s] ### VM INTERACTION END ### [ 337s] /var/run/obs/worker/17/build/build-vm: line 458: kill: (42902) - No such process [ 338s] No buildstatus set, either the base system is broken (kernel/initrd/udev/glibc/bash/perl) [ 338s] or the build host has a kernel or hardware problem...
gave up after 10 failed build attempts...
-- Configure notifications at https://build.opensuse.org/user/notifications openSUSE Build Service (https://build.opensuse.org/)
Date: Thu, 10 May 2018 01:59:16 +0000 From: OBS Notification
To: Alexander Couzens , Harald Welte , OpenBSC gerrit-log Mailing List Subject: Build failure of network:osmocom:nightly/libosmo-sccp in Debian_9.0/aarch64 X-Mailer: OBS Notification System Visit https://build.opensuse.org/package/live_build_log/network:osmocom:nightly/li...
Package network:osmocom:nightly/libosmo-sccp failed to build in Debian_9.0/aarch64
Check out the package for editing: osc checkout network:osmocom:nightly libosmo-sccp
Last lines of build log: [ 13s] [67/70] preinstalling sysvinit-utils... [ 13s] [68/70] preinstalling e2fsprogs... [ 14s] [69/70] preinstalling sysv-rc... [ 14s] [70/70] preinstalling initscripts... [ 14s] [ 14s] [1/1] preinstalling libdevmapper1.02.1... [ 15s] copying packages... [ 18s] reordering...cycle: libc6 -> libgcc1 [ 18s] breaking dependency libgcc1 -> libc6 [ 18s] cycle: debhelper -> dh-autoreconf [ 18s] breaking dependency debhelper -> dh-autoreconf [ 18s] cycle: dh-strip-nondeterminism -> debhelper [ 18s] breaking dependency debhelper -> dh-strip-nondeterminism [ 18s] done [ 18s] objdump: /boot/Image.guest: File format not recognized [ 21s] booting kvm... [ 22s] ### VM INTERACTION START ### [ 22s] /usr/bin/qemu-system-aarch64 -nodefaults -no-reboot -nographic -vga none -enable-kvm -cpu host -M virt,gic-version=host -object rng-random,filename=/dev/hwrng,id=rng0 -device virtio-rng-device,rng=rng0 -runas qemu -net none -kernel /boot/Image.guest -initrd /boot/initrd.guest -append root=/dev/disk/by-id/virtio-0 rootfstype=ext4 rootflags=noatime panic=1 quiet no-kvmclock nmi_watchdog=0 rw rd.driver.pre=binfmt_misc elevator=noop console=ttyAMA0 init=/.build/build -m 2048 -drive file=/var/cache/obs/worker/root_6/root,format=raw,if=none,id=disk,serial=0,cache=unsafe -device virtio-blk-device,drive=disk -drive file=/var/cache/obs/worker/root_6/swap,format=raw,if=none,id=swap,serial=1,cache=unsafe -device virtio-blk-device,drive=swap -serial stdio -chardev socket,id=monitor,server,nowait,path=/var/cache/obs/worker/root_6/root.qemu/monitor -mon chardev=monitor,mode=readline -smp 4 [ 22s] qemu-system-aarch64: -drive file=/var/cache/obs/worker/root_6/root,format=raw,if=none,id=disk,serial=0,cache=unsafe: 'serial' is deprecated, please use the corresponding option of '-device' instead [ 22s] qemu-system-aarch64: -drive file=/var/cache/obs/worker/root_6/swap,format=raw,if=none,id=swap,serial=1,cache=unsafe: 'serial' is deprecated, please use the corresponding option of '-device' instead [ 328s] ### WATCHDOG TRIGGERED, KILLING VM ### [ 328s] /var/cache/obs/worker/root_6/root: 24789 [ 328s] qemu-system-aarch64: terminating on signal 15 from pid 30317 () [ 328s] ### VM INTERACTION END ### [ 328s] /var/run/obs/worker/6/build/build-vm: line 458: kill: (24757) - No such process [ 328s] No buildstatus set, either the base system is broken (kernel/initrd/udev/glibc/bash/perl) [ 328s] or the build host has a kernel or hardware problem...
gave up after 11 failed build attempts...
-- Configure notifications at https://build.opensuse.org/user/notifications openSUSE Build Service (https://build.opensuse.org/)
Date: Thu, 10 May 2018 02:02:59 +0000 From: OBS Notification
To: Alexander Couzens , Harald Welte , OpenBSC gerrit-log Mailing List Subject: Build failure of network:osmocom:nightly/osmo-mgw in Debian_9.0/aarch64 X-Mailer: OBS Notification System Visit https://build.opensuse.org/package/live_build_log/network:osmocom:nightly/os...
Package network:osmocom:nightly/osmo-mgw failed to build in Debian_9.0/aarch64
Check out the package for editing: osc checkout network:osmocom:nightly osmo-mgw
Last lines of build log: [ 289s] [ 258.056108] dracut-initqueue[456]: Warning: dracut-initqueue timeout - starting timeout scripts [ 289s] [ 258.748078] dracut-initqueue[456]: Warning: dracut-initqueue timeout - starting timeout scripts [ 290s] [ 259.460723] dracut-initqueue[456]: Warning: dracut-initqueue timeout - starting timeout scripts [ 291s] [ 260.137201] dracut-initqueue[456]: Warning: dracut-initqueue timeout - starting timeout scripts [ 292s] [ 260.806194] dracut-initqueue[456]: Warning: dracut-initqueue timeout - starting timeout scripts [ 292s] [ 260.813245] dracut-initqueue[456]: Warning: Could not boot. [ 292s] Starting Setup Virtual Console... [ 292s] [[0;32m OK [0m] Started Setup Virtual Console. [ 292s] Starting Dracut Emergency Shell... [ 292s] Warning: /dev/disk/by-uuid/00750419-b769-40be-aa7a-a81dca13c577 does not exist [ 292s] [ 292s] Generating "/run/initramfs/rdsosreport.txt" [ 292s] [ 292s] [ 292s] Entering emergency mode. Exit the shell to continue. [ 292s] Type "journalctl" to view system logs. [ 292s] You might want to save "/run/initramfs/rdsosreport.txt" to a USB stick or /boot [ 292s] after mounting them and attach it to a bug report. [ 292s] [ 292s] [ 334s] dracut:/# ### WATCHDOG TRIGGERED, KILLING VM ### [ 335s] /var/cache/obs/worker/root_21/root: 20457 [ 335s] qemu-system-aarch64: terminating on signal 15 from pid 47289 () [ 335s] ### VM INTERACTION END ### [ 335s] /var/run/obs/worker/21/build/build-vm: line 458: kill: (20447) - No such process [ 335s] No buildstatus set, either the base system is broken (kernel/initrd/udev/glibc/bash/perl) [ 335s] or the build host has a kernel or hardware problem...
gave up after 12 failed build attempts...
-- Configure notifications at https://build.opensuse.org/user/notifications openSUSE Build Service (https://build.opensuse.org/)
Date: Thu, 10 May 2018 03:30:25 +0000 From: OBS Notification
To: Alexander Couzens , Harald Welte , OpenBSC gerrit-log Mailing List Subject: Build failure of network:osmocom:nightly/openbsc in Debian_9.0/aarch64 X-Mailer: OBS Notification System Visit https://build.opensuse.org/package/live_build_log/network:osmocom:nightly/op...
Package network:osmocom:nightly/openbsc failed to build in Debian_9.0/aarch64
Check out the package for editing: osc checkout network:osmocom:nightly openbsc
Last lines of build log: [ 321s] [ 281.204438] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 322s] [ 281.826838] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 323s] [ 282.485707] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 323s] [ 283.156951] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 324s] [ 283.805781] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 325s] [ 284.476808] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 325s] [ 285.116480] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 326s] [ 285.787609] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 327s] [ 286.435795] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 327s] [ 287.036819] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 328s] [ 287.686070] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 329s] [ 288.326598] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 329s] [ 288.996061] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 330s] [ 289.646693] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 331s] [ 290.335875] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 331s] [ 290.966947] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 332s] [ 291.585575] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 333s] [ 292.217080] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 333s] ### WATCHDOG TRIGGERED, KILLING VM ### [ 333s] [ 292.825875] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 334s] [ 293.446891] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 334s] /var/cache/obs/worker/root_9/root: 15294 [ 334s] qemu-system-aarch64: terminating on signal 15 from pid 46467 () [ 334s] ### VM INTERACTION END ### [ 334s] /var/run/obs/worker/9/build/build-vm: line 458: kill: (15279) - No such process [ 334s] No buildstatus set, either the base system is broken (kernel/initrd/udev/glibc/bash/perl) [ 334s] or the build host has a kernel or hardware problem...
gave up after 11 failed build attempts...
-- Configure notifications at https://build.opensuse.org/user/notifications openSUSE Build Service (https://build.opensuse.org/)
Date: Thu, 10 May 2018 03:40:42 +0000 From: OBS Notification
To: Alexander Couzens , Harald Welte , OpenBSC gerrit-log Mailing List Subject: Build failure of network:osmocom:nightly/osmo-bsc in Debian_9.0/aarch64 X-Mailer: OBS Notification System Visit https://build.opensuse.org/package/live_build_log/network:osmocom:nightly/os...
Package network:osmocom:nightly/osmo-bsc failed to build in Debian_9.0/aarch64
Check out the package for editing: osc checkout network:osmocom:nightly osmo-bsc
Last lines of build log: [ 334s] [ 296.158894] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 335s] [ 296.950431] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 336s] [ 297.644363] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 337s] [ 298.337569] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 337s] [ 299.078545] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 338s] [ 299.726713] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 339s] [ 300.435680] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 339s] [ 301.096394] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 340s] [ 301.686831] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 341s] [ 302.530987] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 341s] [ 303.176840] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 342s] [ 303.864445] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 343s] [ 304.480152] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 343s] [ 305.176964] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 344s] [ 305.899673] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 345s] [ 306.637132] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 346s] [ 307.375342] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 346s] [ 308.192437] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 347s] ### WATCHDOG TRIGGERED, KILLING VM ### [ 347s] [ 308.883039] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 348s] [ 309.583432] dracut-initqueue[449]: Warning: dracut-initqueue timeout - starting timeout scripts [ 348s] /var/cache/obs/worker/root_11/root: 22855 [ 348s] qemu-system-aarch64: terminating on signal 15 from pid 1339 (fuser) [ 348s] ### VM INTERACTION END ### [ 348s] /var/run/obs/worker/11/build/build-vm: line 458: kill: (22844) - No such process [ 348s] No buildstatus set, either the base system is broken (kernel/initrd/udev/glibc/bash/perl) [ 348s] or the build host has a kernel or hardware problem...
gave up after 12 failed build attempts...
-- Configure notifications at https://build.opensuse.org/user/notifications openSUSE Build Service (https://build.opensuse.org/)
Date: Thu, 10 May 2018 04:18:07 +0000 From: OBS Notification
To: Alexander Couzens , Harald Welte , OpenBSC gerrit-log Mailing List Subject: Build failure of network:osmocom:nightly/osmo-sgsn in Debian_9.0/aarch64 X-Mailer: OBS Notification System Visit https://build.opensuse.org/package/live_build_log/network:osmocom:nightly/os...
Package network:osmocom:nightly/osmo-sgsn failed to build in Debian_9.0/aarch64
Check out the package for editing: osc checkout network:osmocom:nightly osmo-sgsn
Last lines of build log: [ 363s] [ 299.919831] dracut-initqueue[461]: Warning: dracut-initqueue timeout - starting timeout scripts [ 364s] [ 300.568788] dracut-initqueue[461]: Warning: dracut-initqueue timeout - starting timeout scripts [ 365s] [ 301.190918] dracut-initqueue[461]: Warning: dracut-initqueue timeout - starting timeout scripts [ 365s] [ 301.792257] dracut-initqueue[461]: Warning: dracut-initqueue timeout - starting timeout scripts [ 366s] [ 302.539567] dracut-initqueue[461]: Warning: dracut-initqueue timeout - starting timeout scripts [ 367s] [ 303.215832] dracut-initqueue[461]: Warning: dracut-initqueue timeout - starting timeout scripts [ 367s] [ 303.867144] dracut-initqueue[461]: Warning: dracut-initqueue timeout - starting timeout scripts [ 368s] [ 304.509769] dracut-initqueue[461]: Warning: dracut-initqueue timeout - starting timeout scripts [ 369s] [ 305.146383] dracut-initqueue[461]: Warning: dracut-initqueue timeout - starting timeout scripts [ 369s] ### WATCHDOG TRIGGERED, KILLING VM ### [ 369s] [ 305.796789] dracut-initqueue[461]: Warning: dracut-initqueue timeout - starting timeout scripts [ 369s] [ 305.803694] dracut-initqueue[461]: Warning: Could not boot. [ 369s] Starting Setup Virtual Console... [ 369s] [[0;32m OK [0m] Started Setup Virtual Console. [ 369s] Starting Dracut Emergency Shell... [ 370s] Warning: /dev/disk/by-uuid/00750419-b769-40be-aa7a-a81dca13c577 does not exist [ 370s] [ 370s] Generating "/run/initramfs/rdsosreport.txt" [ 375s] [ 375s] [ 375s] Entering emergency mode. Exit the shell to continue. [ 375s] T/var/cache/obs/worker/root_6/root: 29596 [ 375s] ypqemu-system-aarch64: terminating on signal 15 from pid 3353 () [ 375s] e### VM INTERACTION END ### [ 375s] /var/run/obs/worker/6/build/build-vm: line 458: kill: (29585) - No such process [ 375s] No buildstatus set, either the base system is broken (kernel/initrd/udev/glibc/bash/perl) [ 375s] or the build host has a kernel or hardware problem...
gave up after 11 failed build attempts...
-- Configure notifications at https://build.opensuse.org/user/notifications openSUSE Build Service (https://build.opensuse.org/)
Date: Thu, 10 May 2018 04:22:59 +0000 From: OBS Notification
To: Alexander Couzens , Harald Welte , OpenBSC gerrit-log Mailing List Subject: Build failure of network:osmocom:nightly/osmo-msc in Debian_9.0/aarch64 X-Mailer: OBS Notification System Visit https://build.opensuse.org/package/live_build_log/network:osmocom:nightly/os...
Package network:osmocom:nightly/osmo-msc failed to build in Debian_9.0/aarch64
Check out the package for editing: osc checkout network:osmocom:nightly osmo-msc
Last lines of build log: [ 305s] [ 257.656639] dracut-initqueue[480]: Warning: dracut-initqueue timeout - starting timeout scripts [ 306s] [ 258.407351] dracut-initqueue[480]: Warning: dracut-initqueue timeout - starting timeout scripts [ 307s] [ 259.098133] dracut-initqueue[480]: Warning: dracut-initqueue timeout - starting timeout scripts [ 307s] [ 259.727334] dracut-initqueue[480]: Warning: dracut-initqueue timeout - starting timeout scripts [ 308s] [ 260.393702] dracut-initqueue[480]: Warning: dracut-initqueue timeout - starting timeout scripts [ 308s] [ 260.405743] dracut-initqueue[480]: Warning: Could not boot. [ 308s] Starting Setup Virtual Console... [ 308s] [[0;32m OK [0m] Started Setup Virtual Console. [ 308s] Starting Dracut Emergency Shell... [ 308s] Warning: /dev/disk/by-uuid/00750419-b769-40be-aa7a-a81dca13c577 does not exist [ 308s] [ 308s] Generating "/run/initramfs/rdsosreport.txt" [ 309s] [ 309s] [ 309s] Entering emergency mode. Exit the shell to continue. [ 309s] Type "journalctl" to view system logs. [ 309s] You might want to save "/run/initramfs/rdsosreport.txt" to a USB stick or /boot [ 309s] after mounting them and attach it to a bug report. [ 309s] [ 309s] [ 355s] dracut:/# ### WATCHDOG TRIGGERED, KILLING VM ### [ 356s] /var/cache/obs/worker/root_3/root: 40802 [ 356s] qemu-system-aarch64: terminating on signal 15 from pid 13075 (fuser) [ 356s] ### VM INTERACTION END ### [ 356s] /var/run/obs/worker/3/build/build-vm: line 458: kill: (40784) - No such process [ 356s] No buildstatus set, either the base system is broken (kernel/initrd/udev/glibc/bash/perl) [ 356s] or the build host has a kernel or hardware problem...
gave up after 11 failed build attempts...
-- Configure notifications at https://build.opensuse.org/user/notifications openSUSE Build Service (https://build.opensuse.org/)
--
- Harald Welte
On Donnerstag, 17. Mai 2018 23:36:18 CEST Harald Welte wrote:
Dear OBS community,
just FYI: It's now one week later, but aarch64 builds are still failing consistently throughout that period until today.
We'll now be disabling our osmocom.org aarch64 builds until further notice, to prevent the dozens of build failure notifications every night.
Thanks again for all your efforts.
Regards, Harald
Hi Harald, you should probably check with Debian, as you can see here:
https://build.opensuse.org/project/monitor?utf8=%E2%9C%93&commit=Filter %3A&succeeded=1&failed=1&unresolvable=1&broken=1&blocked=1&dispatching=1&scheduled=1&building=1&finished=1&signing=1&locked=1&deleting=1&pkgname=osmo&repo_openSUSE_Factory=1&repo_openSUSE_Factory_ARM=1&repo_openSUSE_Factory_PPC=1&repo_openSUSE_Leap_15_0=1&repo_openSUSE_Leap_42_2=1&repo_openSUSE_Leap_42_3=1&arch_aarch64=1&arch_armv7l=1&arch_x86_64=1&project=network %3Atelephony&defaults=0
and e.g. here:
https://build.opensuse.org/project/monitor?utf8=%E2%9C%93&commit=Filter %3A&succeeded=1&failed=1&unresolvable=1&broken=1&blocked=1&dispatching=1&scheduled=1&building=1&finished=1&signing=1&locked=1&deleting=1&pkgname=&repo_SLE_15=1&repo_openSUSE_Factory_ARM=1&repo_openSUSE_Leap_15_0=1&repo_openSUSE_Leap_42_3_Ports=1&repo_openSUSE_Tumbleweed=1&arch_aarch64=1&arch_armv7l=1&arch_i586=1&arch_x86_64=1&project=home %3Amnhauke%3Aosmocom%3Anightly&defaults=0
aarch64 on OBS is fine. Kind regards, Stefan -- Stefan Brüns / Bergstraße 21 / 52062 Aachen home: +49 241 53809034 mobile: +49 151 50412019
participants (2)
-
Harald Welte
-
Stefan Brüns