[Bug 731090] New: kiwi: rpm-dir repository type does not find packages
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c0 Summary: kiwi: rpm-dir repository type does not find packages Classification: openSUSE Product: openSUSE.org Version: unspecified Platform: Other OS/Version: Other Status: NEW Severity: Normal Priority: P5 - None Component: System Imaging AssignedTo: ms@suse.com ReportedBy: cyberorg@opensuse.org QAContact: adrian@suse.com Found By: --- Blocker: --- User-Agent: Mozilla/5.0 (X11; Linux i686; rv:7.0.1) Gecko/20100101 Firefox/7.0.1 Specifying the following used to work in 11.4, but no longer works in 12.1 <repository type="rpm-md" priority="15"> <source path="/mnt/sdb2/extras/"/> </repository> zypper behaviour when adding Plaindir repo has changed. zypper ar --type Plaindir "/mnt/sdb2/extra/" extra The above works, but the following that is used by kiwi does not: zypper ar --type Plaindir "file:///mnt/sdb2/extra/" extra zypper successfully adds the repo but does not find packages which is also a bug in zypper. Reproducible: Always -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c1 Marcus Schaefer <ms@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO InfoProvider| |ma@suse.com --- Comment #1 from Marcus Schaefer <ms@suse.com> 2011-11-17 16:25:09 UTC --- we tested: /usr/bin/zypper --non-interactive --no-gpg-checks --reposd-dir /var/cache/kiwi/zypper --cache-dir /var/cache/kiwi/zypper --raw-cache-dir /var/cache/kiwi/zypper --config /var/cache/kiwi/zypper/zypper.conf.28042 --root "/mnt/sdb2/edu-second/build/image-root" addrepo -f --type Plaindir '/mnt/sdb2/extras' mnt_sdb2_extras and also /usr/bin/zypper --non-interactive --no-gpg-checks --reposd-dir /var/cache/kiwi/zypper --cache-dir /var/cache/kiwi/zypper --raw-cache-dir /var/cache/kiwi/zypper --config /var/cache/kiwi/zypper/zypper.conf.28042 --root "/mnt/sdb2/edu-second/build/image-root" addrepo -f --type Plaindir 'file:///mnt/sdb2/extras' mnt_sdb2_extras in both cases zypper does not complain and also build the repo cache but did not find any package Interesting enough a simple zypper ar --type Plaindir "/mnt/sdb2/extras/" worked. I have no clue what's going on here, zypper on 11.4 has no problems with this need help from the zypper people Thanks -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c2 --- Comment #2 from Michael Andres <ma@suse.com> 2011-11-18 09:17:16 CET --- Please attach the zypper logfile /var/log/zypper.log (or an older /var/log/zypper.log-YYYYMMDD.bz2) that shows the reported behavior. You can execute 'grep main.cc /var/log/zypper.log' (or 'zgrep main.cc /var/log/zypper.log-YYYYMMDD.bz2') to see execution dates and commands the log contains. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c3 Michael Andres <ma@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |NEW InfoProvider|ma@suse.com | --- Comment #3 from Michael Andres <ma@suse.com> 2011-11-18 10:01:34 CET --- By now I can't verify this. The only difference seems to be the url schema (dir vs. file). But both work for me as they should: $ zypper ar --type Plaindir /Local/Repo/ extra ...URI: dir:///Local/Repo $ zypper ar --type Plaindir file:///Local/Repo/ extra2 ...URI: file:/Local/Repo/ $ zypper ref extra extra2 Retrieving repository 'extra' metadata [done] Building repository 'extra' cache [done] Retrieving repository 'extra2' metadata [done] Building repository 'extra2' cache [done] Specified repositories have been refreshed. $ zypper se -s -r extra -r extra2 | Name | Type | Version | Arch | Repository --+---------------------+------------+----------------+--------+----------- v | WindowMaker | package | 0.94.0.crm-208 | x86_64 | extra v | WindowMaker | package | 0.94.0.crm-208 | x86_64 | extra2 ... - And also downloading the packages. - And also the same with 'zypper --root /tmp/T' incl. download - And also the call from comment#1, just whithout the --config. So maybe your config is broken? -- Apropos config! Maybe you hit the same bug in zyppers augeas lense I did a few days ago: ## Valid values: remove, install, update, patch, verify ## Default value: remove # forceResolutionCommands = remove forceResolutionCommands = install The above does not work. Zypper treats it as multiple definition of 'forceResolutionCommands' (one commented and one uncommented), and falls back to it's default (and not to the uncommented one). You have to use: ## Valid values: remove, install, update, patch, verify ## Default value: remove forceResolutionCommands = install I fixed this together with bnc#715057. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c4 --- Comment #4 from Michael Andres <ma@suse.com> 2011-11-18 10:05:55 CET --- (AFAIK Coolo do not (yet) pick the above fix for 12.1, still factory only) -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c5 Marcus Schaefer <ms@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO InfoProvider| |cyberorg@opensuse.org --- Comment #5 from Marcus Schaefer <ms@suse.com> 2011-11-18 09:15:00 UTC --- ok so let's try without a config and see if that causes the trouble but basically in that case I think the config is only [main] and nothing more @Cyberorg: can you do the following test: 1. edit the file /usr/share/kiwi/modules/KIWIManager.pm 2. search for '--config' you will find two places in the code looking like this: ... "--raw-cache-dir $dataDir", "--config $zypperConf" 3. remove the --config option from the code so that it looks like this ... "--raw-cache-dir $dataDir" BTW: the ',' is important ;) 4. call kiwi again and see if that makes a difference Thanks -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c6 --- Comment #6 from Michael Andres <ma@suse.com> 2011-11-18 11:25:54 CET --- (...and please attach the zypper.log in case it fails.) -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c7 --- Comment #7 from Jigish Gohil <cyberorg@opensuse.org> 2011-11-21 08:03:19 UTC --- Created an attachment (id=463086) --> (http://bugzilla.novell.com/attachment.cgi?id=463086) zypper log With --config... removed in config.xml <repository type="rpm-dir" priority="15"> <source path="/mnt/sdb2/extras/"/> </repository> -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c8 Jigish Gohil <cyberorg@opensuse.org> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |NEW InfoProvider|cyberorg@opensuse.org | --- Comment #8 from Jigish Gohil <cyberorg@opensuse.org> 2011-11-21 08:04:22 UTC --- Created an attachment (id=463087) --> (http://bugzilla.novell.com/attachment.cgi?id=463087) kiwibuild-rpm-dir.log -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c Marcus Schaefer <ms@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO InfoProvider| |ma@suse.com -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c9 Michael Andres <ma@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |NEW InfoProvider|ma@suse.com | --- Comment #9 from Michael Andres <ma@suse.com> 2011-11-22 18:09:11 CET --- The zypper.log seems to be from the 'outer' system; in kiwibuild-rpm-dir.log: Nov-21 13:30:44..EXEC [/usr/bin/zypper ... and it shows 4389/654 items in the repos: $ grep addSolv bug-731090_zypper-rpm-dir.log ...sat::repo(mnt_12.1){prio 0.0, size 4389} \ after adding /var/cache/kiwi/zypper/solv/mnt_12.1/solv ...sat::repo(mnt_sdb2_extras){prio 0.0, size 654} \ after adding /var/cache/kiwi/zypper/solv/mnt_sdb2_extras/solv which is probably OK? But your problem seems to be located in the 'inner' chrooted calls: Nov-21 13:31:46..EXEC [chroot "/mnt/sdb2/edu-rpm-dir/build/image-root" zypper @Markus: The kiwibuild log says Nov-21 13:31:45 <1> : EXEC [mount -t unionfs ...\ /mnt/sdb2/edu-rpm-dir/build/image-root//base-system/mnt/sdb2/extras 2>&1] skipped Is skipped==failed? Are you sure the directory (/mnt/sdb2/edu-rpm-dir/build/image-root)/base-system/mnt/sdb2/extras actually contains the packages which are missing? If so, I'd need the 'inner' (/mnt/sdb2/edu-rpm-dir/build/image-root)/var/log/zypper.log to see if zypper has any additional hint. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c10 Marcus Schaefer <ms@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO InfoProvider| |cyberorg@opensuse.org Severity|Normal |Major --- Comment #10 from Marcus Schaefer <ms@suse.com> 2011-11-22 17:56:34 UTC --- no skipped just means the union mount was skipped (mostly because no unionfs) kiwi then switches to a bind mount at the end. You can see that in the log as well Couldn't mount read-only, using bind mount Nov-21 13:31:45 <1> : EXEC [mount -o bind "/mnt/sdb2/extras" "/mnt/sdb2/edu-rpm-dir/build/image-root//base-system/mnt/sdb2/extras" 2>&1] done So this seemed to work fine @cyberorg: can you check if the bind of the local repo also contains the packages it's a bit weird that you placed the rpm-dir repo in '/mnt/sdb2/extras' and the image buildroot in the same dir '/mnt/sdb2/edu-rpm-dir' but I don't see why it should not work -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c Marcus Schaefer <ms@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Priority|P5 - None |P3 - Medium Severity|Major |Normal -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c11 --- Comment #11 from Marcus Schaefer <ms@suse.com> 2011-11-22 18:00:33 UTC --- btw, when creating metadata (createrepo) in the rpm-dir and using it as an rpm-md the same bind mount call happens in kiwi and zypper has no problems working with the repo. So I don't think the bind mounts from the outer to the inner system are the problem -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c12 Jigish Gohil <cyberorg@opensuse.org> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |NEW InfoProvider|cyberorg@opensuse.org | --- Comment #12 from Jigish Gohil <cyberorg@opensuse.org> 2011-11-23 04:02:21 UTC --- manually running mount -o bind "/mnt/sdb2/extras" "/mnt/sdb2/edu-rpm-dir/build/image-root//base-system/mnt/sdb2/extras chroot zypper.log attached -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c13 --- Comment #13 from Jigish Gohil <cyberorg@opensuse.org> 2011-11-23 04:03:53 UTC --- Created an attachment (id=463549) --> (http://bugzilla.novell.com/attachment.cgi?id=463549) chroot zypper.log -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c14 --- Comment #14 from Jigish Gohil <cyberorg@opensuse.org> 2011-11-23 04:07:16 UTC --- .. comment #12 ... manually bind mounting shows all packages. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c15 Marcus Schaefer <ms@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO InfoProvider| |ma@suse.com --- Comment #15 from Marcus Schaefer <ms@suse.com> 2011-11-24 08:12:57 UTC --- so the mount is not the problem Michael can you check the zypper log in comment #13 I don't see what kiwi does wrong here Thanks -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c16 --- Comment #16 from Michael Andres <ma@suse.com> 2011-11-24 13:38:08 CET --- Basically bug #732518: cache cleanup. Now I see it: '--reposd-dir' '/var/cache/kiwi/zypper' '--cache-dir' '/var/cache/kiwi/zypper' '--raw-cache-dir' '/var/cache/kiwi/zypper' It's not good to use the same dir for multiple caches. Cleanup in one cache will damage the others. E.g cleaning the raw-cache leads to: recursive_rmdir /var/cache/kiwi/zypper/mnt_12.1 recursive_rmdir /var/cache/kiwi/zypper/mnt_sdb2_extras recursive_rmdir /var/cache/kiwi/zypper/packages <== package cache recursive_rmdir /var/cache/kiwi/zypper/solv <== solv files recursive_rmdir /var/cache/kiwi/zypper/zypp.conf.31542 FAILED: (20)Not a directory recursive_rmdir /var/cache/kiwi/zypper/zypper.conf.31542 FAILED: (20)Not a directory What about: '--reposd-dir' '/var/cache/kiwi/zypper/repos' '--cache-dir' '/var/cache/kiwi/zypper' This will give you: /var/cache/kiwi/zypper/repos/ / /<per repo>.repo / /packages/ / /<per repo>/...rpm packages / /solv/ / /<per repo>/...solv files / /raw/ /<per repo>/...raw metadata -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c Michael Andres <ma@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |NEW InfoProvider|ma@suse.com | -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c17 Michael Andres <ma@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |ms@suse.com --- Comment #17 from Michael Andres <ma@suse.com> 2011-11-24 14:47:26 CET --- *** Bug 732518 has been marked as a duplicate of this bug. *** http://bugzilla.novell.com/show_bug.cgi?id=732518 -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c18 Marcus Schaefer <ms@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution| |FIXED --- Comment #18 from Marcus Schaefer <ms@suse.com> 2011-11-24 14:27:32 UTC --- Looks like changing the structure and preventing cache-dir to be equal to raw-cache-dir fixed it. Thanks much -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=731090 https://bugzilla.novell.com/show_bug.cgi?id=731090#c19 Matthias Hopf <mat@mshopf.de> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|RESOLVED |VERIFIED --- Comment #19 from Matthias Hopf <mat@mshopf.de> 2011-11-28 01:52:38 UTC --- This is verified to be fixed with kiwi 5.01.4. Thanks all! -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
participants (1)
-
bugzilla_noreply＠novell.com