[Bug 216131] New: Installation Source metadata too large.
https://bugzilla.novell.com/show_bug.cgi?id=216131 Summary: Installation Source metadata too large. Product: openSUSE 10.2 Version: Beta 1 Platform: Other OS/Version: Other Status: NEW Severity: Enhancement Priority: P5 - None Component: YaST2 AssignedTo: bnc-team-screening@forge.provo.novell.com ReportedBy: robin.knapp@fujitsu-siemens.com QAContact: jsrain@novell.com Adding an installation source takes too long. Currently, packages and packages.DU have about 16MB for each file. Each time an installation source is refreshed, all files are downloaded again (about 50MB for factory). This process should be optimized. Fore example gzip compresses "packages" to about 2.5MB. Also each time the YaST2 installation sources dialog is called and the source is set to auto refresh, the complete metadata is downloaded again and this process cannot be interrupted. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=216131 aj@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- AssignedTo|bnc-team- |visnov@novell.com |screening@forge.provo.novell| |.com | -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=216131 judas_iscariote@shorewall.net changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |judas_iscariote@shorewall.net ------- Comment #1 from judas_iscariote@shorewall.net 2006-10-29 15:54 MST ------- Stanislav : is there a reason why it is not already bzip'ed ?? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=216131 ------- Comment #2 from andreas.hanke@gmx-topmail.de 2006-10-29 16:06 MST ------- I have an intuition that adding metadata compression support at this point will introduce new seg-faults into the installer, so that you would maybe get smaller metadata if the installation would not abort and leave your hard disk in a mess. The installation is officially feature-frozen since Oct 5th (3 weeks already). So let's please do it later. Note that the lack of compression does not really matter too much for the released product because the large base inst-source never changes. The statement in comment 0 is partially false because if an installation source did not change since the last refresh, YaST downloads only the 42 Bytes large "media" file and not everything, even if the source is set to autorefresh. Patch sources (with YUM metadata) are the only ones which ever change for a released product, and these are already compressed. So the only point where it would make a difference is the first time you add the large base inst-source. This does not justify the risks of such a late change IMHO. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=216131 ------- Comment #3 from andreas.hanke@gmx-topmail.de 2006-10-29 16:15 MST ------- Before I forget: Adding whatever compression you have in mind now will also break smart, because the yast2 channel implementation of smart relies on the uncompressed metadata as described in the documentation. yast2 metadata are no longer under the exclusive control of SUSE, you can't do such a change now. It's unacceptable because too late. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=216131 ------- Comment #4 from robin.knapp@fujitsu-siemens.com 2006-10-30 02:41 MST ------- (In reply to comment #2)
Note that the lack of compression does not really matter too much for the released product because the large base inst-source never changes.
Okay, I agree. That's mainly a "problem" with factory, I think.
The statement in comment 0 is partially false because if an installation source did not change since the last refresh, YaST downloads only the 42 Bytes large "media" file and not everything, even if the source is set to autorefresh. Patch sources (with YUM metadata) are the only ones which ever change for a released product, and these are already compressed. So the only point where it would make a difference is the first time you add the large base inst-source.
Well, I might have triggered a bug. Everytime I called the installation source dialogue, the metadata was reloaded again... Tried it three times consecutively iirc. Then after removing and re-adding the installation source, it did not refresh everything (only the media information). That's okay. But then I opened the software installation dialogue and it started to reload everything again. Maybe there's a bug in zmd/libzypp caching. This evening I will remove all sources, add the factory tree, refresh the media information (to verify the cache ist ok) and then check if it's loaded again on opening the software installation dialogue. If it will reload everything again (cache miss?), I'll attach the y2base and zmd logfiles.
This does not justify the risks of such a late change IMHO.
Agreed. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=216131 ------- Comment #5 from robin.knapp@fujitsu-siemens.com 2006-10-30 14:30 MST ------- Tested again. Seems to be stable now without automatic refreshing all the time and each call. However it would be nice to see compressed metadata in future releases. An idea would be to publish both compressed and uncompressed (for compatibility) metadata (the compressed (gzip) is just 11MB for factory, so this won't eat up much space but will save a lot of traffic). -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=216131 kkaempf@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution| |LATER ------- Comment #7 from kkaempf@novell.com 2007-02-27 03:04 MST ------- Will be fixed in a future product -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=216131#c8
--- Comment #8 from Robin Knapp
https://bugzilla.novell.com/show_bug.cgi?id=216131#c9
Klaus Kämpf
https://bugzilla.novell.com/show_bug.cgi?id=216131#c10
--- Comment #10 from Klaus Kämpf
https://bugzilla.novell.com/show_bug.cgi?id=216131#c11
Klaus Kämpf
participants (1)
-
bugzilla_noreply@novell.com