[Bug 238095] New: libzypp (zypper/YaST) can't add certain repos anymore
https://bugzilla.novell.com/show_bug.cgi?id=238095 Summary: libzypp (zypper/YaST) can't add certain repos anymore Product: openSUSE 10.2 Version: Final Platform: All OS/Version: Other Status: NEW Severity: Major Priority: P5 - None Component: libzypp AssignedTo: kkaempf@novell.com ReportedBy: wolfgang@rosenauer.org QAContact: kkaempf@novell.com Yesterday I wanted to run YOU but it only was hanging at some point (on two different machines). I tried zypper afterwards which stopped with "Failed to restore ..." When I ran yast2 inst_source two of my buildservice repositories were reported as not accessible and were removed from my repo-list. Afterwards YOU and zypper was working again. Now the problem is, that I can't add those repos again: Hygiea:~ # zypper sa http://software.opensuse.org/download/openSUSE:/Tools/openSUSE_10.2 bs-tools Determining http://software.opensuse.org/download/openSUSE:/Tools/openSUSE_10.2 source type... http://software.opensuse.org/download/openSUSE:/Tools/openSUSE_10.2 is type YUM Unknown Error: Downloading metadata failed (is YUM source?) or user did not accept remote source. Aborting refresh. YaST fails with the same error. I'll attach zypper.log. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 ------- Comment #1 from wolfgang@rosenauer.org 2007-01-24 03:02 MST ------- Created an attachment (id=114590) --> (https://bugzilla.novell.com/attachment.cgi?id=114590&action=view) zypper.log -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 ------- Comment #2 from wolfgang@rosenauer.org 2007-01-24 03:26 MST ------- It's really interesting since the above happens on two different machines with 10.2 and the same repos added. So something not local to the machines triggered an error in libzypp and caused some corruption. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 ------- Comment #3 from wolfgang@rosenauer.org 2007-01-29 00:12 MST ------- Hmm, someone has any suggestion how to it to work again? Maybe zypp only gets confused very seldom and so this issue is not of high priority but for me it is. So any idea how to fix the current zypp state at least as a workaround? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 ------- Comment #4 from wolfgang@rosenauer.org 2007-01-29 05:48 MST ------- As it just came up on IRC: I never ever had ZMD/rug installed on these systems. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 mvidner@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |ASSIGNED ------- Comment #5 from mvidner@novell.com 2007-01-29 06:19 MST ------- 2007-01-24 11:00:34 <5> Hygiea(8180) [base] Exception.cc(log):94 SourceImpl.cc(getPossiblyCachedMetadataFile):400 THROW: SourceImpl.cc(getPossiblyCachedMetadataFile):400: http://software.opensuse.org/download/openSUSE:/Tools/openSUSE_10.2./repodat... fails checksum verification. But the checksum seems fine nevertheless. Puzzling. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 hmuelle@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- Status|ASSIGNED |NEEDINFO Info Provider| |cthiel@novell.com ------- Comment #6 from hmuelle@novell.com 2007-01-29 06:23 MST ------- Christoph, could it be related to the redirector of openSUSE? Getting files from various hosts which are not 100% in sync? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 ------- Comment #7 from mvidner@novell.com 2007-01-29 06:26 MST ------- Aha, it has indeed succeeded on the third try for me. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 ------- Comment #8 from wolfgang@rosenauer.org 2007-01-29 06:39 MST ------- I've now used ftp://ftp4.gwdg.de/pub/opensuse/repositories/openSUSE:/Tools/openSUSE_10.2 and it worked. So yes, it seems to be a redirector problem. Interesting is that it happened only for the above two repositories for me. (I have tried others and they worked the first time). Strange behaviour at least. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 jonharson@gmail.com changed: What |Removed |Added ---------------------------------------------------------------------------- OtherBugsDependingO| |239483 nThis| | -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 ------- Comment #9 from poeml@novell.com 2007-01-29 10:01 MST ------- It is not directly related to the redirector. It is related to the fact that we don't set sensible cache controlling headers. (Assuming that the mirrors have exact copies.) We now set cache-control: no-cache, must-revalidate headers on repo-md files, on repos.opensuse.org. However, mirrors that don't do that could still serve files which are cached even though they are outdated. Thus, we need to find a way to cooperate with our mirrors so they also set those header (or don't mirror those files so they are always served by us...). -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 cthiel@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |ASSIGNED Info Provider|cthiel@novell.com | ------- Comment #10 from cthiel@novell.com 2007-01-29 12:15 MST ------- Harald, the redirector implements some kind of "session handling" to make sure to redirector the user to only one mirror for those kind of metadata files. However, as Peter already elaborated, we seem to be hitting some nasty caching-related problems right now. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 mvidner@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|libzypp (zypper/YaST) can't |libzypp (zypper/YaST) can't add certain repos |add certain repos anymore |anymore (mirrors out of sync) -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 poeml@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- Status|ASSIGNED |RESOLVED Resolution| |FIXED ------- Comment #11 from poeml@novell.com 2007-01-31 07:57 MST ------- Meanwhile I'm pretty sure that most issues referenced here are not caused by inconsistent mirrors, or the fact that we redirect things, but rather to caching of repo metadata by web caches in between. Meanwhile, we set an appropriate Cache-Control header on those repo metadata which are frequently re-created by the buildservice. Today, I added Expires header also, just in case that cache doesn't implement Cache-Control, (or some client software like zypper, yum, smart) makes their own caching decision and doesn't have a complete implementation. The fact that we redirect comes _only_ into play because if metadata is pulled from a mirror, because on mirrors we have no influence on the HTTP headers, and can't fix them as described above. Thus, since 2007-01-29 18:20:53 +0100 we are no longer redirecting metadata requests to mirrors at all. For packages it should not matter that much, whether they get stale or mirrors are inconsistent, because the filename is altered at each rebuild. A squid with default configuration will deliver HTTP content from cache without revalidation up to 72 hours, so please allow some time for our latest changes to become effective. By the way, all this just displays how well the integrity checking of repositories is done :) I'm regarding the bug fixed; please reopen if the problem persists. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 poeml@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |novell@spinink.net ------- Comment #12 from poeml@novell.com 2007-01-31 11:54 MST ------- *** Bug 239483 has been marked as a duplicate of this bug. *** -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 jkupec@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |casualprogrammer@yahoo.com ------- Comment #13 from jkupec@novell.com 2007-05-10 12:57 MST ------- *** Bug 251275 has been marked as a duplicate of this bug. *** -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 jkupec@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |jkupec@novell.com Status|RESOLVED |REOPENED Resolution|FIXED | ------- Comment #14 from jkupec@novell.com 2007-05-10 13:00 MST ------- (In reply to comment #11)
The fact that we redirect comes _only_ into play because if metadata is pulled from a mirror, because on mirrors we have no influence on the HTTP headers, and can't fix them as described above. Thus, since 2007-01-29 18:20:53 +0100 we are no longer redirecting metadata requests to mirrors at all.
According to bug 251275, this seems not to be true. Problems persist. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 jkupec@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |aj@novell.com AssignedTo|mvidner@novell.com |poeml@novell.com Status|REOPENED |NEW ------- Comment #15 from jkupec@novell.com 2007-05-10 13:07 MST ------- Peter, reassigning the bug to you, please reassign as/if needed. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 jkupec@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |trango@tiscali.ch ------- Comment #16 from jkupec@novell.com 2007-05-10 13:13 MST ------- *** Bug 239625 has been marked as a duplicate of this bug. *** -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 ------- Comment #17 from jkupec@novell.com 2007-05-10 13:16 MST ------- Why do we do these redirects, anyway? To pick up the best mirror for each file accessed? What about redirect just once per session (to just one mirror)? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 ------- Comment #18 from casualprogrammer@yahoo.com 2007-05-10 13:24 MST ------- The idea as such seems brilliant, you only need to register one source, then depending on load or whatever, you distribute the requests to all available servers subsequently. Problem is, how is synchronicity checked and used as selection criterion. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=238095 poeml@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution| |FIXED ------- Comment #19 from poeml@novell.com 2007-05-10 16:39 MST ------- Thanks for reopening the bug. Testing with the media file referenced in bug 251275, I found that I did a mistake. In my last attempt to fix this, I added a ZrkadloExcludeFileMask for the Factory tree, matching on files which do not contain digits. However, the expression was erroneously written to match on the entire request URI, instead of the last path component. - ZrkadloExcludeFileMask "^[^0-9]*$" + ZrkadloExcludeFileMask "/[^0-9]*$" Sorry, my bad. It didn't become apparent in my testing, because I didn't test with URIs which t contain digits, like it is the case for the the media.1 directory... -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
participants (1)
-
bugzilla_noreply＠novell.com