[Bug 245428] New: Update breaks while drpmsync is running
https://bugzilla.novell.com/show_bug.cgi?id=245428 Summary: Update breaks while drpmsync is running Product: openSUSE 10.3 Version: Alpha 0plus Platform: Other OS/Version: Other Status: NEW Severity: Major Priority: P5 - None Component: Update Problems AssignedTo: bnc-team-screening@forge.provo.novell.com ReportedBy: jpr@novell.com QAContact: jsrain@novell.com I was updating to factory from alpha0plus using System Update and the upddate started breaking with missing packages. Looking at timestamps on the web repo, it appears to have broken while drpmsync is running. System Update should handle that or at least offer to start over. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=245428 mhorvath@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO Info Provider| |jpr@novell.com ------- Comment #1 from mhorvath@novell.com 2007-02-14 08:38 MST ------- Please attach your yast logs. http://en.opensuse.org/Bugs/YaST -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=245428 jpr@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |NEW Info Provider|jpr@novell.com | ------- Comment #2 from jpr@novell.com 2007-02-14 08:59 MST ------- Created an attachment (id=119167) --> (https://bugzilla.novell.com/attachment.cgi?id=119167&action=view) Yast logs -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=245428 mhorvath@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- AssignedTo|bnc-team- |locilka@novell.com |screening@forge.provo.novell| |.com | -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=245428 locilka@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- AssignedTo|locilka@novell.com |bnc-team-screening@forge.provo.novell.com ------- Comment #3 from locilka@novell.com 2007-02-15 08:39 MST ------- grep 404 y2log 2007-02-14 09:56:19 <3> rook(14985) [media] MediaCurl.cc(doGetFileCopy):963 curl error: 22: The requested URL returned error: 404, temp file size 0 byte. 2007-02-14 10:21:47 <3> rook(14985) [media] MediaCurl.cc(doGetFileCopy):963 curl error: 22: The requested URL returned error: 404, temp file size 0 byte. 2007-02-14 10:26:32 <3> rook(14985) [media] MediaCurl.cc(doGetFileCopy):963 curl error: 22: The requested URL returned error: 404, temp file size 0 byte. locilka@miracle:/yast/bugs/245428/YaST2> grep 404 y2log 2007-02-14 09:56:19 <3> rook(14985) [media] MediaCurl.cc(doGetFileCopy):963 curl error: 22: The requested URL returned error: 404, temp file size 0 byte. 2007-02-14 10:21:47 <3> rook(14985) [media] MediaCurl.cc(doGetFileCopy):963 curl error: 22: The requested URL returned error: 404, temp file size 0 byte. 2007-02-14 10:26:32 <3> rook(14985) [media] MediaCurl.cc(doGetFileCopy):963 curl error: 22: The requested URL returned error: 404, temp file size 0 byte. grep -i error y2log | grep -v "404" 2007-02-14 09:55:12 <0> rook(14985) [zypp::GetResolvablesToInsDel] GetResolvablesToInsDel.cc(GetResolvablesToInsDel):129 Ignore auto_delete (should be upgraded): I_TsU[S0:0][package]libgpg-error-1.4-22.i586 2007-02-14 09:55:12 <0> rook(14985) [zypp::GetResolvablesToInsDel] GetResolvablesToInsDel.cc(GetResolvablesToInsDel):129 Ignore auto_delete (should be upgraded): I_TsU[S0:0][package]libgpg-error-devel-1.4-22.i586 2007-02-14 09:55:27 <5> rook(14985) [base] Exception.cc(log):94 PackageProvider.cc(failOnChecksumError):287 THROW: PackageProvider.cc(failOnChecksumError):287: User requested skip of corrupted file 2007-02-14 09:55:27 <5> rook(14985) [base] Exception.cc(log):94 PackageProvider.cc(providePackage):95 RETHROW: PackageProvider.cc(failOnChecksumError):287: User requested skip of corrupted file 2007-02-14 10:18:25 <5> rook(14985) [base] Exception.cc(log):94 PackageProvider.cc(failOnChecksumError):287 THROW: PackageProvider.cc(failOnChecksumError):287: User requested skip of corrupted file 2007-02-14 10:18:25 <5> rook(14985) [base] Exception.cc(log):94 PackageProvider.cc(providePackage):95 RETHROW: PackageProvider.cc(failOnChecksumError):287: User requested skip of corrupted file 2007-02-14 10:18:32 <5> rook(14985) [base] Exception.cc(log):94 PackageProvider.cc(failOnChecksumError):287 THROW: PackageProvider.cc(failOnChecksumError):287: User requested skip of corrupted file 2007-02-14 10:18:32 <5> rook(14985) [base] Exception.cc(log):94 PackageProvider.cc(providePackage):95 RETHROW: PackageProvider.cc(failOnChecksumError):287: User requested skip of corrupted file 2007-02-14 10:21:32 <5> rook(14985) [base] Exception.cc(log):94 PackageProvider.cc(failOnChecksumError):287 THROW: PackageProvider.cc(failOnChecksumError):287: User requested skip of corrupted file 2007-02-14 10:21:32 <5> rook(14985) [base] Exception.cc(log):94 PackageProvider.cc(providePackage):95 RETHROW: PackageProvider.cc(failOnChecksumError):287: User requested skip of corrupted file Wrong assignment, reassigning back. Installation cannot handle such problems, maybe zypp itself. Anyway this seems to be partly just a wrong negotiation between zypp and the installation source (might need enhancements on both sides). -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=245428 ma@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |adrian@novell.com AssignedTo|ma@novell.com |bnc-team-screening@forge.provo.novell.com ------- Comment #4 from ma@novell.com 2007-02-16 04:22 MST ------- No this is something the application must coordinate. The packages on the server don't fit the metadata anymore. You have to offer to reload the sources, redo the selection, resolve and then commit again. Anyway, it would be desirable if the server/mirror would keep the old version of a package a little longer. So running updates have a chance to complete. (Adrian?) -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=245428 mhorvath@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- AssignedTo|bnc-team- |locilka@novell.com |screening@forge.provo.novell| |.com | ------- Comment #5 from mhorvath@novell.com 2007-02-16 06:29 MST ------- Lukas, please see comment #4. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=245428 locilka@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |locilka@novell.com, visnov@novell.com, | |mvidner@novell.com, dmacvicar@novell.com, | |ma@novell.com, jsrain@novell.com AssignedTo|locilka@novell.com |adrian@novell.com ------- Comment #6 from locilka@novell.com 2007-02-16 07:40 MST ------- Please, see this time diagram. Client Server with FACTORY source ------------------------------------------------------------------- [ Start Update ] . [ Select Packages(*) ] . [ Pkg::Solve ] . [ Pkg::Commit ] . . . . . download: bash-45.85.1 [ OK ] . install: bash-45.85.1 [ OK ] . . . . +------------------------------+ . | drpmsync: changes the source | . | new: bash-45.90.2 | . | new: glibc-2.37.0 | . +------------------------------+ . . . . download: glibc-2.35.2 [ Error ] . (Error 404: not found ) . . . . . What to do now? . ------------------------------------------------------------------- (*) select: bash-45.85.1 (requires glibc-2.35.2) select: glibc-2.35.2 select: ... 1.) Zypp doesn't know that the source will be updated (source problem) 2.) Source switches from one to another consistent state but it breaks the pool. Some packages might be installed some needn't (zypp problem - commit without rollback). 3.) Maybe a possibility to offer a source reload and re-solve if there was some time-stamp on the source (zypp would need to check it, callbacks would need to offer reloading the source and returning to the proposal again). This can't be fixed without talk between ZYPP team and Adrian. We expect sources that don't change in time... -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=245428#c8
Christoph Thiel
https://bugzilla.novell.com/show_bug.cgi?id=245428#c9
--- Comment #9 from Peter Poeml
I'd actually propose to close it INVALID or WONTFIX, because there doesn't seem to be a nice way to handle that kind of changes in a repository while installing.
Please let's fix it somehow. The bug is neither invalid, nor should it stay unfixed, if possible, IMO. Offering an option to start over (refreshing metadata) could be all which is needed. IF the drpmsync source is currently being changed with drpmsync however, I suspect that metadata won't be up-to-date anyway. This is an issue with the installation source then, where a refresh in the client will NOT help, because drpmsync causes an inconsistent state in the installation source. This scenario is the reason why we SHOULD use atomic replacement of the installation source (consistent Factory tree synced out to download.opensuse.org), and rsync with the --delete-after. I believe that we do it this way for download.opensuse.org and our mirrors (where we feed them). (Adrian, do we?) I wonder which kind of installation source was used here, and how it could become inconsistent with drpmsync, and I presume that it wasn't download.opensuse.org. Is that right, JP?
Adding Peter to CC, as he might have some input as well, given his recent involvement with the openSUSE download redirector. IIUC, by using the redirector this bug should be way less a problem, because the redirector would redirect you to a mirror (on a file by file basis), that actually has the file. (Even if it already got updated on the main server or servers that we push to.)
The redirector doesn't issue redirects for files that don't exist (on its own filesystem). Using the redirector should fix the issue nevertheless, because the installation source it hosts is not updated in realtime with drpmsync. (Which is the root of the problem.) Even with atomic replacement of the installation source, such a replacement could happen while yast is busy for a while with calculating dependencies, or downloading packages. Thus, it should be fixed to handle this scenario gracefully nevertheless. Allowing the redirector to serve non-existing files (by redirecting to mirrors which might still have them) is not a cure that we count on -- there might be no mirror which has the file. Especially with short-lived Factory sources, this can happen. (I saw this in the past.) Thus, the graceful error handling is required anyway. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=245428#c10
Stanislav Visnovsky
https://bugzilla.novell.com/show_bug.cgi?id=245428#c11
--- Comment #11 from Peter Poeml
https://bugzilla.novell.com/show_bug.cgi?id=245428#c12
--- Comment #12 from JP Rosevear
https://bugzilla.novell.com/show_bug.cgi?id=245428#c13
--- Comment #13 from Peter Poeml
https://bugzilla.novell.com/show_bug.cgi?id=245428
Adrian Schröter
https://bugzilla.novell.com/show_bug.cgi?id=245428#c14
--- Comment #14 from Michael Schröder
https://bugzilla.novell.com/show_bug.cgi?id=245428#c15
--- Comment #15 from Peter Poeml
https://bugzilla.novell.com/show_bug.cgi?id=245428#c16
--- Comment #16 from Peter Poeml
https://bugzilla.novell.com/show_bug.cgi?id=245428#c17
--- Comment #17 from Michael Schröder
https://bugzilla.novell.com/show_bug.cgi?id=245428#c18
--- Comment #18 from Peter Poeml
https://bugzilla.novell.com/show_bug.cgi?id=245428
User poeml@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=245428#c19
--- Comment #19 from Peter Poeml
https://bugzilla.novell.com/show_bug.cgi?id=245428
User poeml@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=245428#c20
--- Comment #20 from Peter Poeml
https://bugzilla.novell.com/show_bug.cgi?id=245428
User kkaempf@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=245428#c21
--- Comment #21 from Klaus Kämpf
https://bugzilla.novell.com/show_bug.cgi?id=245428
User mls@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=245428#c22
--- Comment #22 from Michael Schröder
https://bugzilla.novell.com/show_bug.cgi?id=245428
User kkaempf@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=245428#c23
--- Comment #23 from Klaus Kämpf
https://bugzilla.novell.com/show_bug.cgi?id=245428
User bwhiteley@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=245428#c24
Bart Whiteley
https://bugzilla.novell.com/show_bug.cgi?id=245428
User poeml@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=245428#c25
--- Comment #25 from Peter Poeml
participants (1)
-
bugzilla_noreply@novell.com