[Bug 1190369] New: obs returns incorrect repositiory data forcing all downloads through the API
https://bugzilla.suse.com/show_bug.cgi?id=1190369 Bug ID: 1190369 Summary: obs returns incorrect repositiory data forcing all downloads through the API Classification: Internal Novell Products Product: openSUSE Build Service Version: 2.5 Hardware: Other OS: Other Status: NEW Severity: Normal Priority: P5 - None Component: build process Assignee: mls@suse.com Reporter: william.brown@suse.com QA Contact: adrian.schroeter@suse.com Found By: --- Blocker: --- I noticed that during builds with branched/devel packages, that all downloads were being forced through the OBS API. Examples are devel:languages:rust/rust and home:firstyear:branches:devel:languages:rust/rust. Observing the build XML (./.osc/_buildinfo-openSUSE_Tumbleweed-x86_64.xml) during a local osc build, I noted that repositories were set to "dod". IE: <bdep name="file" version="5.40" release="1.13" arch="x86_64" project="openSUSE:Tumbleweed" repository="dod"/> This causes the package to miss on the download URL, and then forces a full download from the API. However, doing an osc co openSUSE:Factory/<pkg> works correctly and returns valid repo locations (./.osc/_buildinfo-standard-x86_64.xml): <bdep name="libtevent-devel" version="0.10.2" release="1.7" arch="x86_64" project="openSUSE:Factory" repository="standard"/> I have previously been advised that using the API is not recommended due to load on OBS, so I'm wondering if this behaviour is a flaw or bug? -- You are receiving this mail because: You are on the CC list for the bug.
https://bugzilla.suse.com/show_bug.cgi?id=1190369 https://bugzilla.suse.com/show_bug.cgi?id=1190369#c1 Adrian Schr�ter <adrian.schroeter@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Component|build process |BuildService Version|2.5 |unspecified Assignee|mls@suse.com |andrii.nikitin@suse.com Product|openSUSE Build Service |openSUSE.org --- Comment #1 from Adrian Schr�ter <adrian.schroeter@suse.com> --- it is a missing optimisation, because download on demand URLs are not handled automatically. however, this is an osc and download redirector thing in first place. The download redirector could have a rule for openSUSE:Tumbleweed/dod to the same point as it has for openSUSE:Factory/standard already -- You are receiving this mail because: You are on the CC list for the bug.
https://bugzilla.suse.com/show_bug.cgi?id=1190369 https://bugzilla.suse.com/show_bug.cgi?id=1190369#c2 Adrian Schr�ter <adrian.schroeter@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution|--- |FIXED --- Comment #2 from Adrian Schr�ter <adrian.schroeter@suse.com> --- ignore me, this was the old way. We have also a mechanic in OBS meanwhile to map this. I added this repo there now, please verify. -- You are receiving this mail because: You are on the CC list for the bug.
https://bugzilla.suse.com/show_bug.cgi?id=1190369 https://bugzilla.suse.com/show_bug.cgi?id=1190369#c3 --- Comment #3 from William Brown <william.brown@suse.com> --- Doesn't look like this is working. Doing a test again on my branch project. Again, the xml shows the majority of dependencies as dod. -- GET https://download.opensuse.org/repositories/openSUSE:/Tumbleweed/dod/x86_64/l... send: b'GET /repositories/openSUSE:/Tumbleweed/dod/x86_64/liblua5_4-5-5.4.3-4.1.x86_64.rpm HTTP/1.1\r\nAccept-Encoding: identity\r\nHost: download.opensuse.org\r\nUser-agent: osc/0.174\r\nConnection: close\r\n\r\n' reply: 'HTTP/1.1 404 Not Found\r\n' header: Date: Sat, 11 Sep 2021 00:42:40 GMT header: Server: Apache/2.4.43 (Linux/SUSE) header: Vary: accept-language,accept-charset header: Upgrade: h2,h2c header: Connection: Upgrade, close header: Accept-Ranges: bytes header: Transfer-Encoding: chunked header: Content-Type: text/html; charset=utf-8 header: Content-Language: en openSUSE:Tumbleweed/liblua5_4-5: attempting download from api, since not found URLs to try for package 'aaa_base': https://download.opensuse.org/repositories/openSUSE:/Tumbleweed/dod/x86_64/a... -- GET https://download.opensuse.org/repositories/openSUSE:/Tumbleweed/dod/x86_64/a... send: b'GET /repositories/openSUSE:/Tumbleweed/dod/x86_64/aaa_base-84.87+git20210823.4c98889-1.1.x86_64.rpm HTTP/1.1\r\nAccept-Encoding: identity\r\nHost: download.opensuse.org\r\nUser-agent: osc/0.174\r\nConnection: close\r\n\r\n' reply: 'HTTP/1.1 404 Not Found\r\n' header: Date: Sat, 11 Sep 2021 00:42:41 GMT header: Server: Apache/2.4.43 (Linux/SUSE) header: Vary: accept-language,accept-charset header: Upgrade: h2,h2c header: Connection: Upgrade, close header: Accept-Ranges: bytes header: Transfer-Encoding: chunked header: Content-Type: text/html; charset=utf-8 header: Content-Language: en openSUSE:Tumbleweed/aaa_base: attempting download from api, since not found URLs to try for package 'attr': https://download.opensuse.org/repositories/openSUSE:/Tumbleweed/dod/x86_64/a... -- You are receiving this mail because: You are on the CC list for the bug.
https://bugzilla.suse.com/show_bug.cgi?id=1190369 https://bugzilla.suse.com/show_bug.cgi?id=1190369#c4 William Brown <william.brown@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|RESOLVED |REOPENED Resolution|FIXED |--- --- Comment #4 from William Brown <william.brown@suse.com> --- Reopening -- You are receiving this mail because: You are on the CC list for the bug.
https://bugzilla.suse.com/show_bug.cgi?id=1190369 https://bugzilla.suse.com/show_bug.cgi?id=1190369#c5 William Brown <william.brown@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |adrian.schroeter@suse.com Flags| |needinfo?(adrian.schroeter@ | |suse.com) --- Comment #5 from William Brown <william.brown@suse.com> --- Reminder about this issue - it's still occurring that all content is marked as DOD from OSC/OBS. -- You are receiving this mail because: You are on the CC list for the bug.
https://bugzilla.suse.com/show_bug.cgi?id=1190369 https://bugzilla.suse.com/show_bug.cgi?id=1190369#c6 --- Comment #6 from Andrii Nikitin <andrii.nikitin@suse.com> --- I am really not sure how it supposed to work and Lars mentioned in slack that it needs input from Adrian, so I am assigning back. ( https://suse.slack.com/archives/C02BX1X92HM/p1631770513172300 ) It might be a question about how to deliver data from obs to download.o.o , but I still need somebody to explain the problem in more details. -- You are receiving this mail because: You are on the CC list for the bug.
https://bugzilla.suse.com/show_bug.cgi?id=1190369 Andrii Nikitin <andrii.nikitin@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|andrii.nikitin@suse.com |adrian.schroeter@suse.com -- You are receiving this mail because: You are on the CC list for the bug.
https://bugzilla.suse.com/show_bug.cgi?id=1190369 https://bugzilla.suse.com/show_bug.cgi?id=1190369#c7 Adrian Schr�ter <adrian.schroeter@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|adrian.schroeter@suse.com |marco.strigl@suse.com Flags|needinfo?(adrian.schroeter@ | |suse.com) | --- Comment #7 from Adrian Schr�ter <adrian.schroeter@suse.com> --- the config is right from OBS server side and there is nothing to do on the redirector. The problem is within osc, which is ignoring the "url" attributes when trying to download files. It should take that meanwhile and ignore the old downloadurl at the top of the buildinfo. -- You are receiving this mail because: You are on the CC list for the bug.
https://bugzilla.suse.com/show_bug.cgi?id=1190369 https://bugzilla.suse.com/show_bug.cgi?id=1190369#c8 --- Comment #8 from Adrian Schr�ter <adrian.schroeter@suse.com> --- fixed it now here: https://github.com/openSUSE/osc/pull/952 -- You are receiving this mail because: You are on the CC list for the bug.
https://bugzilla.suse.com/show_bug.cgi?id=1190369 https://bugzilla.suse.com/show_bug.cgi?id=1190369#c9 Adrian Schr�ter <adrian.schroeter@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|REOPENED |RESOLVED Resolution|--- |FIXED --- Comment #9 from Adrian Schr�ter <adrian.schroeter@suse.com> --- fixed, just a new osc release missing -- You are receiving this mail because: You are on the CC list for the bug.
participants (1)
-
bugzilla_noreply＠suse.com