[Bug 477690] New: osc fetching binaries really slow
https://bugzilla.novell.com/show_bug.cgi?id=477690 Summary: osc fetching binaries really slow Classification: openSUSE Product: openSUSE.org Version: unspecified Platform: Other OS/Version: Other Status: NEW Severity: Normal Priority: P5 - None Component: BuildService AssignedTo: bnc-team-screening@forge.provo.novell.com ReportedBy: dmueller@novell.com QAContact: adrian@novell.com Found By: --- it looks like in osc 0.112 it can not really cache the ichain cookie anymore. osc co openSUSE:Factory/libqca2 osc build staging x86_64 this has to fetch a lot of build packages from api.opensuse.org, and every fetch takes around 2s to process. looking at osc -H build output, it seems like it does the ichain authentication everytime because it gets everytime the HTTP/401 unauthorized back. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=477690
User suse-tux@gmx.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=477690#c1
Marcus Hüwe
https://bugzilla.novell.com/show_bug.cgi?id=477690
User dmueller@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=477690#c2
--- Comment #2 from Dirk Mueller
https://bugzilla.novell.com/show_bug.cgi?id=477690
User suse-tux@gmx.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=477690#c3
--- Comment #3 from Marcus Hüwe
no, it doesn't seem to be that "easy". api.opensuse.org sets a cookie on ".opensuse.org", that is not sent back when asking api.opensuse.org again it seems there is a bug in the cookie library here.
A new cookie is only send back if you get a 401 and authenticate with your credentials. If you afterwards send a new request to the api the cookie is used and no new cookie is send back. In this case the old cookie is kept and will be used until the cookie has expired. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=477690
User suse-tux@gmx.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=477690#c4
--- Comment #4 from Marcus Hüwe
https://bugzilla.novell.com/show_bug.cgi?id=477690
User suse-tux@gmx.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=477690#c5
--- Comment #5 from Marcus Hüwe
https://bugzilla.novell.com/show_bug.cgi?id=477690
User dmueller@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=477690#c6
--- Comment #6 from Dirk Mueller
https://bugzilla.novell.com/show_bug.cgi?id=477690
User suse-tux@gmx.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=477690#c7
--- Comment #7 from Marcus Hüwe
it looks like the binary server is just overloaded with that many individual requests. can we add api support for the cpio download to fetch all binaries in one go? This is already possible via the public/ route, e.g.: https://api.opensuse.org/public/build/openSUSE:11.1/standard/i586/_repository?view=cpio&binary=sed&binary=gawk Would this speed up the download process? It shouldn't be too hard to implement it.
-- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=477690
Cyril Hrubis
https://bugzilla.novell.com/show_bug.cgi?id=477690
User dmueller@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=477690#c8
--- Comment #8 from Dirk Mueller
https://bugzilla.novell.com/show_bug.cgi?id=477690
User suse-tux@gmx.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=477690#c9
--- Comment #9 from Marcus Hüwe
https://bugzilla.novell.com/show_bug.cgi?id=477690
User suse-tux@gmx.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=477690#c10
--- Comment #10 from Marcus Hüwe
https://bugzilla.novell.com/show_bug.cgi?id=477690
User suse-tux@gmx.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=477690#c11
--- Comment #11 from Marcus Hüwe
participants (1)
-
bugzilla_noreply@novell.com