openSUSE Build Service November 2020

buildservice@lists.opensuse.org

23 participants
21 discussions

[opensuse-buildservice] Compiler Cache (Ccache) support in Open Build Service

by Sumit Jamgade

Hello, Long running compilation can now leverage ccache[1] to speed up the build process. This feature can be enabled per package in the project config: BuildFlags: useccahe:<packagename> example: https://build.opensuse.org/projects/home:sjamgade:branches:science:machinel… Once enabled per package, it will be enabled for all architectures and repositories. https://openbuildservice.org/help/manuals/obs-user-guide/cha.obs.prjconfig.… (grep ccache) --- The ccache tar file is collected only on *successful builds with changed result*. It is extracted for every build at /.ccache/ if enabled. This build artifact is not versioned and only the latest tar is stored. It can be downloaded from the webui or osc. https://build.opensuse.org/package/binaries/home:sjamgade:branches:science:… osc getbinaries --ccache -M standard home:sjamgade:branches:science:machinelearning tensorflow openSUSE_Tumbleweed x86_64 _ccache.tar osc getbinaries --ccache $prj $pkg $repo $arch _ccache.tar This archive can be further used for local builds too. osc build --pkg-ccache /full/path/to/_ccache. (please use the latest osc) --- Ccache config file is stored in /.ccache/ccache.conf and is writable by the build user. So, it could also be disabled (or configured as per package requirements) echo "disable = true" >> /.ccache/ccache.conf For possible build time comparisons: https://build.opensuse.org/packages/tensorflow:standard/job_history/home:sj… https://w3.nue.suse.com/~sjamgade/ccachereport.html Thank you, Sumit Jamgade and OBS Team [1] - https://ccache.dev/ PS: Some packages (eg: tensorflow) need extra plumbing in spec file to enable access to /.ccache and use of ccache cmd: export CC_PREFIX=ccache; ln -s /.ccache/ ~/.ccache -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe(a)opensuse.org To contact the owner, e-mail: opensuse-buildservice+owner(a)opensuse.org

3 weeks

[opensuse-buildservice] Short OBS downtime this Saturday

by Michael Schroeder

Hi OBS users, we need to do a little database maintenance on Saturday at 21:00 UTC. The buildservice will not be available for about 30 minutes. The build service will still schedule and finish builds in that time, but the API and the Web UI will not be available. Thanks for your understanding and have a nice weekend, Michael. -- Michael Schroeder SUSE Software Solutions Germany GmbH mls(a)suse.de GF: Felix Imendoerffer HRB 36809, AG Nuernberg main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);} -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe(a)opensuse.org To contact the owner, e-mail: opensuse-buildservice+owner(a)opensuse.org

3 weeks

[opensuse-buildservice] handling one thousand source tarballs in one package

by Ludwig Nussel

Hi, I'm trying to build a package from source that uses npm modules. Doing so involves more than one thousand(!) upstream tarballs. In the hope to make that more manageable I wrote a PoC script¹ to produuce a file includable from the spec and to also download the tarballs. Uploading them to OBS as part of the source is rather annoying though as you can't see the forest for all the trees anymore then. So would be convenient if a service like download_files or download_url could do that on server side so the files would be hidden as _service:* AFAICS services do not have access to previously generated results² though so would have to download those files on every source change which seems rather wasteful and also takes time. OTOH there's a hack in OBS to have a cache directory for tar_scm³ only. So would it be possible to either let services access the previous results or have a cache dir for all? Any other ideas how to handle one thousand source tarballs? cu Ludwig [1] https://github.com/lnussel/nodejs-tarballs [2] https://github.com/openSUSE/osc/blob/7b5d10552352295ebdd21193b6dfbf830e7d23… [3] https://github.com/openSUSE/open-build-service/blob/master/src/backend/run-… -- (o_ Ludwig Nussel //\ V_/_ http://www.suse.com/ SUSE Software Solutions Germany GmbH, GF: Felix Imendörffer HRB 36809 (AG Nürnberg) -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe(a)opensuse.org To contact the owner, e-mail: opensuse-buildservice+owner(a)opensuse.org

3 months, 2 weeks

[opensuse-buildservice] CentOS 8 on obs: Different behavior concerning debug packages

by Michael Behrisch

Hi, I am trying to move packages from https://build.opensuse.org/project/show/home:behrisch to https://build.opensuse.org/project/show/science:dlr and get build failures on CentOS 8 although the configuration seems to be identical. The failing project is https://build.opensuse.org/package/show/science:dlr/fox16 which seems to have problems with debuginfos which I tried to disable using %global debug_package %{nil} (this works in my home project). My major question is where does this different behavior come from? Here is what I tried as workarounds: Moving around the define as mentioned here: https://superuser.com/questions/1091529/rpm-build-error-empty-files-file-de… or adding futher defines such as %undefine _debuginfo_subpackages as mentioned here: https://bugzilla.redhat.com/show_bug.cgi?id=1481352 or %define _debugsource_template %{nil} as mentioned here: https://www.getpagespeed.com/server-setup/build-rpms-gotchas. Nothing worked so far. Thanks for your help, Michael

5 months, 1 week

[opensuse-buildservice] Fedora_33 fails to find build deps

by Jürgen Weigert

Hello Geekos! I am puzzled by a Fedora_33 build failure, where Fedora_32 works just fine. https://build.opensuse.org/package/show/isv:ownCloud:Qt5129/ocqt5129-qt5-qt… fails to start with nothing provides ocqt5129-libqt5-qtbase-devel >= 5.12.9, nothing provides ocqt5129-libqt5-qtbase-private-headers-devel >= 5.12.9 Bot subpackages are there, they come from https://build.opensuse.org/package/binaries/isv:ownCloud:Qt5129/ocqt5129-qt… The same setup works for all other distros. No Idea what is going on there, thanks, JW-

5 months, 2 weeks

Fedora33 fails to find build deps

by Jürgen Weigert

5 months, 2 weeks

[opensuse-buildservice] 13556 packages suddenly changed to unresovable?

by Detlef Steuer

Hi! All packages in d:l:R:autoCran turned to state unresolvable because there is choice :-) :-( unresolvable: have choice for xorg-x11-fonts-100dpi needed by R-base: xorg-x11-fonts xorg-x11-fonts-legacy have choice for xorg-x11-fonts-75dpi needed by R-base: xorg-x11-fonts xorg-x11-fonts-legacy have choice for python3 needed by texlive-filesystem: python3 python38 Is this temporarily or will this persist? Do I need to recreate 13556 spec files or not? In case this change is here to stay: How could I have known? How could I have found out beforehand, that such a change is imminent? Where can I read what I have to do now to make the packages build again? All the best Detlef

5 months, 2 weeks

[opensuse-buildservice] Factory/Tumbleweed i586 unresolvable - missing pre/vminstalls: kernel-obs-build

by munix9

On Factory/Tumbleweed i586 many packages get the error "unresolvable - missing pre/vminstalls: kernel-obs-build" when trying to rebuild. See eg. https://build.opensuse.org/project/monitor/multimedia:apps https://build.opensuse.org/project/monitor/devel:languages:php Many home repositories are also affected, too.

5 months, 2 weeks

[opensuse-buildservice] Error Trying to Build Package

by Kyle Edwards

Hello, The SSL certificate I was using on my OBS server recently expired, and had to be replaced with a renewed certificate yesterday. However, even with the renewed certificate, I am having trouble getting packages to build. In the scheduler log, I see the following: 2020-11-19 15:13:43: [1620] looking at high prio cmake/xUbuntu_16.04 (1/0/2/0/2) - cmake/xUbuntu_16.04 scanning repo cmake/xUbuntu_16.04... sorting 2 packages checking packages - cmake-xenial (500 remote error: Internal Server Error) broken: 1 disabled: 1 building: 0, notready: 0, unfinished: 0 took 0 seconds to check the packages leaf prp, freeing data 2020-11-19 15:13:44: [1620] looking at high prio cmake/xUbuntu_20.04 (0/0/2/0/2) - cmake/xUbuntu_20.04 scanning repo cmake/xUbuntu_20.04... sorting 2 packages checking packages - cmake-focal (interconnect error: rpc timeout) broken: 1 disabled: 1 building: 0, notready: 0, unfinished: 0 took 0 seconds to check the packages leaf prp, freeing data 2020-11-19 15:13:44: [1620] looking at low prio cmake/xUbuntu_16.04 (0/0/1/0/2) - cmake/xUbuntu_16.04 scanning repo cmake/xUbuntu_16.04... sorting 2 packages checking packages - cmake-xenial (500 remote error: Internal Server Error) broken: 1 disabled: 1 building: 0, notready: 0, unfinished: 0 took 0 seconds to check the packages leaf prp, freeing data 2020-11-19 15:13:44: [1620] looking at low prio cmake/xUbuntu_20.04 (0/0/0/0/2) - cmake/xUbuntu_20.04 scanning repo cmake/xUbuntu_20.04... sorting 2 packages checking packages - cmake-focal (interconnect error: rpc timeout) broken: 1 disabled: 1 building: 0, notready: 0, unfinished: 0 took 0 seconds to check the packages leaf prp, freeing data Kyle

5 months, 2 weeks

[opensuse-buildservice] rsync acces to built packages broken?

by Harald Welte

Hi! In recent days we've seen a many hours of downtime of not only download.opensuse.org but also mirrors.opensuse.org and status.opensuse.org I'm not complaining, just stating the facts. This caused severe downstream problems for e.g. any CI/CD jobs that try to use the related packages, or builds of Dockerfiles failed, etc. So I thought, in order to be better prepared for possible future incidents, I'd want to create a mirror for the network:osmocom project and it's sub-projects. According to https://en.opensuse.org/openSUSE:Mirror_infrastructure the 'buildservice-repos' module on rsync.opensuse.org contains "The complete content". However, much to my surprise, when I call "rsync rsync.opensuse.org::buildservice-repos/network:/osmocom:/nightly/" I only see some of the distributions (not even all OpenSuSE and Raspobian_10), but not the majority of them (like all our Debian, xUbuntu CentOS builds). This is quite strange, and I'm somewhat surprised given that it's supposedly "The complete content". Is this intentional? Then the wiki page with the description should probably be updated. And in this case: is there some other rsync module that one can use to mirror all of the content of one's project on build.opensuse.org? Or is it a bug? In that case, it would be great if somebody could look into it. Thanks to roox I found a wokr-around: rsync from one of the [few] mirrors that have all of the OBS builds ("repositories") and themselves offer rsync access. Interestingly, that works. But then why do those mirrors get "all" of the content, while the official rsync archive doesn't have it? Here the respective output: ----- $ rsync rsync.opensuse.org::buildservice-repos/network:/osmocom:/nightly/ drwxr-xr-x 4,096 2020/10/29 14:50:01 . drwxr-xr-x 8,192 2020/11/18 11:02:51 Raspbian_10 drwxr-xr-x 121 2020/11/21 02:40:54 openSUSE_Leap_15.1 drwxr-xr-x 141 2020/11/21 04:51:29 openSUSE_Leap_15.1_ARM drwxr-xr-x 121 2020/11/21 02:40:58 openSUSE_Leap_15.2 drwxr-xr-x 137 2020/11/21 02:41:04 openSUSE_Tumbleweed ----- vs. ----- rsync rsync://ftp.gwdg.de/pub/opensuse/repositories/network:/osmocom:/nightly/ drwxr-xr-x 4,096 2020/10/29 14:50:01 . drwxr-xr-x 134 2020/11/21 04:58:31 CentOS_8_Stream drwxr-xr-x 8,192 2020/11/21 06:26:01 Debian_10 drwxr-xr-x 8,192 2020/11/21 02:52:28 Debian_8.0 drwxr-xr-x 8,192 2020/11/21 06:27:13 Debian_9.0 drwxr-xr-x 8,192 2020/11/21 05:03:27 Debian_Testing drwxr-xr-x 8,192 2020/11/21 04:38:53 Debian_Unstable drwxr-xr-x 12,288 2020/11/18 11:02:51 Raspbian_10 drwxr-xr-x 135 2020/11/20 03:01:23 openSUSE_Factory_ARM drwxr-xr-x 116 2020/11/21 02:40:54 openSUSE_Leap_15.1 drwxr-xr-x 135 2020/11/21 04:51:29 openSUSE_Leap_15.1_ARM drwxr-xr-x 116 2020/11/21 02:40:58 openSUSE_Leap_15.2 drwxr-xr-x 131 2020/11/21 02:41:04 openSUSE_Tumbleweed drwxr-xr-x 8,192 2020/10/29 04:09:53 xUbuntu_16.04 drwxr-xr-x 8,192 2020/11/21 02:57:04 xUbuntu_18.04 drwxr-xr-x 8,192 2020/10/29 04:04:55 xUbuntu_18.10 drwxr-xr-x 8,192 2020/11/21 02:54:52 xUbuntu_19.04 drwxr-xr-x 8,192 2020/11/21 02:59:10 xUbuntu_19.10 drwxr-xr-x 8,192 2020/11/21 03:08:48 xUbuntu_20.04 drwxr-xr-x 8,192 2020/11/21 03:09:06 xUbuntu_20.10 ----- Compare the list of distros at rsync -av --delete rsync://ftp.gwdg.de/pub/opensuse/repositories/network:/osmocom: /external/packages/repositories/network\:/ Regards, Harald -- - Harald Welte <laforge(a)gnumonks.org> http://laforge.gnumonks.org/ ============================================================================ "Privacy in residential applications is a desirable marketing option." (ETSI EN 300 175-7 Ch. A6)

5 months, 2 weeks

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

openSUSE Build Service November 2020