January 2021 - openSUSE Build Service - openSUSE Mailing Lists

[opensuse-buildservice] handling one thousand source tarballs in one package
by Ludwig Nussel 22 Jan '21

22 Jan '21

Hi, I'm trying to build a package from source that uses npm modules. Doing so involves more than one thousand(!) upstream tarballs. In the hope to make that more manageable I wrote a PoC script¹ to produuce a file includable from the spec and to also download the tarballs. Uploading them to OBS as part of the source is rather annoying though as you can't see the forest for all the trees anymore then. So would be convenient if a service like download_files or download_url could do that on server side so the files would be hidden as _service:* AFAICS services do not have access to previously generated results² though so would have to download those files on every source change which seems rather wasteful and also takes time. OTOH there's a hack in OBS to have a cache directory for tar_scm³ only. So would it be possible to either let services access the previous results or have a cache dir for all? Any other ideas how to handle one thousand source tarballs? cu Ludwig [1] https://github.com/lnussel/nodejs-tarballs [2] https://github.com/openSUSE/osc/blob/7b5d10552352295ebdd21193b6dfbf830e7d23… [3] https://github.com/openSUSE/open-build-service/blob/master/src/backend/run-… -- (o_ Ludwig Nussel //\ V_/_ http://www.suse.com/ SUSE Software Solutions Germany GmbH, GF: Felix Imendörffer HRB 36809 (AG Nürnberg) -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe(a)opensuse.org To contact the owner, e-mail: opensuse-buildservice+owner(a)opensuse.org

3 10

triggers for debian builds
by Mark Olesen 19 Jan '21

19 Jan '21

Last week was my first foray into using OBS to build Debian (Ubuntu) packages. Largely OK by following the wiki (https://en.opensuse.org/openSUSE:Build_Service_Debian_builds) However I did run into a small inconsistency with requirement between Ubuntu versions, which I attempted to resolve according to the example: - wonderproj-xUbuntu_10.10.dsc - wonderproj_0.0.1-1.debian.tar.gz - wonderproj_0.0.1.orig.tar.bz2 In my case I augmented the regular dsc file with one for Ubuntu 20.04. For example, openfoam2012_1-2.dsc openfoam2012_1-2.debian.tar.xz openfoam2012_1.orig.tar.gz openfoam2012-xUbuntu_20.04.dsc which promptly prevent anything from building. Removing the openfoam2012-xUbuntu_20.04.dsc file and it builds for xUbuntu_18.04 and xUbuntu_20.10 without problem (the 20.04 still complains about missing gfortran). One guess is that the repo-specific dsc file should actually also include the project version, or I could just add in the gfortran to the base dsc file and go from there. In any case, I would like to understand where the "magic" is encapsulated and fix my input and/or the wiki accordingly. Cheers, /mark

1 0

integrate as a dependency a project .
by Renato _ 18 Jan '21

18 Jan '21

Hello there, I need help. I have my proper obs infra. all is working fine. small question regarding package dependancie. How can I integrate as a dependency a package(from another project) on my working project that needs to be built. to understand here, an example: ** A package built and available under difference OS: Open Build Service > Projects > go > golang-1.13 - repo: ubuntu 20 centos 7 ** my personal project not yet built: it has on the: Open Build Service > Projects > FooProject > SuperPackage-0.1 > _service:extract_file:superpackage.dsc file "* Build-Depends: debhelper (>= 9), golang-1.13" How to When OBS spawn the built , makes available the package golang-1.13 to my build SuperPackage? Thank you very much , -t

1 0

dial tcp: lookup proxy.golang.org [..] connection refused
by Michael Ströder 16 Jan '21

16 Jan '21

HI! I'm trying to build a Go package on https://build.opensuse.org and it seems the Go modules are downloaded via proxy.golang.org. Some packages seem to download just fine but one fails: dial tcp: lookup proxy.golang.org on [::1]:53: read udp [::1]:58763->[::1]:53: read: connection refused I guess the DNS resolver trys to switch to TCP but this gets blocked. Never built a Go package before so I'm not sure whether it's correct [1]. Ciao, Michael. [1] https://build.opensuse.org/package/show/home:stroeder:network/galene

3 7

TCP Port Listening on Workers
by Kyle Edwards 14 Jan '21

14 Jan '21

Hello, In my OBS setup, I've split the workers off from the main server. One of the things I've found is that the workers listen on a port for connections from the OBS server. However, this makes setups involving DMZs more difficult. Is it possible to configure the workers to not listen for connections, and instead establish a long-running connection to the OBS server to listen for build commands, so that the workers only establish outgoing connections and not incoming connections? Kyle

2 1

Nightly builds with OBS
by Axel Braun 13 Jan '21

13 Jan '21

HI, I would like to set-up a nightly build for one package by pulling latest stuff from gitlab and running a build process. Is there a kind of cron available on OBS to trigger the service run? Or do I have to trigger this from external? Thanks Axel

6 7

converting obscpio -> tar
by Axel Braun 13 Jan '21

13 Jan '21

Hi, as a prerequsite to the nightly build, I'm struggeling with the source service. I guess its a no-brainer for somebody who worked already with it... I have pulled the latest commit using obs_scm: <service name="obs_scm"> <param name="url">https://mygitpage.com/myproject.git</param> <param name="scm">git</param> <param name="versionformat">VERSIONgit.%ci~%h</param> </service> and end up with .obscpio file in my build repo. How can I conver this to a .tar file? I tried recompress-service, but that gives me a .obscpio.gz :-) I have searched the wiki https://en.opensuse.org/ openSUSE:Build_Service_Concept_SourceService#All_OBS_services_available and OBS manuals, and I feel it needs some love: - obs_scm is not mentioned at all in the above list - the documentation mostly points to the github page - and the github page is not very helpful either (unless 'The code is the documentation' is considered as approach) Example: https://en.opensuse.org/ openSUSE:Build_Service_Concept_SourceService#recompress https://en.opensuse.org/Category:Build_Service gives some insights as well, but misses proper documentation Just seen: osc api /service (will look further into that) Thanks Axel

8 12

remove inactive user?
by Ludwig Nussel 13 Jan '21

13 Jan '21

Hi, Trying to ping https://build.opensuse.org/users/gberh about a request that was not processed for two months (849612) I found the mail bouncing. Is there a way to check if a user is active at all despite invalid mail address and act according to that? Ie retire the account and remove from all projects/packages if really inactive? Or if still active somehow warn/suspend so the user is forced to add a valid mail again? cu Ludwig -- (o_ Ludwig Nussel //\ V_/_ http://www.suse.com/ SUSE Software Solutions Germany GmbH, GF: Felix Imendörffer HRB 36809 (AG Nürnberg)

2 1

[2.11 alpha] no login, internal error
by Moritz Röhrich 12 Jan '21

12 Jan '21

Dear OBS Maintainers, I have recently updated the packages of my self hosted OBS instance. Before that I was running 2.11 alpha from 13.07.2020 just fine. However after the update, the webui and api are broken, because they respond to login with an error 500. I haven't found a smoking gun, but I have found this log message: ``` [...] W, [2021-01-12T11:57:44.260928 #246] WARN -- : [246:0.00] Creating scope :type_image. Overwriting existing method Kiwi::PackageGroup.type_image. W, [2021-01-12T11:57:44.262566 #246] WARN -- : [246:0.00] Creating scope :system. Overwriting existing method Kiwi::Description.system. I, [2021-01-12T11:58:11.889188 #305] INFO -- : [d4ca49a2-e299-4220-b545-9d2dbdd7c269] [305:0.00] method=GET path=/ format=html controller=Webui::MainController action=index status=200 duration=778.10 view=163.97 db=231.24 params={} host=10.20.2.130 time=23825.70 backend=245.66 user=_nobody_ I, [2021-01-12T11:58:12.241802 #305] INFO -- : [31100c3c-f265-4e7e-abd2-d04147cc874f] [305:0.35] method=GET path=/ format=html controller=Webui::MainController action=index status=200 duration=30.96 view=22.47 db=2.64 params={} host=10.10.1.12 time=23826.80 backend=0 user=_nobody_ I, [2021-01-12T11:58:22.224528 #305] INFO -- : [217b004b-fe02-4d47-8731-107e1af5655e] [305:10.34] method=GET path=/ format=html controller=Webui::MainController action=index status=200 duration=41.07 view=32.12 db=2.78 params={} host=10.10.1.14 time=23836.77 backend=0 user=_nobody_ I, [2021-01-12T11:58:28.871440 #305] INFO -- : [d5a6713f-4c7c-431d-8e2d-f70f091c3676] [305:16.98] method=POST path=/session format=html controller=Webui::SessionController action=create status=500 error='NoMethodError: undefined method `biography' for #<User:0x000056236e0fc4d0>' duration=446.31 view=0.00 db=2.03 params={"authenticity_token"=>"XXXXXX", "username"=>"XXXXXX", "password"=>"[FILTERED]", "login"=>"Log In"} host=10.20.2.130 time=23843.01 backend=0 user=_nobody_ F, [2021-01-12T11:58:28.875109 #305] FATAL -- : [d5a6713f-4c7c-431d-8e2d-f70f091c3676] [305:16.99] [d5a6713f-4c7c-431d-8e2d-f70f091c3676] NoMethodError (undefined method `biography' for #<User:0x000056236e0fc4d0>): [d5a6713f-4c7c-431d-8e2d-f70f091c3676] [d5a6713f-4c7c-431d-8e2d-f70f091c3676] app/models/user.rb:871:in `mark_login!' [d5a6713f-4c7c-431d-8e2d-f70f091c3676] app/models/user.rb:282:in `authenticate_via_password' [d5a6713f-4c7c-431d-8e2d-f70f091c3676] app/models/user.rb:180:in `find_with_credentials' [d5a6713f-4c7c-431d-8e2d-f70f091c3676] app/services/session_controller_service/session_creator.rb:17:in `exist?' [d5a6713f-4c7c-431d-8e2d-f70f091c3676] app/controllers/webui/session_controller.rb:40:in `authenticate' [d5a6713f-4c7c-431d-8e2d-f70f091c3676] config/initializers/wrap_parameters.rb:38:in `call' [...] ``` (username and authenticity token redacted) This happens with all users, including Admin on both WebUI and commanline API usage. The corresponding output from osc for example is: ``` $ osc -A https://obs.corp.quobyte.com ls Server returned an error: HTTP Error 500: Internal Server Error Request: https://obs.corp.quobyte.com/source Headers: status: 500 Internal Server Error x-request-id: b9d699ba-b207-4543-9fcc-e2c34a084a7a x-powered-by: Phusion Passenger 6.0.7 connection: close content-length: 131 server: Apache x-runtime: 0.447938 cache-control: public date: Tue, 12 Jan 2021 12:14:07 GMT content-type: application/xml; charset=utf-8 ``` Are there any steps I should be taking in debugging my environment? Is this a bug perhaps? Do I need to migrate the database? Best regards, Moritz Röhrich -- Quobyte GmbH, Berlin, AG Charlottenburg HRB 149012 B, Felix Hupfeld, Bjoern Kolbeck -- Quobyte GmbH, Berlin, AG Charlottenburg HRB 149012 B, Felix Hupfeld, Bjoern Kolbeck

3 3

How to create a project using osc?
by huangyang 08 Jan '21

08 Jan '21

hi， I checked the help file of the osc command, and I found the only possible subcommand "osc init" to create a project. I tried it, but the result was wrong. The following information was returned: obs:/home/loongson/thirdpart_projects # ls mars obs:/home/loongson/thirdpart_projects # osc -A https://obs init mars .... Password: Server returned an error: HTTP Error 404: Not Found mars obs:/home/loongson/thirdpart_projects # osc add mars/ A mars obs:/home/loongson/thirdpart_projects # osc commit Password: Server returned an error: HTTP Error 404: Not Found mars obs:/home/loongson/thirdpart_projects # Did I use the wrong command? By the way, what is the function of the channel in the osc command? thanks

3 3