[opensuse-factory] new openSUSE:* source processing method. PLEASE TEST !
Hello, I look for some more people who want to try our hopefully soon to be applied new source processing method for openSUSE:Factory and the maintenance updates to :Update projects. It should work good already, so you do not need to be brave ;) You may know that currently all package source submissions to Factory and friends get SUSE in-house be reviewed, re-validated and reformated. You can see this in the additional "autobuild" commits in the openSUSE:Factory commits. We plan to do following changes in future: * We would like to do these steps out there and as soon as possible in future. This means in best case before any packager is commiting his changes the validating and reformating is done already. This avoids any possible merge problems, unnecessary commits and extra turn around times. * these services can be code stream specific (unlike current osc_source_validator). That means we will be able to do better checks in future for Factory then for maintenance updates (where we need to stay compatible). And we do not need to take care about non-SUSE code streams, eg. Fedora or MeeGo people can still work and submit their changes to their projects or write their own services. * In addition to existing checks, we want to track where upstream sources (tar balls) are comming from. So far we had the download_url source service, which downloaded files and stored them with _service: prefix what not everybody liked. The new and project wide working "download_files" service is just validate the URL's from the spec file. The new osc will commit these files as usual files and the server is just validating this. (People with low upstream bandwidth can still decide to skip the commit, the server will store it with prefix again.) So, if everybody is using this current osc & source service stack, the source services will be used to do these steps, but there will be no _service* file(s) in your package sources. And the last really SUSE in-house part of Factory development would be the legal review db, really everything else would be out there in build.o.o... How to test this ? ================== First of all you need the new services and a new osc installed. Please add the proper openSUSE:Tools project repo and install zypper in obs-service-download_files obs-service-format_spec_file obs-service-source_validator In addition to that please install "osc" from openSUSE:Tools:Unstable project. If you do not like to add the repo, just run osc getbinaries openSUSE:Tools:Unstable osc $YOUR_REPO $YOUR_ARCH and install the osc package manually. To activate this for your entire devel project (it would work also per package) do # osc co $YOUR_DEVEL_PROJECT _project # cd $YOUR_DEVEL_PROJECT/_project # cat > _service <<EOF <services> <service name="format_spec_file" mode="trylocal"/> <service name="download_files" mode="trylocal"/> <service name="source_validator" mode="trylocal"/> </services> EOF # osc addremove # osc ci -m "activate factory default source services" Afterwards these services running on "osc build" and "osc commit" actions, if not disabled via CLI switch. Reformated spec files will be uploaded directly and in case of validation errors, osc will abort before commit/build'ing. What happens to people with old osc version (0.130 and before) or just using the webui after activating these services ? Nothing. The services will run on the server only. => The source state will turn into "broken" if a validation error exists. => if tar ball is missing/different or spec file is different formated they will be visible with _service:* prefix again. How to get rid of them again ? Just anyone with a current osc stack will merge these changes automatically on next commit and the server side generated files will disappear again. If this testing phase works out fine, we will of course make a maintenance update for all these packages, so everybody should have a current stack. I have activated this already for the openSUSE:Tools* projects and everything seems to work. And I found out that 3 out of 3 random packages from openSUSE:Factory contain broken Source: $URL lines ;) Feel free to branch any openSUSE:Tools package into your branch and try to edit it. With the new osc you will use these local services automatically. -- Adrian Schroeter SUSE Linux Products GmbH email: adrian@suse.de -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
Am Mittwoch, 25. Mai 2011, 20:14:17 schrieb Adrian Schröter:
ese steps out there and as soon as possible in future. This means in best case before any packager is commiting his changes the validating and reformating is done already. This avoids any possible merge problems, unnecessary commits and extra turn around times.
Great. I'll give that one a try for sure. -- Ralf Lang Linux Consultant / Developer B1 Systems GmbH Osterfeldstraße 7 / 85088 Vohburg / http://www.b1-systems.de GF: Ralph Dehner / Unternehmenssitz: Vohburg / AG: Ingolstadt,HRB 3537 -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
Hi Adrian, great stuff, but: Am Mittwoch, 25. Mai 2011, 20:14:17 schrieb Adrian Schröter:
How to test this ? ==================
First of all you need the new services and a new osc installed. Please add the proper openSUSE:Tools project repo and install
zypper in obs-service-download_files obs-service-format_spec_file obs-service-source_validator
In addition to that please install "osc" from openSUSE:Tools:Unstable project. If you do not like to add the repo, just run
osc getbinaries openSUSE:Tools:Unstable osc $YOUR_REPO $YOUR_ARCH
and install the osc package manually.
To activate this for your entire devel project (it would work also per package) do
# osc co $YOUR_DEVEL_PROJECT _project # cd $YOUR_DEVEL_PROJECT/_project # cat > _service <<EOF <services> <service name="format_spec_file" mode="trylocal"/> <service name="download_files" mode="trylocal"/> <service name="source_validator" mode="trylocal"/> </services> EOF # osc addremove # osc ci -m "activate factory default source services"
<services> <service name="format_spec_file" mode="trylocal"/> <service name="download_files" mode="trylocal"/> <service name="source_validator" mode="trylocal"/> </services> EOF rlang@linux-ecfn:~/build/server:php:applications/_project> cat _service rlang@linux-ecfn:~/build/server:php:applications/_project> osc ar A _service rlang@linux-ecfn:~/build/server:php:applications/_project> osc ci -m "activate factory default source services" *.spec is no file at /usr/lib/obs/service/format_spec_file.files/prepare_spec
This didn't work for me. lang@linux-ecfn:~/build/server:php:applications> osc co _project A _project At revision None. rlang@linux-ecfn:~/build/server:php:applications> cd _project/ rlang@linux-ecfn:~/build/server:php:applications/_project> cat > _service <<EOF line 479. cmp: *.spec: Datei oder Verzeichnis nicht gefunden ERROR: service call failed: /usr/lib/obs/service/format_spec_file --outdir /tmp/tmplOr56Z (your _services file may be corrupt now) error: Name field must be present in package: (main package) error: Version field must be present in package: (main package) error: Release field must be present in package: (main package) error: Summary field must be present in package: (main package) error: License field must be present in package: (main package) ERROR: Can not recognize Version in *.spec. Remember that Version: must be at the beginning of line. ERROR: service call failed: /usr/lib/obs/service/source_validator --outdir /tmp/tmpnbi1IB (your _services file may be corrupt now) osc: source service run failed 1 *** Error: rlang@linux-ecfn:~/build/server:php:applications/_project> However, this worked: osc ci --skip-local-service-run --skip-validation -m "activate factory default source services" Sending _service Transmitting file data . Committed revision 1. Waiting for server side source service run At revision 1. updated -- Ralf Lang Linux Consultant / Developer B1 Systems GmbH Osterfeldstraße 7 / 85088 Vohburg / http://www.b1-systems.de GF: Ralph Dehner / Unternehmenssitz: Vohburg / AG: Ingolstadt,HRB 3537 -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
Am Thursday, 26. May 2011, 10:59:49 schrieb Ralf Lang: ...
rlang@linux-ecfn:~/build/server:php:applications/_project> osc ci -m "activate factory default source services" *.spec is no file at /usr/lib/obs/service/format_spec_file.files/prepare_spec line 479.
fixed in git, new packages will come soon. -- Adrian Schroeter SUSE Linux Products GmbH email: adrian@suse.de -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
Am Donnerstag, 26. Mai 2011, 15:58:22 schrieb Adrian Schröter:
Am Thursday, 26. May 2011, 10:59:49 schrieb Ralf Lang: ...
rlang@linux-ecfn:~/build/server:php:applications/_project> osc ci -m "activate factory default source services" *.spec is no file at /usr/lib/obs/service/format_spec_file.files/prepare_spec line 479.
fixed in git, new packages will come soon.
Great - and very fast response. I'll try out immediately when I get it. -- Ralf Lang Linux Consultant / Developer Tel.: +49-170-6381563 Mail: lang@b1-systems.de B1 Systems GmbH Osterfeldstraße 7 / 85088 Vohburg / http://www.b1-systems.de GF: Ralph Dehner / Unternehmenssitz: Vohburg / AG: Ingolstadt,HRB 3537 -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
Am Donnerstag, 26. Mai 2011, 18:12:07 schrieb Ralf Lang:
Am Donnerstag, 26. Mai 2011, 15:58:22 schrieb Adrian Schröter:
Am Thursday, 26. May 2011, 10:59:49 schrieb Ralf Lang: ...
rlang@linux-ecfn:~/build/server:php:applications/_project> osc ci -m "activate factory default source services" *.spec is no file at /usr/lib/obs/service/format_spec_file.files/prepare_spec line 479.
fixed in git, new packages will come soon.
Great - and very fast response. I'll try out immediately when I get it.
No, still no automatic ci messages with this morning's osc package. The part above the ignore-the-rest marker is empty. Do I need to checkout the repo anew or delete the .oscrc to make this work? -- Ralf Lang Linux Consultant / Developer B1 Systems GmbH Osterfeldstraße 7 / 85088 Vohburg / http://www.b1-systems.de GF: Ralph Dehner / Unternehmenssitz: Vohburg / AG: Ingolstadt,HRB 3537 -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
The new osc from the unstable repo doesn't automagically import my last osc vc message into the commit message anymore. I found that one handy. Is it gone by purpose or shall I open a bug? -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
Am Thursday, 26. May 2011, 13:45:47 schrieb Ralf Lang:
The new osc from the unstable repo doesn't automagically import my last osc vc message into the commit message anymore. I found that one handy. Is it gone by purpose or shall I open a bug?
no, that seems to be an side effect. Will have a look and build new packages. -- Adrian Schroeter SUSE Linux Products GmbH email: adrian@suse.de -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
Am Thursday, 26. May 2011, 15:58:46 schrieb Adrian Schröter:
Am Thursday, 26. May 2011, 13:45:47 schrieb Ralf Lang:
The new osc from the unstable repo doesn't automagically import my last osc vc message into the commit message anymore. I found that one handy. Is it gone by purpose or shall I open a bug?
no, that seems to be an side effect. Will have a look and build new packages.
hm, I can not reproduce that here. Are you sure that this is broken for you now ? -- Adrian Schroeter SUSE Linux Products GmbH email: adrian@suse.de -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
Am Thursday, 26. May 2011, 16:00:39 schrieb Adrian Schröter:
Am Thursday, 26. May 2011, 15:58:46 schrieb Adrian Schröter:
Am Thursday, 26. May 2011, 13:45:47 schrieb Ralf Lang:
The new osc from the unstable repo doesn't automagically import my last osc vc message into the commit message anymore. I found that one handy. Is it gone by purpose or shall I open a bug?
no, that seems to be an side effect. Will have a look and build new packages.
hm, I can not reproduce that here. Are you sure that this is broken for you now ?
okay, we found it. Next packages should have this fixed. -- Adrian Schroeter SUSE Linux Products GmbH email: adrian@suse.de -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
Am Donnerstag, 26. Mai 2011, 16:40:23 schrieb Adrian Schröter:
Am Thursday, 26. May 2011, 16:00:39 schrieb Adrian Schröter:
Am Thursday, 26. May 2011, 15:58:46 schrieb Adrian Schröter:
Am Thursday, 26. May 2011, 13:45:47 schrieb Ralf Lang:
The new osc from the unstable repo doesn't automagically import my last osc vc message into the commit message anymore. I found that one handy. Is it gone by purpose or shall I open a bug?
no, that seems to be an side effect. Will have a look and build new packages.
hm, I can not reproduce that here. Are you sure that this is broken for you now ?
okay, we found it.
Next packages should have this fixed.
WROX for me now :-) -- Ralf Lang Linux Consultant / Developer Tel.: +49-170-6381563 Mail: lang@b1-systems.de B1 Systems GmbH Osterfeldstraße 7 / 85088 Vohburg / http://www.b1-systems.de GF: Ralph Dehner / Unternehmenssitz: Vohburg / AG: Ingolstadt,HRB 3537 -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
participants (2)
-
Adrian Schröter
-
Ralf Lang