[opensuse-factory] openSUSE reproducible builds status 2020-03
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, last month's status: https://lists.opensuse.org/opensuse-factory/2020-03/msg00014.html Last months' reproducible builds project updates (including my work): https://reproducible-builds.org/reports/2020-02/ I uploaded https://rb.zq1.de/compare.factory-20200402/ today and rbstats are: total-packages: 12781 (+89) build-tried: 12772 (+89) build-failed: 54 (+14) build-n-a: 86 (+1) build-succeeded: 12632 (+74) build-official-failed+na: 135 (+43) build-compare-failed: 408 (+17) build-compare-succeeded: 12224 (+57) verify-failed: 526 (+7) verified-semi-reproducible: 11458 (+87) verified-bit-identical: 0 (+0) bit-by-bit-identical: 11862 (+58) not-bit-by-bit-identical: 764 (+17) not-bit-by-bit-identicalcheck: 770 (+16) https://rb.zq1.de/compare.factory-20200402/graph.png shows the change over time https://rb.zq1.de/compare.factory-20200402/unreproduciblerings.txt lists very unreproducible core packages (bootstrap+DVD) Of the badly unreproducible packages, 4 were in ring0 44 were in ring1 That makes it 48/2901 => 1.65 % which is below the overall average of 408/12632 => 3.23 % 764/12632 => 6.05 % of packages are not perfectly reproducible newly unreproducible core packages: cri-o parallelism causes go buildid to vary - same problem as in many of our go packages (since go1.10) python3 filesystem readdir order influences .pyc file marshalling https://bugs.python.org/issue34033 Ciao Bernhard M. -----BEGIN PGP SIGNATURE----- iF0EARECAB0WIQRk4KvQEtfG32NHprVJNgs7HfuhZAUCXoXALgAKCRBJNgs7Hfuh ZI5NAJ92/xS9ZDT7FQBg0HwnAHfO46lBYACgsvlwixFNKxHssknMR1089KXD1qY= =kxCI -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-factory+owner@opensuse.org
Hi, last month's status: https://lists.opensuse.org/opensuse-factory/2020-04/msg00026.html Last months' reproducible builds project updates (including my work): https://reproducible-builds.org/reports/2020-03/ I uploaded https://rb.zq1.de/compare.factory-20200430/ today and rbstats are: total-packages: 12788 (+7) build-tried: 12782 (+10) build-failed: 48 (-6) build-n-a: 148 (+62) build-succeeded: 12586 (-46) build-official-failed+na: 237 (+102) build-compare-failed: 462 (+54) build-compare-succeeded: 12124 (-100) verify-failed: 516 (-10) verified-semi-reproducible: 11342 (-116) verified-bit-identical: 0 (+0) bit-by-bit-identical: 11796 (-66) not-bit-by-bit-identical: 790 (+26) not-bit-by-bit-identicalcheck: 790 (+20) https://rb.zq1.de/compare.factory-20200430/graph.png shows the change over time https://rb.zq1.de/compare.factory-20200430/unreproduciblerings.txt lists very unreproducible core packages (bootstrap+DVD) Of the badly unreproducible packages, 3 were in ring0 51 were in ring1 That makes it 54/2901 => 1.86 % which is below the overall average of 462/12586 => 3.67 % 790/12586 => 6.28 % of packages are not perfectly reproducible newly unreproducible core packages: glassfish-servlet-api java gtk-sharp2 monodoc uses nondeterministic filesystem readdir order libqt5-qtscript filesys readdir order from Qt podman random go tmp build path python-debtcollector https://review.openstack.org/652669 sphinx .pickle file marshalling python-numpy .pyc file marshalling tigervnc has signature with random RSA key xerces-j2 java yudit ASLR? uninitialized bytes in .my files created by "mytool" packages that are problematic to build in my setup, but not OBS: breezy -j1 diy many tests fail frr -j1 lua-toluapp ?scons fail perl-Image-Sane https://bugzilla.opensuse.org/show_bug.cgi?id=1170639 stuck build on -j1 python2-pip ImportError: No module named six python3-espressomd -j1 failed all_compare_test python-astropy https://github.com/astropy/astropy/issues/10228 python-keystonemiddleware expired SSL cert python-M2Crypto https://gitlab.com/m2crypto/m2crypto/-/issues/275 python-nbclient test_run_all_notebooks failed python-pyenchant test_docstrings failed python-ruffus test_with_logger.py Fatal Python error: Aborted tdiff https://github.com/F-i-f/tdiff/issues/2 vim https://bugzilla.opensuse.org/show_bug.cgi?id=1157623 Ciao Bernhard M. -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-factory+owner@opensuse.org
On Thursday 2020-04-30 08:26, Bernhard M. Wiedemann wrote:
colm is a case of ASLR. The data it outputs wants to have some unique identifiers among all the identifiers it outputs, and it simply uses the pointer address of those objects while serializing to text. Do you already have a "standard solution" (abstract way to address serialization of pointers) for cases like these? String name( 128, "_ign_%p", regionSet->tokenIgnore ); If not, I'll be trying to use a global counter or something. -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-factory+owner@opensuse.org
Am 30.04.20 um 09:48 schrieb Jan Engelhardt:
On Thursday 2020-04-30 08:26, Bernhard M. Wiedemann wrote:
colm is a case of ASLR.
The data it outputs wants to have some unique identifiers among all the identifiers it outputs, and it simply uses the pointer address of those objects while serializing to text.
Do you already have a "standard solution" (abstract way to address serialization of pointers) for cases like these?
String name( 128, "_ign_%p", regionSet->tokenIgnore );
If not, I'll be trying to use a global counter or something.
Yes, global counters is one way - as long as everything happens in one process, otherwise racy parallel processing can introduce nondeterminism. A workaround is to use setarch -R to disable ASLR during build. Otherwise sorting by something that is unique and deterministic also does the trick. E.g. these pointers are pointing to some data? strcmp/memcmp could tell you which comes first... -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-factory+owner@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Hi, last month's status: https://lists.opensuse.org/opensuse-factory/2020-04/msg00026.html Last months' reproducible builds project updates (including my work): https://reproducible-builds.org/reports/2020-04/ The reproducible numbers may be around 60 too high because I ran the autoclassify on packages that had been classified more than a year ago. And that often leaves them reproducible-with-tweaks, which should be tracked separately in the statistics, because there is work left to do. Java is still a major factor in unreproducibility - I think, there are easy toolchain patches possible with xmvn https://bugzilla.opensuse.org/show_bug.cgi?id=1162112 and https://build.opensuse.org/package/show/home:bmwiedemann:reproducible:te st/java-11-openjdk I uploaded https://rb.zq1.de/compare.factory-20200602/ today and rbstats are: total-packages: 12846 (+58) build-tried: 12837 (+55) build-failed: 13 (-35) build-n-a: 148 (+0) build-succeeded: 12676 (+90) build-official-failed+na: 640 (+403) build-compare-failed: 423 (-39) build-compare-succeeded: 12253 (+129) verify-failed: 535 (+19) verified-semi-reproducible: 11369 (+27) verified-bit-identical: 0 (+0) bit-by-bit-identical: 12086 (+290) not-bit-by-bit-identical: 591 (-199) not-bit-by-bit-identicalcheck: 590 (-200) https://rb.zq1.de/compare.factory-20200602/graph.png shows the change over time https://rb.zq1.de/compare.factory-20200602/unreproduciblerings.txt lists very unreproducible core packages (bootstrap+DVD) Of the badly unreproducible packages, 2 were in ring0 41 were in ring1 That makes it 43/2901 => 1.48 % which is below the overall average of 423/12676 => 3.34 % 591/12676 => 4.66 % of packages are not perfectly reproducible Ciao Bernhard M. -----BEGIN PGP SIGNATURE----- iHUEARYIAB0WIQTykslvYmKwlIQesLNdovN53d8CLgUCXtaiMQAKCRBdovN53d8C Lv3fAP9qvMele/FnBsFczvU6+uKoYJRWpJDH9V8q9Eq/KyS77QD/RdoCmzQ3BA3R If/GlJnbdh9wb/M4F43TgXXmoacAQAQ= =HfGT -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-factory+owner@opensuse.org
participants (3)
-
Bernhard M. Wiedemann -
Bernhard M. Wiedemann -
Jan Engelhardt