[Bug 1166965] New: kernel-docs fail to build occasionally with python 3.8
http://bugzilla.suse.com/show_bug.cgi?id=1166965 Bug ID: 1166965 Summary: kernel-docs fail to build occasionally with python 3.8 Classification: openSUSE Product: openSUSE Tumbleweed Version: Current Hardware: Other OS: Other Status: NEW Severity: Normal Priority: P5 - None Component: Other Assignee: screening-team-bugs@suse.de Reporter: jslaby@suse.com QA Contact: qa-bugs@suse.de CC: mkubecek@suse.com Depends on: 1158289 Found By: --- Blocker: --- kernel-docs need 8.2G of memory with python 3.8 now. It used to be 2.2G on SLE15-SP2 (python 3.6). I don't have numbers for 3.7, but the build did not fail in factory, now it fails quite often.
[ 776s] writing output... [ 55%] media/uapi/dvb/audio-continue .. media/uapi/dvb/frontend-property-terrestrial-systems [ 783s] [ 768.244238] Out of memory: Killed process 4174 (sphinx-build) total-vm:1256996kB, anon-rss:517292kB, file-rss:0kB, shmem-rss:0kB, UID:399 pgtables:2508kB oom_score_adj:0 [ 842s] writing output... [ 59%] media/uapi/dvb/frontend-stat-properties .. media/uapi/rc/lirc-set-wideband-receiver [ 847s] [ 847s] Exception occurred: [ 847s] File "/usr/lib64/python3.8/multiprocessing/connection.py", line 383, in _recv [ 847s] raise EOFError [ 847s] EOFError
I indeed can increase the constraints, but 4 times larger memory footprint is too much... This must be a bug or leak. https://build.opensuse.org/packages/kernel-docs/job_history/Kernel:stable/st... -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.suse.com/show_bug.cgi?id=1166965
Jiri Slaby
http://bugzilla.suse.com/show_bug.cgi?id=1166965
Matej Cepl
http://bugzilla.suse.com/show_bug.cgi?id=1166965
Hans-Peter Jansen
http://bugzilla.suse.com/show_bug.cgi?id=1166965
Tomáš Chvátal
http://bugzilla.suse.com/show_bug.cgi?id=1166965
http://bugzilla.suse.com/show_bug.cgi?id=1166965#c2
Matej Cepl
http://bugzilla.suse.com/show_bug.cgi?id=1166965
http://bugzilla.suse.com/show_bug.cgi?id=1166965#c3
Jiri Slaby
http://bugzilla.suse.com/show_bug.cgi?id=1166965
http://bugzilla.suse.com/show_bug.cgi?id=1166965#c4
--- Comment #4 from Jiri Slaby
Could you please *ATTACH* (not link) build log (preferably on x86_64) when it fails, please?
I am not sure what that is good for, but I attached it anyway. Even if it does not fail, it still consumes 8G of memory. So be it failed or successful build, the leak is still there... More interesting would be to run it locally and measure python memory footprint with 3.6/3.7 and 3.8. Maybe with some valgrind-for-python thing, if there is any... -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.suse.com/show_bug.cgi?id=1166965
http://bugzilla.suse.com/show_bug.cgi?id=1166965#c5
--- Comment #5 from Jiri Slaby
http://bugzilla.suse.com/show_bug.cgi?id=1166965
http://bugzilla.suse.com/show_bug.cgi?id=1166965#c6
Jiri Slaby
http://bugzilla.suse.com/show_bug.cgi?id=1166965
http://bugzilla.suse.com/show_bug.cgi?id=1166965#c7
--- Comment #7 from Steve Kowalik
http://bugzilla.suse.com/show_bug.cgi?id=1166965
http://bugzilla.suse.com/show_bug.cgi?id=1166965#c8
--- Comment #8 from Michal Kubeček
http://bugzilla.suse.com/show_bug.cgi?id=1166965
http://bugzilla.suse.com/show_bug.cgi?id=1166965#c9
--- Comment #9 from Michal Kubeček
http://bugzilla.suse.com/show_bug.cgi?id=1166965
http://bugzilla.suse.com/show_bug.cgi?id=1166965#c10
--- Comment #10 from Michal Kubeček
http://bugzilla.suse.com/show_bug.cgi?id=1166965
http://bugzilla.suse.com/show_bug.cgi?id=1166965#c11
--- Comment #11 from Jiri Slaby
From IBS:
Standard kernel Devel:Kernel:stable/kernel-docs/standard/x86_64 Maximal used memory: 7096 Mbyte With sphinx from leap 15.2 home:jirislaby:kernel_docs_sphinx/kernel-docs/SUSE_Factory_Head/x86_64 Maximal used memory: 1830 Mbyte With python 3.7 home:jirislaby:kernel_docs_python/kernel-docs/SUSE_Factory_Head/x86_64 Maximal used memory: 7593 Mbyte So there is little difference between py 3.7 & 3.8. There is a huge difference between sphinx 1.7.6 and 2.4.4. -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.suse.com/show_bug.cgi?id=1166965
http://bugzilla.suse.com/show_bug.cgi?id=1166965#c12
--- Comment #12 from Steve Kowalik
http://bugzilla.suse.com/show_bug.cgi?id=1166965
http://bugzilla.suse.com/show_bug.cgi?id=1166965#c13
--- Comment #13 from Jiri Slaby
Created attachment 834926 [details] OBS job history of Kernel:HEAD and Kernel:stable
Looking at the attached "osc jobhist" outputs, it seems that whatever caused these build failures, it happened between 2020-02-28 and 2020-03-02.
https://build.opensuse.org/request/show/779133 fits in there. -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.suse.com/show_bug.cgi?id=1166965
http://bugzilla.suse.com/show_bug.cgi?id=1166965#c14
--- Comment #14 from Michal Kubeček
http://bugzilla.suse.com/show_bug.cgi?id=1166965
http://bugzilla.suse.com/show_bug.cgi?id=1166965#c15
--- Comment #15 from Jiri Slaby
http://bugzilla.suse.com/show_bug.cgi?id=1166965
http://bugzilla.suse.com/show_bug.cgi?id=1166965#c16
--- Comment #16 from Steve Kowalik
http://bugzilla.suse.com/show_bug.cgi?id=1166965
Jiri Slaby
http://bugzilla.suse.com/show_bug.cgi?id=1166965
http://bugzilla.suse.com/show_bug.cgi?id=1166965#c17
Steve Kowalik
http://bugzilla.suse.com/show_bug.cgi?id=1166965
Matej Cepl
http://bugzilla.suse.com/show_bug.cgi?id=1166965
Tomáš Chvátal
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c19
--- Comment #19 from OBSbugzilla Bot
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c21
--- Comment #21 from Swamp Workflow Management
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c23
--- Comment #23 from Swamp Workflow Management
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c24
--- Comment #24 from Swamp Workflow Management
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c26
--- Comment #26 from Swamp Workflow Management
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c27
--- Comment #27 from Swamp Workflow Management
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c28
--- Comment #28 from Swamp Workflow Management
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c29
--- Comment #29 from Swamp Workflow Management
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c30
--- Comment #30 from OBSbugzilla Bot
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c33
--- Comment #33 from Swamp Workflow Management
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c34
--- Comment #34 from Swamp Workflow Management
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c35
Steve Kowalik
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c36
--- Comment #36 from Swamp Workflow Management
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c39
--- Comment #39 from Swamp Workflow Management
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c40
--- Comment #40 from Swamp Workflow Management
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c41
--- Comment #41 from Swamp Workflow Management
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c42
--- Comment #42 from Swamp Workflow Management
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c44
--- Comment #44 from Swamp Workflow Management
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c56
--- Comment #56 from Swamp Workflow Management
https://bugzilla.suse.com/show_bug.cgi?id=1166965
https://bugzilla.suse.com/show_bug.cgi?id=1166965#c57
--- Comment #57 from Swamp Workflow Management
participants (2)
-
bugzilla_noreply@novell.com
-
bugzilla_noreply@suse.com