[opensuse-buildservice] logs from hanging builds?
We're currently having problems with some of our builds (project net-snmp, package net-snmp-main-snapshot). The builds seem to be hanging at some stage, but in order to be able to fix this, I'd need to see the log. However, "osc log" gives: Error: can't get 'http://api.opensuse.org/result/net-snmp/SuSE_Linux_10.1/net-snmp-main-snapshot/i586/log?nostream=1&start=790382' HTTP Error 500: Internal Server Error The WebClient has further details: - --- snip --- OpenSUSE Webclient Error: Error Details: Errorcode: 500 Message: execution expired Exception from Webclient: Timeout::Error: execution expired Stack Trace: /usr/lib64/ruby/1.8/timeout.rb:54:in `rbuf_fill' /usr/lib64/ruby/1.8/timeout.rb:56:in `timeout' /usr/lib64/ruby/1.8/timeout.rb:76:in `timeout' /usr/lib64/ruby/1.8/net/protocol.rb:132:in `rbuf_fill' /usr/lib64/ruby/1.8/net/protocol.rb:116:in `readuntil' /usr/lib64/ruby/1.8/net/protocol.rb:126:in `readline' /usr/lib64/ruby/1.8/net/http.rb:1988:in `read_status_line' /usr/lib64/ruby/1.8/net/http.rb:1977:in `read_new' /usr/lib64/ruby/1.8/net/http.rb:1046:in `request' /usr/lib64/ruby/1.8/net/http.rb:771:in `get' /srv/www/opensuse/common/current/lib/activexml/transport.rb:413:in `http_do' /usr/lib64/ruby/1.8/net/http.rb:545:in `start' /usr/lib64/ruby/1.8/net/http.rb:440:in `start' /srv/www/opensuse/common/current/lib/activexml/transport.rb:404:in `http_do' /srv/www/opensuse/common/current/lib/activexml/transport.rb:378:in `direct_http' /srv/www/opensuse/webclient/current/public/../config/../lib/frontend_compat.rb:46:in `get_log_chunk' /srv/www/opensuse/webclient/current/public/../config/../app/controllers/package_controller.rb:385:in `live_build_log' /usr/lib64/ruby/gems/1.8/gems/actionpack-1.12.3/lib/action_controller/base.rb:910:in `perform_action_without_filters' /usr/lib64/ruby/gems/1.8/gems/actionpack-1.12.3/lib/action_controller/filters.rb:368:in `perform_action_without_benchmark' /usr/lib64/ruby/gems/1.8/gems/actionpack-1.12.3/lib/action_controller/benchmarking.rb:69:in `perform_action_without_rescue' /usr/lib64/ruby/1.8/benchmark.rb:293:in `measure' /usr/lib64/ruby/gems/1.8/gems/actionpack-1.12.3/lib/action_controller/benchmarking.rb:69:in `perform_action_without_rescue' /usr/lib64/ruby/gems/1.8/gems/actionpack-1.12.3/lib/action_controller/rescue.rb:82:in `perform_action' /usr/lib64/ruby/gems/1.8/gems/actionpack-1.12.3/lib/action_controller/base.rb:381:in `process_without_filters' /usr/lib64/ruby/gems/1.8/gems/actionpack-1.12.3/lib/action_controller/filters.rb:377:in `process_without_session_management_support' /usr/lib64/ruby/gems/1.8/gems/actionpack-1.12.3/lib/action_controller/session_management.rb:117:in `process' /usr/lib64/ruby/gems/1.8/gems/rails-1.1.4/lib/dispatcher.rb:38:in `dispatch' /usr/lib64/ruby/gems/1.8/gems/rails-1.1.4/lib/fcgi_handler.rb:150:in `process_request' /usr/lib64/ruby/gems/1.8/gems/rails-1.1.4/lib/fcgi_handler.rb:54:in `process!' /usr/lib64/ruby/1.8/fcgi.rb:612:in `each_cgi' /usr/lib64/ruby/1.8/fcgi.rb:609:in `each_cgi' /usr/lib64/ruby/gems/1.8/gems/rails-1.1.4/lib/fcgi_handler.rb:53:in `process!' /usr/lib64/ruby/gems/1.8/gems/rails-1.1.4/lib/fcgi_handler.rb:23:in `process!' /srv/www/opensuse/webclient/current/public/dispatch.fcgi:24 - --- snap --- Can someone please get me the log somehow and kill the current builds? What to do about such issues in the future? +Thomas -- Thomas Anders (thomas.anders at blue-cable.de) --------------------------------------------------------------------- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
Am Tuesday 26 September 2006 12:18 schrieb Thomas Anders:
We're currently having problems with some of our builds (project net-snmp, package net-snmp-main-snapshot). The builds seem to be hanging at some stage, but in order to be able to fix this, I'd need to see the log. However, "osc log" gives:
Error: can't get 'http://api.opensuse.org/result/net-snmp/SuSE_Linux_10.1/net-snmp-main-snap shot/i586/log?nostream=1&start=790382' HTTP Error 500: Internal Server Error
This is caused, because I had to manually kill the build jobs, because they did run forever. I read somewhere that this issue should be fixed in the meantime. bye adrian -- Adrian Schroeter SUSE Linux Products GmbH, Maxfeldstr. 5, 90409 Nuernberg, Germany email: adrian@suse.de --------------------------------------------------------------------- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
Adrian Schröter wrote:
Am Tuesday 26 September 2006 12:18 schrieb Thomas Anders:
We're currently having problems with some of our builds (project net-snmp, package net-snmp-main-snapshot). The builds seem to be hanging at some stage, but in order to be able to fix this, I'd need to see the log. However, "osc log" gives:
Error: can't get 'http://api.opensuse.org/result/net-snmp/SuSE_Linux_10.1/net-snmp-main-snap shot/i586/log?nostream=1&start=790382' HTTP Error 500: Internal Server Error
This is caused, because I had to manually kill the build jobs, because they did run forever. I read somewhere that this issue should be fixed in the meantime.
Can we (and should we) set cpu time (or wall clock time) limits? I take it that packages may have *very* different compile time requirements, but shouldn't there be a way to prevent hung build jobs from blocking build hosts "forever"? Can we offer the project maintainer(s) a way to terminate build jobs themselves? +Thomas -- Thomas Anders (thomas.anders at blue-cable.de) --------------------------------------------------------------------- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
Am Tuesday 26 September 2006 14:30 schrieb Thomas Anders:
Adrian Schröter wrote:
Am Tuesday 26 September 2006 12:18 schrieb Thomas Anders:
We're currently having problems with some of our builds (project net-snmp, package net-snmp-main-snapshot). The builds seem to be hanging at some stage, but in order to be able to fix this, I'd need to see the log. However, "osc log" gives:
Error: can't get 'http://api.opensuse.org/result/net-snmp/SuSE_Linux_10.1/net-snmp-main-s nap shot/i586/log?nostream=1&start=790382' HTTP Error 500: Internal Server Error
This is caused, because I had to manually kill the build jobs, because they did run forever. I read somewhere that this issue should be fixed in the meantime.
Can we (and should we) set cpu time (or wall clock time) limits? I take it that packages may have *very* different compile time requirements, but shouldn't there be a way to prevent hung build jobs from blocking build hosts "forever"? Can we offer the project maintainer(s) a way to terminate build jobs themselves?
Yes, Michael is working on this already (but he is on vacation this week ;) -- Adrian Schroeter SUSE Linux Products GmbH, Maxfeldstr. 5, 90409 Nuernberg, Germany email: adrian@suse.de --------------------------------------------------------------------- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
participants (2)
-
Adrian Schröter
-
Thomas Anders