[opensuse-buildservice] --disable-cpio-bulk-download fails with OBS
![](https://seccdn.libravatar.org/avatar/a961d54b41a44a48c5241aab3571178f.jpg?s=120&d=mm&r=g)
A few years/months ago I always called osc build with --disable-cpio-bulk-download to workaround some bug in OBS or osc that affected me at that time. Since a few days my osc wrapper hangs when doing 'osc build', when it tries to download packages for the chroot. Sometimes it downloads no package at all, or it hangs after downloading a different number of packages. Removing that option fixies it. Is that option still supported by OBS? Olaf
![](https://seccdn.libravatar.org/avatar/8f947802c8278f7de589d948d49d1c97.jpg?s=120&d=mm&r=g)
On 2018-02-15 18:46:40 +0100, Olaf Hering wrote:
A few years/months ago I always called osc build with --disable-cpio-bulk-download to workaround some bug in OBS or osc that affected me at that time.
Since a few days my osc wrapper hangs when doing 'osc build', when it tries to download packages for the chroot. Sometimes it downloads no package at all, or it hangs after downloading a different number of packages. Removing that option fixies it.
Hmm this should not happen. Can you post the output of "osc -d build..." to see where it hangs? Does strace reveal anything suspicious?
Is that option still supported by OBS?
Yep (maybe not preferred, because it creates "a lot" of http requests instead of "a few"). Marcus -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-buildservice+owner@opensuse.org
![](https://seccdn.libravatar.org/avatar/a961d54b41a44a48c5241aab3571178f.jpg?s=120&d=mm&r=g)
Am Thu, 15 Feb 2018 21:30:27 +0100
schrieb Marcus Hüwe
Hmm this should not happen. Can you post the output of "osc -d build..." to see where it hangs? Does strace reveal anything suspicious?
It hangs in ipv6 connect: olaf@latitude:~/work/obs/home:olh:xen-unstable/xen $ strace -f -s 1234 -tt -o /dev/shm/$$ bash -x /usr/share/helpers/bin/obs -d build --disable-cpio-bulk-download --debuginfo --no-service --no-verify --no-checks --release=180216075029.0 --root=/dev/shm/xen.obs.home:olh:xen-unstable.openSUSE_15.0.x86_64 openSUSE_15.0 x86_64 + export OSC_CONFIG=/home/olaf/.osc/oscrc + OSC_CONFIG=/home/olaf/.osc/oscrc + exec /usr/bin/osc --config=/home/olaf/.osc/oscrc -A https://api.opensuse.org -d build --disable-cpio-bulk-download --debuginfo --no-service --no-verify --no-checks --release=180216075029.0 --root=/dev/shm/xen.obs.home:olh:xen-unstable.openSUSE_15.0.x86_64 openSUSE_15.0 x86_64 GET https://api.opensuse.org/source/home:olh:xen-unstable/_meta WARNING: source service from package or project will not be executed. This may not be the same build as on server! Building xen.spec for openSUSE_15.0/x86_64 Getting buildinfo from server and store to /z_crypt_lvm_btrfs/work/obs/home:olh:xen-unstable/xen/.osc/_buildinfo-openSUSE_15.0-x86_64.xml POST https://api.opensuse.org/build/home:olh:xen-unstable/openSUSE_15.0/x86_64/xe... Getting buildconfig from server and store to /z_crypt_lvm_btrfs/work/obs/home:olh:xen-unstable/xen/.osc/_buildconfig-openSUSE_15.0-x86_64 GET https://api.opensuse.org/build/home:olh:xen-unstable/openSUSE_15.0/_buildcon... Updating cache of required packages 54.3% cache miss. 150/328 dependencies cached. GET http://download.opensuse.org/repositories/openSUSE:/Leap:/15.0/standard/x86_... .... 3376 08:52:46.357854 socket(AF_INET6, SOCK_DGRAM|SOCK_CLOEXEC, IPPROTO_IP) = 9 3376 08:52:46.357878 connect(9, {sa_family=AF_INET6, sin6_port=htons(80), inet_pton(AF_INET6, "2001:67c:2178:8::13", &sin6_addr), sin6_flowinfo=htonl(0), sin6_scope_id=0}, 28) = 0 3376 08:52:46.357929 getsockname(9, {sa_family=AF_INET6, sin6_port=htons(37531), inet_pton(AF_INET6, "2001:a62:816:91ff:a572:884d:f51d:1a86", &sin6_addr), sin6_flowinfo=htonl(0), sin6_scope_id=0}, [28]) = 0 3376 08:52:46.357958 close(9) = 0 3376 08:52:46.358010 socket(AF_INET6, SOCK_STREAM, IPPROTO_TCP) = 9 3376 08:52:46.358090 connect(9, {sa_family=AF_INET6, sin6_port=htons(80), inet_pton(AF_INET6, "2001:67c:2178:8::13", &sin6_addr), sin6_flowinfo=htonl(0), sin6_scope_id=0}, 28) = 0 3376 08:52:46.372594 sendto(9, "GET /repositories/openSUSE:/Leap:/15.0/standard/x86_64/gmp-devel-6.1.2-lp150.1.26.x86_64.rpm HTTP/1.1\r\nAccept-Encoding: identity\r\nHost: download.opensuse.org\r\nConnection: close\r\nUser-Agent: osc/0.162.1\r\n\r\n", 205, 0, NULL, 0) = 205 3376 08:52:46.373461 recvfrom(9, "HTTP/1.1 302 Found\r\nDate: Fri, 16 Feb 2018 07:52:46 GMT\r\nServer: Apache/2.4.23 (Linux/SUSE)\r\nLocation: http://download.opensuse.org/distribution/leap/15.0/repo/oss/x86_64/gmp-devel-6.1.2-lp150.1.26.x86_64.rpm\r\nContent-Length: 380\r\nConnection: close\r\nContent-Type: text/html; charset=iso-8859-1\r\n\r\n<!DOCTYPE HTML PUBLIC \"-//IETF//DTD HTML 2.0//EN\">\n<html><head>\n<title>302 Found</title>\n</head><body>\n<h1>Found</h1>\n<p>The document has moved http://download.opensuse.org/distribution/leap/15.0/repo/oss/x86_64/gmp-devel-6.1.2-lp150.1.26.x86_64.rpm\">here</a>.</p>\n<hr>\n<address>Apache/2.4.23 (Linux/SUSE) Server at download.opensuse.org Port 80</address>\n</body></html>\n", 8192, 0, NULL, NULL) = 677 3376 08:52:46.388177 close(9) = 0 3376 08:52:46.388538 socket(AF_INET, SOCK_DGRAM|SOCK_CLOEXEC, IPPROTO_IP) = 9 3376 08:52:46.388583 connect(9, {sa_family=AF_INET, sin_port=htons(80), sin_addr=inet_addr("195.135.221.134")}, 16) = 0 3376 08:52:46.388645 getsockname(9, {sa_family=AF_INET, sin_port=htons(44922), sin_addr=inet_addr("172.16.0.3")}, [28->16]) = 0 3376 08:52:46.388681 close(9) = 0 3376 08:52:46.388707 socket(AF_INET6, SOCK_DGRAM|SOCK_CLOEXEC, IPPROTO_IP) = 9 3376 08:52:46.388731 connect(9, {sa_family=AF_INET6, sin6_port=htons(80), inet_pton(AF_INET6, "2001:67c:2178:8::13", &sin6_addr), sin6_flowinfo=htonl(0), sin6_scope_id=0}, 28) = 0 3376 08:52:46.388772 getsockname(9, {sa_family=AF_INET6, sin6_port=htons(38426), inet_pton(AF_INET6, "2001:a62:816:91ff:a572:884d:f51d:1a86", &sin6_addr), sin6_flowinfo=htonl(0), sin6_scope_id=0}, [28]) = 0 3376 08:52:46.388802 close(9) = 0 3376 08:52:46.388846 socket(AF_INET6, SOCK_STREAM, IPPROTO_TCP) = 9 3376 08:52:46.388895 connect(9, {sa_family=AF_INET6, sin6_port=htons(80), inet_pton(AF_INET6, "2001:67c:2178:8::13", &sin6_addr), sin6_flowinfo=htonl(0), sin6_scope_id=0}, 28) = 0 3376 08:52:46.402738 sendto(9, "GET /distribution/leap/15.0/repo/oss/x86_64/gmp-devel-6.1.2-lp150.1.26.x86_64.rpm HTTP/1.1\r\nAccept-Encoding: identity\r\nHost: download.opensuse.org\r\nConnection: close\r\nUser-Agent: osc/0.162.1\r\n\r\n", 194, 0, NULL, 0) = 194 3376 08:52:46.402850 recvfrom(9, "HTTP/1.1 302 Found\r\nDate: Fri, 16 Feb 2018 07:52:46 GMT\r\nServer: Apache/2.4.23 (Linux/SUSE)\r\nX-MirrorBrain-Mirror: widehat.opensuse.org\r\nX-MirrorBrain-Realm: country\r\nLink: http://download.opensuse.org/distribution/leap/15.0/repo/oss/x86_64/gmp-deve...; rel=describedby; type=\"application/metalink4+xml\"\r\nLink: http://download.opensuse.org/distribution/leap/15.0/repo/oss/x86_64/gmp-deve...; rel=describedby; type=\"application/x-bittorrent\"\r\nLink: http://widehat.opensuse.org/distribution/leap/15.0/repo/oss/x86_64/gmp-devel...; rel=duplicate; pri=1; geo=de\r\nLink: http://ftp.uni-erlangen.de/pub/mirrors/opensuse/distribution/leap/15.0/repo/...; rel=duplicate; pri=2; geo=de\r\nLink: http://ftp.rz.uni-wuerzburg.de/pub/linux/opensuse/distribution/leap/15.0/rep...; rel=duplicate; pri=3; geo=de\r\nLink: http://suse.uni-leipzig.de/pub/ftp.opensuse.org/opensuse/distribution/leap/1...; rel=duplicate; pri=4; geo=de\r\nLink: <http://ftp.halifax.rwth-aachen.de/opensuse/distribution/leap/15.0/re"..., 8192, 0, NULL, NULL) = 2042 3376 08:52:46.422446 close(9) = 0 3376 08:52:46.422767 socket(AF_INET, SOCK_DGRAM|SOCK_CLOEXEC, IPPROTO_IP) = 9 3376 08:52:46.422814 connect(9, {sa_family=AF_INET, sin_port=htons(80), sin_addr=inet_addr("62.146.92.202")}, 16) = 0 3376 08:52:46.422871 getsockname(9, {sa_family=AF_INET, sin_port=htons(51947), sin_addr=inet_addr("172.16.0.3")}, [28->16]) = 0 3376 08:52:46.422896 close(9) = 0 3376 08:52:46.422918 socket(AF_INET6, SOCK_DGRAM|SOCK_CLOEXEC, IPPROTO_IP) = 9 3376 08:52:46.422938 connect(9, {sa_family=AF_INET6, sin6_port=htons(80), inet_pton(AF_INET6, "2a01:138:a004:0:230:48ff:fe80:9a32", &sin6_addr), sin6_flowinfo=htonl(0), sin6_scope_id=0}, 28) = 0 3376 08:52:46.422972 getsockname(9, {sa_family=AF_INET6, sin6_port=htons(35560), inet_pton(AF_INET6, "2001:a62:816:91ff:a572:884d:f51d:1a86", &sin6_addr), sin6_flowinfo=htonl(0), sin6_scope_id=0}, [28]) = 0 3376 08:52:46.423000 close(9) = 0 3376 08:52:46.423044 socket(AF_INET6, SOCK_STREAM, IPPROTO_TCP) = 9 3376 08:52:46.423092 connect(9, {sa_family=AF_INET6, sin6_port=htons(80), inet_pton(AF_INET6, "2a01:138:a004:0:230:48ff:fe80:9a32", &sin6_addr), sin6_flowinfo=htonl(0), sin6_scope_id=0}, 28 Olaf
![](https://seccdn.libravatar.org/avatar/8f947802c8278f7de589d948d49d1c97.jpg?s=120&d=mm&r=g)
Hi, On 2018-02-16 08:56:32 +0100, Olaf Hering wrote:
Am Thu, 15 Feb 2018 21:30:27 +0100 schrieb Marcus Hüwe
: Hmm this should not happen. Can you post the output of "osc -d build..." to see where it hangs? Does strace reveal anything suspicious?
It hangs in ipv6 connect:
<SNIP>
3376 08:52:46.358010 socket(AF_INET6, SOCK_STREAM, IPPROTO_TCP) = 9 3376 08:52:46.358090 connect(9, {sa_family=AF_INET6, sin6_port=htons(80), inet_pton(AF_INET6, "2001:67c:2178:8::13", &sin6_addr), sin6_flowinfo=htonl(0), sin6_scope_id=0}, 28) = 0 3376 08:52:46.372594 sendto(9, "GET /repositories/openSUSE:/Leap:/15.0/standard/x86_64/gmp-devel-6.1.2-lp150.1.26.x86_64.rpm HTTP/1.1\r\nAccept-Encoding: identity\r\nHost: download.opensuse.org\r\nConnection: close\r\nUser-Agent: osc/0.162.1\r\n\r\n", 205, 0, NULL, 0) = 205 3376 08:52:46.373461 recvfrom(9, "HTTP/1.1 302 Found\r\nDate: Fri, 16 Feb 2018 07:52:46 GMT\r\nServer: Apache/2.4.23 (Linux/SUSE)\r\nLocation: http://download.opensuse.org/distribution/leap/15.0/repo/oss/x86_64/gmp-devel-6.1.2-lp150.1.26.x86_64.rpm\r\nContent-Length: 380\r\nConnection: close\r\nContent-Type: text/html; charset=iso-8859-1\r\n\r\n<!DOCTYPE HTML PUBLIC \"-//IETF//DTD HTML 2.0//EN\">\n<html><head>\n<title>302 Found</title>\n</head><body>\n<h1>Found</h1>\n<p>The document has moved http://download.opensuse.org/distribution/leap/15.0/repo/oss/x86_64/gmp-devel-6.1.2-lp150.1.26.x86_64.rpm\">here</a>.</p>\n<hr>\n<address>Apache/2.4.23 (Linux/SUSE) Server at download.opensuse.org Port 80</address>\n</body></html>\n", 8192, 0, NULL, NULL) = 677
<SNIP>
3376 08:52:46.423044 socket(AF_INET6, SOCK_STREAM, IPPROTO_TCP) = 9 3376 08:52:46.423092 connect(9, {sa_family=AF_INET6, sin6_port=htons(80), inet_pton(AF_INET6, "2a01:138:a004:0:230:48ff:fe80:9a32", &sin6_addr), sin6_flowinfo=htonl(0), sin6_scope_id=0}, 28
It seems that widehat.opensuse.org (2a01:138:a004:0:230:48ff:fe80:9a32) does not accept an ipv6 connect. A simple telnet 2a01:138:a004:0:230:48ff:fe80:9a32 80 results in a timeout (ETIMEDOUT during connect(...)). Hence, it looks like an issue with widehat.opensuse.org. Marcus -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-buildservice+owner@opensuse.org
participants (2)
-
Marcus Hüwe
-
Olaf Hering