[opensuse-buildservice] Slow http performance
Greetings: We are using osc, version 131, to download binary files from a build repo (osc getbinaries). We are noticing 2x performance differences in download speeds on different OBS2.1 service hosts. The disk io speeds & bit transfer rates to storage are exactly the same on both hosts (verified with dd calls). The osc download requests are to local host services. On the slow performer, I see ruby trace calls referencing '_session' variables, as well as a 'Cookie' reference. We don't see this problem on an old OBS1.6 installation. We thought disabling ssl checks (sslcertck=0) would speed up the transfer - but this makes no difference. Here's the html header: send: 'GET /build/Project:700: Builder_2/rhel5/i586/......4.1.el5.i386.rpm HTTP/1.1\r\nAccept-Encoding: identity\r\nHost: obs-......com\r\nCookie: opensuse_webclient_session=0blongkey; _frontend_session=BAlongkey--65bblongkey\r\nConnection: close\r\nUser-Agent: osc/0.131\r\n\r\n' The traceroute calls all have a single hop to the local host. We are using ssl encryption. Any ideas as to how we might tune this - or what could be causing these differences in download speed? Thanks. Jeff Glanz Dell | PG Release Engineering Team office + 1 512 724 9509 -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
We root caused this: A remote build system in India was referencing an LDAP host in America. Take care with your LDAP configuration settings in your obs-api setup. Keep them together in proximate regions. Jeff Glanz Dell | PG Release Engineering Team office + 1 512 724 9509 -----Original Message----- From: Glanz, Jeff Sent: Tuesday, August 30, 2011 2:12 PM To: opensuse-buildservice@opensuse.org Cc: Whiteman, George; S, Prabhakar Subject: [opensuse-buildservice] Slow http performance Greetings: We are using osc, version 131, to download binary files from a build repo (osc getbinaries). We are noticing 2x performance differences in download speeds on different OBS2.1 service hosts. The disk io speeds & bit transfer rates to storage are exactly the same on both hosts (verified with dd calls). The osc download requests are to local host services. On the slow performer, I see ruby trace calls referencing '_session' variables, as well as a 'Cookie' reference. We don't see this problem on an old OBS1.6 installation. We thought disabling ssl checks (sslcertck=0) would speed up the transfer - but this makes no difference. Here's the html header: send: 'GET /build/Project:700: Builder_2/rhel5/i586/......4.1.el5.i386.rpm HTTP/1.1\r\nAccept-Encoding: identity\r\nHost: obs-......com\r\nCookie: opensuse_webclient_session=0blongkey; _frontend_session=BAlongkey--65bblongkey\r\nConnection: close\r\nUser-Agent: osc/0.131\r\n\r\n' The traceroute calls all have a single hop to the local host. We are using ssl encryption. Any ideas as to how we might tune this - or what could be causing these differences in download speed? Thanks. Jeff Glanz Dell | PG Release Engineering Team office + 1 512 724 9509 -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
Am Dienstag, 13. September 2011, 15:48:17 schrieb Jeff_Glanz@Dell.com:
We root caused this: A remote build system in India was referencing an LDAP host in America. Take care with your LDAP configuration settings in your obs-api setup. Keep them together in proximate regions.
you can also install a local openldap server on the host in India which is proxying & caching the requests to America.
Jeff Glanz Dell | PG Release Engineering Team office + 1 512 724 9509
-----Original Message----- From: Glanz, Jeff Sent: Tuesday, August 30, 2011 2:12 PM To: opensuse-buildservice@opensuse.org Cc: Whiteman, George; S, Prabhakar Subject: [opensuse-buildservice] Slow http performance
Greetings:
We are using osc, version 131, to download binary files from a build repo (osc getbinaries).
We are noticing 2x performance differences in download speeds on different OBS2.1 service hosts. The disk io speeds & bit transfer rates to storage are exactly the same on both hosts (verified with dd calls). The osc download requests are to local host services. On the slow performer, I see ruby trace calls referencing '_session' variables, as well as a 'Cookie' reference.
We don't see this problem on an old OBS1.6 installation. We thought disabling ssl checks (sslcertck=0) would speed up the transfer - but this makes no difference.
Here's the html header: send: 'GET /build/Project:700: Builder_2/rhel5/i586/......4.1.el5.i386.rpm HTTP/1.1\r\nAccept-Encoding: identity\r\nHost: obs-......com\r\nCookie: opensuse_webclient_session=0blongkey; _frontend_session=BAlongkey--65bblongkey\r\nConnection: close\r\nUser-Agent: osc/0.131\r\n\r\n'
The traceroute calls all have a single hop to the local host. We are using ssl encryption.
Any ideas as to how we might tune this - or what could be causing these differences in download speed?
Thanks.
Jeff Glanz Dell | PG Release Engineering Team office + 1 512 724 9509 -- Adrian Schroeter SUSE Linux Products GmbH email: adrian@suse.de
participants (2)
-
Adrian Schröter -
Jeff_Glanz＠Dell.com