On Sun, 16 Jun 2019 10:17:57 +0200 Per Jessen wrote:
dieter wrote:
On Sat, 15 Jun 2019 22:34:31 +0200 Carlos E. R. wrote:
On 15/06/2019 18.08, dieter wrote:
On Sat, 15 Jun 2019 12:46:14 +0200 Carlos E. R. wrote:
[snip]
Not good enough. Say the kernel, it is downloaded simultaneously from 3 mirrors. A proxy cache would end storing 3 identical copies of the kernel, wasting space and download pipe. It does not recognize that they are the same thing.
I have the impression that this can be avoided by setting ZYPP_MULTICURL=0
Yes, I think this will prevent the chunked download, but with squid you would still be caching multiple mirrors.
A caching solution as suggested by Pete would be really great. But I am a fan of the UNIX philosophy "do one thing and do it well". And in this respect to add the caching/serving functionality to the zypper download library does not feel right for me. I do not want so sell "my solution", I am only describing what worked for me so far. As I already mentioned I did not use squid but wwwoffle. For me it was not relevant to actually see the cached rpms in the cache directory as Pete would prefer. For Leap updates (my main use case) a single mirror can easily saturate my download link, so ZYPP_MULTICURL=0 is no limitation. This is also a difference to Pete's intended focus Tumbleweed were it could be more desirable to use several mirrors in parallel when everybody is downloading a new snapshot. Without setting ZYPP_MULTICURL wwwoffle served corrupted RPMs. Just some weeks ago I updated several installations, partly VMs, from Leap 15.0 to 15.1 by "zypper dup". I used a Leap 42.3 VM with wwwoffle (it was still part of the distro then) as caching proxy. These updates happened within some days. The given numbers are from memory, so I may be wrong. But I checked them then because I was interested in the data and found them satisfying. The updated systems are not identical installations, but similar. According to zypper dup the "Overall download size" varied between 1.7GB and 2.4GB. For the first update the ifconfig output of transferred data (RX/TX) in the 42.3-wwwoffle-VM was very close to the amount predicted by zypper (slightly higher, possibly IP overhead and the like). For the following updates the TX amount was again close to the amount predicted by zypper (e.g. 2.3GB) and the RX amount something like 380MB, which could be package differences (themes, fonts, ...) or repeated downloads of packages from different mirrors. For me it was good enough not to invest time to find out exactly. Also watching the download process of zypper dup most packages were received by the updating system with LAN speed, not with download speed. And looking now in my wwwoffle cache directory which was not purged yet: yes, not all packages were downloaded from the same mirror, but at least for the bigger files I checked they exist only once. But this approach is dated, Leap 42.3 will be out of maintenance soon and as soon as the openSUSE download links become https it will probably stop working anyway. When wwwoffle was removed with Leap 15.0 I checked whether squid could be a replacement for my use case, and decided it is way beyond what I need and not worth the hassle. Regards, Dieter -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-factory+owner@opensuse.org