October 2022 - Heroes - openSUSE Mailing Lists

improving download.o.o
by Bernhard M. Wiedemann 12 Oct '22

12 Oct '22

Hi, as you might know, pontifex2 aka download.o.o serves 4 major roles atm. 1. download.opensuse.org redirector for zypper repos 2. downloadcontent.opensuse.org fallback mirror 3. stage.opensuse.org rsync source server for major mirrors 4. repopusher to 6 mirrors During August, my nagios monitoring has logged at least 20+10+20+19+22+70+30+10+20+10+10 minutes of high packet loss on download.o.o - that is 241m or 4h When I captured a tcpdump during such a troublesome moment, I found that 89% of it was rsync traffic and the total traffic sent was between 2.5 and 3 GBit/s on average, with 60 different mirror IPs. We only have a 4GBit/s link there shared for all of the Nuremberg SUSE Maxtorhof stuff. That indicates that 3. and 4. above saturated the link and that contibuted to high packet loss that makes for a very poor user-experience of download.o.o users. With 60 mirrors rsyncing simultaneously at 3GBit, that leaves around 6 MByte/s for each mirror and that means, syncing just 122GB of Factory takes over 5h. [Math 122000/(3000.0/8/60)/60/60 => 5.4 ] To solve this, we should try to separate these roles so that they conflict less with each other. The first thing we should try is to move out and split stage.o.o . Ideally, the data should be transferred only once to each continent via repopusher and then other mirrors pull from these primary mirrors. Another easy improvement might be to serve download.o.o via mirrorcache from another network. This might not even need much bandwidth as it mostly serves redirects. I'd like to have Andrii's opinion on this, once he is back from vacation. As this is a major change to our download infra, I don't want to decide on that alone, so I'd appreciate your feedback if and how we should change things. Ciao Bernhard M.

4 7

Meeting minutes
by Christian Boltz 06 Oct '22

06 Oct '22

Hello, here are the minutes of today's heroes meeting: * downloadcontent2.o.o (a cloud VM) improved the stability of download.o.o a lot - documented at https://progress.opensuse.org/projects/opensuse-admin-wiki/wiki/ Downloadcontent2 * /update/leap/15.3/sle/repodata/*-primary.xml.gz (120 MB) is a "hot" file causing traffic spikes * not pushing Tumbleweed images in home repos can save traffic - they get rebuilt more often than downloaded * there's desire for a new server (3 TB SSD disk, 10 GBit network) that can host the most important repos and will serve as a rsync master for most mirrors (not certain yet) * mirrorcache-br.o.o * was cache.opensuse.net.br * https://progress.opensuse.org/issues/116710 - "collect root passwords" (or not) * Georg: root password hashes to be set to * in /etc/shadow * (which also means we'll enforce using sudo or ssh-key) * Georg: close GDPR related tickets with reference to privacy at suse.com * Georg: close email alias related tickets with reference to https://code.opensuse.org/project/membership/new_issue Regards, Christian Boltz -- Es wird also sehr wohl gemountet, wie soll denn yast sonst auf die CD zugreifen? Per dd erstmal alles auf die HD kopieren? Oder lässt es sich die Pakete vielleicht als .wav vorsingen? [Jan Trippler in suse-linux]

1 0

Reminder: Heroes meeting on Thursday
by Christian Boltz 06 Oct '22

06 Oct '22

Hello, the next heroes meeting will be on Thursday (2022-10-06) at 18:00 UTC / 20:00 CEST in https://meet.opensuse.org/heroes So far the meeting ticket https://progress.opensuse.org/issues/116140 lists the usual topics. Feel free to add whatever you want to discuss, or just bring it up during the meeting. Regards, Christian Boltz -- Die Borg sind einfach eine Allegorie auf M$: gross, toll und voller endloser Featuritis - aber wenn es ernst wird, sterben sie an einer Schutzverletzung. [Andreas Pohlke in drsst]

2 1

Spam is increasing
by Carlos E. R. 02 Oct '22

02 Oct '22

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On users-es(a)lists.opensuse.org and users(a)lists.opensuse.org. Also factory(a)lists.opensuse.org. - -- Cheers Carlos E. R. (from openSUSE Leap 15.3 at Telcontar) -----BEGIN PGP SIGNATURE----- iHYEARECADYWIQQZEb51mJKK1KpcU/W1MxgcbY1H1QUCYzbUsRgcY2FybG9zLmUu ckBvcGVuc3VzZS5vcmcACgkQtTMYHG2NR9UiYgCfRqCvxMGa2iV2y+lAacwvpDhB PxYAn1Ywc3gs+fzUnHqUuI5VXVqTUWE6 =NFTS -----END PGP SIGNATURE-----

5 16