Hello, here are the minutes of today's^Wyesterday's heroes meeting: 2023-10-05 heroes meeting Start Time - 2000 CEST Attendees: Bill, Neal, Georg, Carlos, "Captain Tofu", Christian Boltz, Luciano S Status reports: - Lots of salt activity to prepare the move to Prague datacenter - Proposal to add attendees to meeting notes -> ok - Positive feedback from the new CDN with US users Infra notes - Determine whether to redeploy from scratch or reconfig existing Servers (relocation to Prague DC, working from Georg's spreadsheet) * Crtmgr * Separate crtmgr between employee and infra * Leave old crtmgr to build test * Verify salt on the crtmgr setup * Elsa * Redeploy HAProxy (public services) with Salt * Internal mail relay (include in existing mx*.i.o.o * Deploy new NTP (chronyd) with Salt * Drop turnserver (only used by Jitsi) * Deploy new internal DB HProxy + PgBouncer with Salt (ex Ipsilon) * Mickey * Copy 1:1 * Jekyll * Redeploy with Salt (Check SSH keys for redeployment) * Anna * Same as Elsa * Backup * Copy 1:1 * Int * Copy 1:1 check with mjambor@suse.cz * Chip * Redeploy Salt with Leap * Finish deployment of PowerDNS (dnsdist in front, maybe Unbound for internal DNS) * Goal is to decommisssion BIND and DNSmasq * Man * Copy 1:1 ? * Runs RPM to docsrv * SUSE to check with tkukuk * Community * Copy 1:1 unless @lkocman provides a package * Hosts docs * Community 2 * Factory dashboard * gets two html pages rsynced (rsyncd running), check with dimstar/fvogt for alternative ways * Other services unknown? (a few more hosts configured in nginx, but not reachable via haproxy) * Who owns the system ? * Do we need to move this to something else ? * for now, copy 1:1 * discourse01 * copy 1:1 * mirrorcache* * check with anikitin * dale * copy 1:1, coordinate with henne * discourse01 * copy 1:1 * elections2 * redeploy with salt, keep copy as fallback * etherpad * copy 1:1 * is data in mysql? -> check * freeipa * copy 1:1 * freeipa2 * copy 1:1 * galera* * setup new VMs, copy over databases while migrating services * ideally salt the setup (Georg has SUSE salt states we could use as base, but they need cleanup) - volunteer needed * obsreview * copy 1:1 * check with henne * identification2 * unused, drop * jenkins-agent * idle VM, re-create * opi-proxy * copy 1:1 * jenkins * idle VM, re-create * kali * check with Lars * limesurvey * try to re-deploy with salt, keep VM copy as fallback * malman3 * re-deploy with salt, keep VM copy as fallback * matomo * copy 1:1 * matrix * maintainer to re-deploy with salt, otherwise copy 1:1 * metrics * copy 1:1 * minnie * drop (new salt master will be deployed) * mirrordb* * actually "just" a pgsql cluster * try to re-deploy with salt (repmgr part might need to be manual) * choose a better hostname ;-) * monitor * copy 1:1 * mx* and test-mx * copy 1:1 (check with pjessen, salt available) * narwal* * re-deploy with salt (needds updated ssh host keys in salt) * nue-ns* * manually re-deploy or copy 1:1, update config (chip.i.o.o config might need updated) * consider to replace with proper PowerDNS setup later * nuka * copy 1:1, clarify with Antonio/Marketa * olaf * copy 1:1 with less resources * remainders of MirrorBrain - consolidate into another machine? * osc-collab * copy 1:1, clarify with dimstar * pagure01 * re-deploy with salt, check with Neal * pinot * re-deploy with salt * pontifex2 * check with build team / Andrii * progressoo * copy 1:1, re-deploy with salt * riesling * copy 1:1 * riesling3 * copy 1:1 * rpmlint * copy 1:1 * scar * SUSE to deploy new OpenVPN server and migrate configurations and CA (easyrsa) * Firewall parts replaced by asgard* * svn * svn.o.o is broken (404) * also hosts kernel.o.o - candidate for move to narwal* - check with kernel team * tsp * copy 1:1 * water* * copy 1:1 Long-term Goals - Explore Leap Micro for redeployments (and create SOP) - How can we turn packages into containers for expanding workload scalability State of Jitsi * Packages are out of date and need refreshing, help welcome * Package sources: https://build.opensuse.org/project/show/openSUSE:infrastructure:jitsi Regards, Christian Boltz -- "Does your computer ever crash?" "Oh definitely, believe me. We want to make a tool that we can use ourselves and we know from our own use we can make it a lot better and a lot more reliable." [Bill Gates in a BBC interview]