------- Original Message ------- On Thursday, March 24th, 2022 at 3:37 PM, Robert Munteanu <rombert@apache.org> wrote:
On Wed, 2022-03-23 at 11:54 +0100, Robert Munteanu wrote:
Hi Thorsten,
On Wed, 2022-03-23 at 11:42 +0100, Thorsten Kukuk wrote:
On Wed, Mar 23, Robert Munteanu wrote:
I have the same problem with kubic cluster:
$ kubectl -n kube-system logs weave-net-8mmmc -c weave-init
modprobe: can't load module nfnetlink
(kernel/net/netfilter/nfnetlink.ko.zst): invalid module format
Ignore the error if "xt_set" is built-in in the kernel
Works fine for me (but it's not running kubernetes):
microos:~ # lsmod |grep nfnetlink
nfnetlink 20480 0
microos:~ # cat /etc/os-release
NAME="openSUSE MicroOS"
# VERSION="20220321"
Could it be that your disk is full or the nfnetlink.ko.zst
corrupted
in
any other way?
What das "rpm -V kernel-default" say?
I already rolled back following Richard's ask to test older snapshots
and the problem is (temporarily) solved.
FWIW, the old kernel version was 5.16.14 and the new one was 5.16.15
.
I don't think free space is an issue, all my kubic VMs have at least
5
GB available on the root partition after a rollback and 8 GB on /var.
I
don't think the snapshot rollback freed up that much space.
Also, the problem affected all 3 VMs, no pods would get an IP
address,
so I'm not sure this was a disk space problem.
If you think this is useful, I will try and get another VM rolled
forward to the latest kernel version and check the free space issue
and
the kernel RPM integrity.
I see no obvious issues on the latest Kubic image. kubicmaster:~ # rpm -V kernel-default kubicmaster:~ # uname -a Linux kubicmaster 5.16.15-1-default #1 SMP PREEMPT Wed Mar 16 23:33:05 UTC 2022 (d8f0e40) x86_64 x86_64 x86_64 GNU/Linux kubicmaster:~ # lsmod | grep -i nfnetlink nfnetlink_log 20480 2 nfnetlink 20480 3 ip_set,nfnetlink_log
I would suggest that the Kubic project makes a statement on the
installation pages regarding the availability of such container images.
We've been there before, so to avoid issues we make a copy of the kube-system images at $dayjob that now holds the 1.23.0 images: https://registry.antavo.com/kubic Also, wondering if we should open a bug report on this issue instead of running the thread here? -- Br, A.