Comment # 8
on bug 1203630
from Bernd Senf
I have also many Linux workstations and servers with the same bug and decided
to downgrade from 5.14.21-150400.24.21-default ->
5.14.21-150400.24.18-default.
For me the problem are related with NFS:
a) try to mount NFS directories without permission also cases stacktrace
expected: any warning, skip mounting
happened: CPU stuck, stack trace, processes not killable anymore
b) mount points are active and remote server goes down or does reboot
expected: NFS hangs
happened: CPU stuck, stack trace
-----
Oct 06 10:12:10 schelling automount[2580]: attempting to mount entry /home/loki
Oct 06 10:12:10 schelling kernel: BUG: workqueue leaked lock or atomic:
kworker/u25:0/0x00000001/196
last function: xs_error_handle [sunrpc]
Oct 06 10:12:10 schelling kernel: CPU: 1 PID: 196 Comm: kworker/u25:0 Tainted:
P OE X N 5.14.21-150400.24.21-default #1 SLE15-SP4
7550826c4c7e8c258239e300508e0c8b2a69bad2
Oct 06 10:12:10 schelling kernel: Hardware name: System manufacturer System
Product Name/PRIME B360-PLUS, BIOS 0802 06/20/2018
Oct 06 10:12:10 schelling kernel: Workqueue: xprtiod xs_error_handle [sunrpc]
Oct 06 10:12:10 schelling kernel: Call Trace:
Oct 06 10:12:10 schelling kernel: <TASK>
Oct 06 10:12:10 schelling kernel: dump_stack_lvl+0x45/0x5b
Oct 06 10:12:10 schelling kernel: process_one_work+0x390/0x440
Oct 06 10:12:10 schelling kernel: worker_thread+0x2d/0x3d0
Oct 06 10:12:10 schelling kernel: ? process_one_work+0x440/0x440
Oct 06 10:12:10 schelling kernel: kthread+0x154/0x180
Oct 06 10:12:10 schelling kernel: ? set_kthread_struct+0x50/0x50
Oct 06 10:12:10 schelling kernel: ret_from_fork+0x1f/0x30
Oct 06 10:12:10 schelling kernel: </TASK>
Oct 06 10:12:10 schelling kernel: BUG: scheduling while atomic:
kworker/u25:0/196/0x00000002
Oct 06 10:12:10 schelling kernel: Modules linked in: nfsv3 nfs_acl isofs
rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace sunrpc fscache
netfs af_packet nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet
nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct iscsi_ibft iscsi_boot_sysfs
nft_chain_nat nf_tables ebtable_nat ebtable_broute ip6table_nat ip6table_mangle
ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6
nf_defrag_ipv4 libcrc32c iptable_mangle iptable_raw iptable_security ip_set
nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter
bpfilter dmi_sysfs intel_rapl_msr intel_rapl_common nvidia_drm(POEX)
nvidia_modeset(POEX) snd_sof_pci_intel_cnl snd_sof_intel_hda_common
intel_tcc_cooling(N) soundwire_intel soundwire_generic_allocation
x86_pkg_temp_thermal nvidia_uvm(POEX) intel_powerclamp soundwire_cadence
snd_sof_intel_hda coretemp snd_sof_pci snd_sof_xtensa_dsp mei_hdcp(N) snd_sof
soundwire_bus snd_soc_skl kvm_intel
Oct 06 10:12:10 schelling kernel: snd_soc_hdac_hda snd_hda_ext_core iTCO_wdt
snd_soc_sst_ipc intel_pmc_bxt snd_soc_sst_dsp iTCO_vendor_support ee1004(N)
mfd_core snd_soc_acpi_intel_match snd_soc_acpi kvm snd_soc_core
snd_hda_codec_realtek eeepc_wmi(N) asus_wmi snd_hda_codec_generic battery
sparse_keymap platform_profile irqbypass nls_iso8859_1 nvidia(POEX)
snd_compress ledtrig_audio snd_hda_codec_hdmi rfkill nls_cp437 pcspkr
snd_pcm_dmaengine wmi_bmof snd_usb_audio vfat snd_hda_intel efi_pstore(N) fat
uvcvideo snd_intel_dspcfg snd_intel_sdw_acpi snd_hda_codec videobuf2_vmalloc
snd_usbmidi_lib videobuf2_memops videobuf2_v4l2 drm_kms_helper snd_hda_core
snd_rawmidi videobuf2_common snd_hwdep snd_seq_device snd_pcm videodev cec
r8169 mei_me snd_timer rc_core realtek mdio_devres i2c_i801 snd libphy
i2c_smbus syscopyarea mc sysfillrect sysimgblt mei fb_sys_fops soundcore
thermal fan intel_pmc_core acpi_pad drm fuse configfs ip_tables x_tables ext4
crc16 mbcache jbd2 hid_generic usbhid sr_mod
Oct 06 10:12:10 schelling kernel: sd_mod cdrom crc32_pclmul crc32c_intel
xhci_pci xhci_pci_renesas ghash_clmulni_intel xhci_hcd nvme ahci aesni_intel
libahci crypto_simd usbcore cryptd nvme_core libata nvme_common t10_pi wmi
video button sg dm_multipath dm_mod scsi_dh_rdac scsi_dh_emc scsi_dh_alua
scsi_mod msr efivarfs
Oct 06 10:12:10 schelling kernel: Supported: No, Proprietary and Unsupported
modules are loaded
Oct 06 10:12:10 schelling kernel: CPU: 1 PID: 196 Comm: kworker/u25:0 Tainted:
P OE X N 5.14.21-150400.24.21-default #1 SLE15-SP4
7550826c4c7e8c258239e300508e0c8b2a69bad2
Oct 06 10:12:10 schelling kernel: Hardware name: System manufacturer System
Product Name/PRIME B360-PLUS, BIOS 0802 06/20/2018
Oct 06 10:12:10 schelling kernel: Workqueue: 0x0 (xprtiod)
Oct 06 10:12:10 schelling kernel: Call Trace:
Oct 06 10:12:10 schelling kernel: <TASK>
Oct 06 10:12:10 schelling kernel: dump_stack_lvl+0x45/0x5b
Oct 06 10:12:10 schelling kernel: __schedule_bug+0x52/0x70
Oct 06 10:12:10 schelling kernel: __schedule+0xdc4/0x1140
Oct 06 10:12:10 schelling kernel: ? dump_stack_lvl+0x4a/0x5b
Oct 06 10:12:10 schelling kernel: schedule+0x64/0xe0
Oct 06 10:12:10 schelling kernel: worker_thread+0xab/0x3d0
Oct 06 10:12:10 schelling kernel: ? process_one_work+0x440/0x440
Oct 06 10:12:10 schelling kernel: kthread+0x154/0x180
Oct 06 10:12:10 schelling kernel: ? set_kthread_struct+0x50/0x50
Oct 06 10:12:10 schelling kernel: ret_from_fork+0x1f/0x30
Oct 06 10:12:10 schelling kernel: </TASK>
Oct 06 10:12:53 schelling kernel: BUG: workqueue lockup - pool cpus=3 node=0
flags=0x0 nice=0 stuck for 42s!
Oct 06 10:12:53 schelling kernel: Showing busy workqueues and worker pools:
Oct 06 10:12:53 schelling kernel: workqueue events: flags=0x0
Oct 06 10:12:53 schelling kernel: pwq 6: cpus=3 node=0 flags=0x0 nice=0
active=1/256 refcnt=2
Oct 06 10:12:53 schelling kernel: pending: kfree_rcu_monitor
Oct 06 10:12:53 schelling kernel: workqueue events_power_efficient: flags=0x80
Oct 06 10:12:53 schelling kernel: pwq 6: cpus=3 node=0 flags=0x0 nice=0
active=1/256 refcnt=2
Oct 06 10:12:53 schelling kernel: pending: neigh_periodic_work
Oct 06 10:12:53 schelling kernel: workqueue mm_percpu_wq: flags=0x8
Oct 06 10:12:53 schelling kernel: pwq 6: cpus=3 node=0 flags=0x0 nice=0
active=2/256 refcnt=4
Oct 06 10:12:53 schelling kernel: pending: vmstat_update,
lru_add_drain_per_cpu BAR(105)
Oct 06 10:13:04 schelling kernel: watchdog: BUG: soft lockup - CPU#3 stuck for
52s! [mount.nfs:2665]
Oct 06 10:13:04 schelling kernel: Modules linked in: nfsv3 nfs_acl isofs
rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace sunrpc fscache
netfs af_packet nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet
nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct iscsi_ibft iscsi_boot_sysfs
nft_chain_nat nf_tables ebtable_nat ebtable_broute ip6table_nat ip6table_mangle
ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6
nf_defrag_ipv4 libcrc32c iptable_mangle iptable_raw iptable_security ip_set
nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter
bpfilter dmi_sysfs intel_rapl_msr intel_r