http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c1 Stefan Dirsch changed: What |Removed |Added ---------------------------------------------------------------------------- Priority|P5 - None |P3 - Medium Status|NEW |IN_PROGRESS CC| |marix@marix.org Assignee|gfx-bugs@suse.de |sndirsch@suse.com Flags| |needinfo?(marix@marix.org) --- Comment #1 from Stefan Dirsch --- Hmm. nvidia-uvm should be loaded automatically once nvidia module gets loaded. How does /etc/modprobe.d/50-nvidia-default.conf look like? Please attach also result of nvidia-bug-report.sh run. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c3 --- Comment #3 from Matthias Bach --- Created attachment 839361 --> http://bugzilla.opensuse.org/attachment.cgi?id=839361&action=edit Result of nvidia-bug-report.sh -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c5 --- Comment #5 from Stefan Dirsch --- Looks good. I'm wondering which displaymanager you're using? gdm, sddm, lightdm, ... ? Which desktop? GNOME, KDE, xfce, ... ? -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c7 --- Comment #7 from Matthias Bach --- I am using sddm as the display manager. Desktop is KDE. But that should be irrelevant as the compute capabilities should are, if everything works correctly, also accessible without and desktop running. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c9 Stefan Dirsch changed: What |Removed |Added ---------------------------------------------------------------------------- Status|IN_PROGRESS |RESOLVED Resolution|--- |WORKSFORME --- Comment #9 from Stefan Dirsch --- So I did a fresh Leap 15.2 installation on my NVIDIA laptop. Worked fine for me. nvidia modules are loaded during boot including nvidia-uvm, permissions are set for the logged in user. # lsmod | grep nvidia nvidia_drm 53248 0 nvidia_modeset 1118208 1 nvidia_drm nvidia_uvm 1069056 0 nvidia 20721664 5 nvidia_uvm,nvidia_modeset ipmi_msghandler 69632 2 ipmi_devintf,nvidia drm_kms_helper 229376 2 nvidia_drm,i915 drm 544768 8 drm_kms_helper,nvidia_drm,i915 # getfacl /dev/nvidia* getfacl: Removing leading '/' from absolute path names # file: dev/nvidia0 # owner: root # group: video user::rw- user:tux:rw- group::rw- mask::rw- other::--- # file: dev/nvidiactl # owner: root # group: video user::rw- user:tux:rw- group::rw- mask::rw- other::--- # file: dev/nvidia-modeset # owner: root # group: video user::rw- user:tux:rw- group::rw- mask::rw- other::--- # file: dev/nvidia-uvm # owner: root # group: video user::rw- user:tux:rw- group::rw- mask::rw- other::--- (check the usr:tux:rw- lines) I noticed that the NVIDIA repository is not yet in the community repos. I will report this. Also I noticed, that the hardware supplements in G04/G05 are wrong, so G04 was autoselected instead of G05. Fixed this now. The fix will be available with the next NVIDIA RPM/repo update. It's embarassing, since this is broken for Leap already since 15.1. :-( -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c21 Stefan Dirsch changed: What |Removed |Added ---------------------------------------------------------------------------- Status|REOPENED |IN_PROGRESS --- Comment #21 from Stefan Dirsch --- Oh. I forgot, that this is also needed (will be included in %post script of updated package) mkdir -p /run/udev/static_node-tags/uaccess ln -snf /dev/nvidiactl /run/udev/static_node-tags/uaccess/nvidiactl ln -snf /dev/nvidia-uvm /run/udev/static_node-tags/uaccess/nvidia-uvm ln -snf /dev/nvidia-uvm-tools /run/udev/static_node-tags/uaccess/nvidia-uvm-tools ln -snf /dev/nvidia-modeset /run/udev/static_node-tags/uaccess/nvidia-modeset But this doesn't explain, why nvidia-uvm isn't loaded and the device not being created. It should be done via the modprobe scriptlet. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c23 --- Comment #23 from Matthias Bach --- I just re-verified. Sadly, even with the links created as the %postin script would, SDDM black-screens when the tarball is applied. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c25 Mister Pend changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |thechode@gmail.com --- Comment #25 from Mister Pend --- Created attachment 839480 --> http://bugzilla.opensuse.org/attachment.cgi?id=839480&action=edit sample files from two machines sample files from two machines, one working one not -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c27 --- Comment #27 from Stefan Dirsch ---

I haven't applied the tarball suggested (the reports above gave me pause), but did notice once discrepancy with your tarball: you seem > to be missing this final line from /usr/lib/tmpfiles.d/nvidia-logind-acl-trick-G05.conf:

L /run/udev/static_node-tags/uaccess/nvidia0 - - - - /dev/nvidia0

Thanks! Good catch! This is definitely needed and may explain the black screen Matthias sees now with SDDM.

Also, my test machine (working) is lacking /dev/nvidia-uvm-tools, but CUDA still functions fine:

Looks like it depends, which functionality you require whether you need this device or not. I figured out that it already exists since driver version 364 (March 2016). It's weird to see not getting reports earlier and now with Leap 15.2 several at about the same day even! -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c29 --- Comment #29 from Stefan Dirsch ---

getfacl /dev/nvidia* [...] @Mister Pend Seeems only gdm has access to your nvidia devices? It should look different once a regular user has logged into the session.

-- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c31 --- Comment #31 from Mister Pend --- (In reply to Stefan Dirsch from comment #29)

...

getfacl /dev/nvidia* [...] @Mister Pend Seeems only gdm has access to your nvidia devices? It should look different once a regular user has logged into the session.

Correct, I had SSH'ed into the test machine cause I was too lazy to set up VNC or walk across to the other end of my workshop :P once a regular user has logged on, they show as having access as well -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c33 --- Comment #33 from Stefan Dirsch --- (In reply to Mister Pend from comment #30)

(In reply to Stefan Dirsch from comment #28)

...

You're using different NVreg_DeviceFileGID on your machines (not using our default of 33). Also on the broken machine /usr/lib/tmpfiles.d/nvidia-logind-acl-trick.conf is missing completely.

I'm not sure how, I'm not doing anything out of the ordinary here - drivers were installed from NVIDIA repository as per my ansible tasklist (NVIDIA repository added 'https://download.nvidia.com/opensuse/leap/15.2', package 'x11-video-nvidiaG05' installed via zypper). And yes, that file is missing completely on a clean installed machine - I suspect it's presence on the working machine is due to driver package variances during it's life before I tested the upgrade on it.

Then there is something fishy. You must have edited manually /etc/modprobe.d/50-nvidia-default.conf in order to have a different NVreg_DeviceFileGID there. 33 is the group ID of video group. That's why we use it here. Probably it no longer matters since permissions are meanwhile set via udev/logind (ACLs). So I guess you can ignore this. /usr/lib/tmpfiles.d/nvidia-logind-acl-trick-G05.conf is created in %post of nvidia-gfxG05-kmp-default and only removed in %postun when uninstalled, not during an update. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c35 Nikolai Nikolaevskii changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |kaykaykay123@gmail.com --- Comment #35 from Nikolai Nikolaevskii --- So is this issue solved or not? My wild shot: GDM starts with root privileges, SDDM starts with ordinary user privileges. Maybe I am wrong. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c37 --- Comment #37 from Matthias Bach --- (In reply to Stefan Dirsch from comment #27)

...

I haven't applied the tarball suggested (the reports above gave me pause), but did notice once discrepancy with your tarball: you seem > to be missing this final line from /usr/lib/tmpfiles.d/nvidia-logind-acl-trick-G05.conf:

L /run/udev/static_node-tags/uaccess/nvidia0 - - - - /dev/nvidia0

Thanks! Good catch! This is definitely needed and may explain the black screen Matthias sees now with SDDM.

I can confirm that adding this line into the file will resolve the black-screen issue. Though I am still without compute capablities. (In reply to Stefan Dirsch from comment #24)

Hmm. You rebooted your machine afterwards, right? You could try running the script code in modprobe file manually for testing. I'm running out of ideas why things are not working for you.

Yes, I rebooted my machine. I have extracted the code from the install section of the modprobe file and running this via /bin/sh (which on my system means Bash) will create the missing files. root@eddie:~ # ls -l /dev/nvidia* crw-rw----+ 1 root video 195, 254 Jul 8 18:26 /dev/nvidia-modeset crw-rw---- 1 root video 239, 0 Jul 8 18:29 /dev/nvidia-uvm crw-rw---- 1 root video 239, 1 Jul 8 18:29 /dev/nvidia-uvm-tools crw-rw----+ 1 root video 195, 0 Jul 8 18:26 /dev/nvidia0 crw-rw----+ 1 root video 195, 255 Jul 8 18:26 /dev/nvidiactl In consequence, it seems like the modprobe file for some reason is not properly applied by machine despite being present. Could this be an issue of initalisation order? Could it be that some trigger condition for the modprobe is not being matched. Although it wound wonder me if those changed since 15.1. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c39 --- Comment #39 from Cor Blom --- I have build rev 71 of X11:Drivers:Video, i.e. before the version update to 45o.57, which, if I am correct contains all corrections mentioned in this report. I installed the packages. The bug is not solved for me. I observe the following (and I use for with ffmpeg and nvenc) As a regular user I get the error: [h264_nvenc @ 0x55de3a62d5c0] Cannot init CUDA When I execute the same command with sudo, it works. After that it also works as regular user. It seems that with executing the ffmpeg command as su, the nvidia-uvm device is made. Before the sudo it did not exist. I have only /dev/nvidia0 /dev/nvidiactl /dev/nvidia-modeset After executing the ffmpeg with the nvenc option as root two additional devices are added: /dev/nvidia-uvm /dev/nvidia-uvm-tools I have checked this once after a reboot. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c41 --- Comment #41 from Stefan Dirsch --- (In reply to Matthias Bach from comment #37)

(In reply to Stefan Dirsch from comment #27)

...

...

I haven't applied the tarball suggested (the reports above gave me pause), but did notice once discrepancy with your tarball: you seem > to be missing this final line from /usr/lib/tmpfiles.d/nvidia-logind-acl-trick-G05.conf:

L /run/udev/static_node-tags/uaccess/nvidia0 - - - - /dev/nvidia0

Thanks! Good catch! This is definitely needed and may explain the black screen Matthias sees now with SDDM.

I can confirm that adding this line into the file will resolve the black-screen issue. Though I am still without compute capablities.

Thanks. At least this we could fix again.

I have extracted the code from the install section of the modprobe file and running this via /bin/sh (which on my system means Bash) will create the missing files.

root@eddie:~ # ls -l /dev/nvidia* crw-rw----+ 1 root video 195, 254 Jul 8 18:26 /dev/nvidia-modeset crw-rw---- 1 root video 239, 0 Jul 8 18:29 /dev/nvidia-uvm crw-rw---- 1 root video 239, 1 Jul 8 18:29 /dev/nvidia-uvm-tools crw-rw----+ 1 root video 195, 0 Jul 8 18:26 /dev/nvidia0 crw-rw----+ 1 root video 195, 255 Jul 8 18:26 /dev/nvidiactl

Ah. Thanks for checking this1

In consequence, it seems like the modprobe file for some reason is not properly applied by machine despite being present. Could this be an issue of initalisation order? Could it be that some trigger condition for the modprobe is not being matched. Although it wound wonder me if those changed since 15.1.

That could be a good catch! The modprobe file is marked as %config, so possibly the old one has been backed up as .rpmsave, but preferred over the new one nevertheless. This would explain the behaviou at least. Could you check this and remove the old modprobe file. And test again? -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c43 --- Comment #43 from Stefan Dirsch ---

I have build rev 71 of X11:Drivers:Video, i.e. before the version update to 45o.57, which, if I am correct contains all corrections mentioned in this report.

Yes, that's perfect! Thanks for doing this! Unfortunately I cannot provide RPMs for testing for legal reasons here. Could you check if you have two modprobe files like /etc/modprobe.d/50-nvidia-default.conf /etc/modprobe.d/50-nvidia-default.conf.rpmsave See my comment#41. If yes, please remove the older file and try again (reboot is the easiest). -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c44 --- Comment #44 from Matthias Bach --- (In reply to Stefan Dirsch from comment #43)

Could you check if you have two modprobe files like

/etc/modprobe.d/50-nvidia-default.conf /etc/modprobe.d/50-nvidia-default.conf.rpmsave

See my comment#41. If yes, please remove the older file and try again (reboot is the easiest).

I only have the following: # ls /etc/modprobe.d/*nvidia* /etc/modprobe.d/50-nvidia-default.conf /etc/modprobe.d/nvidia-default.conf I do remember removing some rpmsave file at some point during my debugging but my last rounds of tests definitely already were performed without that file present. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c48 Cor Blom changed: What |Removed |Added ---------------------------------------------------------------------------- Flags|needinfo?(cornelis@solcon.n | |l) | --- Comment #48 from Cor Blom --- (In reply to Stefan Dirsch from comment #43)

Could you check if you have two modprobe files like

/etc/modprobe.d/50-nvidia-default.conf /etc/modprobe.d/50-nvidia-default.conf.rpmsave

See my comment#41. If yes, please remove the older file and try again (reboot is the easiest).

Yes, I had both. Removed the .rpmsave one and rebooted. It made not difference. I have backuped both files and can provide them, if necessary. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c52 --- Comment #52 from Matthias Bach --- Based on the previous test I have been able to solve the problem for myself. The solution is as obvious as hidden in plain sight. All I had to do was execute the following: /sbin/mkinitrd Still, I don't fully understand _why_ this solves the problem. I always assumed the driver installation to trigger this. Maybe Mister Pend or Cor Blom can confirm this behaviour. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c54 Matthias Bach changed: What |Removed |Added ---------------------------------------------------------------------------- Flags|needinfo?(marix@marix.org) | --- Comment #54 from Matthias Bach --- It seems the nvidia module is indeed added to the initrd. ✗ sudo lsinitrd /boot/initrd | grep nvidia [sudo] Passwort für root: -rw-r--r-- 1 root root 1483 Jul 7 11:46 etc/modprobe.d/50-nvidia-default.conf -rw-r--r-- 1 root root 18 Jun 25 17:23 etc/modprobe.d/nvidia-default.conf drwxr-xr-x 12 root root 0 Jul 10 20:26 lib/firmware/nvidia drwxr-xr-x 4 root root 0 Jul 10 20:26 lib/firmware/nvidia/gm200 drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gm200/acr -rw-r--r-- 1 root root 832 Mar 1 08:55 lib/firmware/nvidia/gm200/acr/bl.bin -rw-r--r-- 1 root root 10144 Mar 1 08:55 lib/firmware/nvidia/gm200/acr/ucode_load.bin -rw-r--r-- 1 root root 1440 Mar 1 08:55 lib/firmware/nvidia/gm200/acr/ucode_unload.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gm200/gr -rw-r--r-- 1 root root 576 Mar 1 08:55 lib/firmware/nvidia/gm200/gr/fecs_bl.bin -rw-r--r-- 1 root root 1968 Mar 1 08:55 lib/firmware/nvidia/gm200/gr/fecs_data.bin -rw-r--r-- 1 root root 16271 Mar 1 08:55 lib/firmware/nvidia/gm200/gr/fecs_inst.bin -rw-r--r-- 1 root root 76 Mar 1 08:55 lib/firmware/nvidia/gm200/gr/fecs_sig.bin -rw-r--r-- 1 root root 576 Mar 1 08:55 lib/firmware/nvidia/gm200/gr/gpccs_bl.bin -rw-r--r-- 1 root root 2056 Mar 1 08:55 lib/firmware/nvidia/gm200/gr/gpccs_data.bin -rw-r--r-- 1 root root 9768 Mar 1 08:55 lib/firmware/nvidia/gm200/gr/gpccs_inst.bin -rw-r--r-- 1 root root 76 Mar 1 08:55 lib/firmware/nvidia/gm200/gr/gpccs_sig.bin -rw-r--r-- 1 root root 7616 Mar 1 08:55 lib/firmware/nvidia/gm200/gr/sw_bundle_init.bin -rw-r--r-- 1 root root 5592 Mar 1 08:55 lib/firmware/nvidia/gm200/gr/sw_ctx.bin -rw-r--r-- 1 root root 10800 Mar 1 08:55 lib/firmware/nvidia/gm200/gr/sw_method_init.bin -rw-r--r-- 1 root root 1440 Mar 1 08:55 lib/firmware/nvidia/gm200/gr/sw_nonctx.bin drwxr-xr-x 4 root root 0 Jul 10 20:26 lib/firmware/nvidia/gm204 drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gm204/acr lrwxrwxrwx 1 root root 22 Jul 10 20:26 lib/firmware/nvidia/gm204/acr/bl.bin -> ../../gm200/acr/bl.bin lrwxrwxrwx 1 root root 30 Jul 10 20:26 lib/firmware/nvidia/gm204/acr/ucode_load.bin -> ../../gm200/acr/ucode_load.bin lrwxrwxrwx 1 root root 32 Jul 10 20:26 lib/firmware/nvidia/gm204/acr/ucode_unload.bin -> ../../gm200/acr/ucode_unload.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gm204/gr lrwxrwxrwx 1 root root 26 Jul 10 20:26 lib/firmware/nvidia/gm204/gr/fecs_bl.bin -> ../../gm200/gr/fecs_bl.bin -rw-r--r-- 1 root root 1968 Mar 1 08:55 lib/firmware/nvidia/gm204/gr/fecs_data.bin lrwxrwxrwx 1 root root 28 Jul 10 20:26 lib/firmware/nvidia/gm204/gr/fecs_inst.bin -> ../../gm200/gr/fecs_inst.bin -rw-r--r-- 1 root root 76 Mar 1 08:55 lib/firmware/nvidia/gm204/gr/fecs_sig.bin lrwxrwxrwx 1 root root 27 Jul 10 20:26 lib/firmware/nvidia/gm204/gr/gpccs_bl.bin -> ../../gm200/gr/gpccs_bl.bin -rw-r--r-- 1 root root 2056 Mar 1 08:55 lib/firmware/nvidia/gm204/gr/gpccs_data.bin lrwxrwxrwx 1 root root 29 Jul 10 20:26 lib/firmware/nvidia/gm204/gr/gpccs_inst.bin -> ../../gm200/gr/gpccs_inst.bin -rw-r--r-- 1 root root 76 Mar 1 08:55 lib/firmware/nvidia/gm204/gr/gpccs_sig.bin lrwxrwxrwx 1 root root 33 Jul 10 20:26 lib/firmware/nvidia/gm204/gr/sw_bundle_init.bin -> ../../gm200/gr/sw_bundle_init.bin lrwxrwxrwx 1 root root 25 Jul 10 20:26 lib/firmware/nvidia/gm204/gr/sw_ctx.bin -> ../../gm200/gr/sw_ctx.bin lrwxrwxrwx 1 root root 33 Jul 10 20:26 lib/firmware/nvidia/gm204/gr/sw_method_init.bin -> ../../gm200/gr/sw_method_init.bin lrwxrwxrwx 1 root root 28 Jul 10 20:26 lib/firmware/nvidia/gm204/gr/sw_nonctx.bin -> ../../gm200/gr/sw_nonctx.bin drwxr-xr-x 4 root root 0 Jul 10 20:26 lib/firmware/nvidia/gm206 drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gm206/acr lrwxrwxrwx 1 root root 22 Jul 10 20:26 lib/firmware/nvidia/gm206/acr/bl.bin -> ../../gm200/acr/bl.bin -rw-r--r-- 1 root root 10144 Mar 1 08:55 lib/firmware/nvidia/gm206/acr/ucode_load.bin -rw-r--r-- 1 root root 1440 Mar 1 08:55 lib/firmware/nvidia/gm206/acr/ucode_unload.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gm206/gr lrwxrwxrwx 1 root root 26 Jul 10 20:26 lib/firmware/nvidia/gm206/gr/fecs_bl.bin -> ../../gm200/gr/fecs_bl.bin -rw-r--r-- 1 root root 1968 Mar 1 08:55 lib/firmware/nvidia/gm206/gr/fecs_data.bin lrwxrwxrwx 1 root root 28 Jul 10 20:26 lib/firmware/nvidia/gm206/gr/fecs_inst.bin -> ../../gm200/gr/fecs_inst.bin -rw-r--r-- 1 root root 76 Mar 1 08:55 lib/firmware/nvidia/gm206/gr/fecs_sig.bin lrwxrwxrwx 1 root root 27 Jul 10 20:26 lib/firmware/nvidia/gm206/gr/gpccs_bl.bin -> ../../gm200/gr/gpccs_bl.bin -rw-r--r-- 1 root root 2056 Mar 1 08:55 lib/firmware/nvidia/gm206/gr/gpccs_data.bin lrwxrwxrwx 1 root root 29 Jul 10 20:26 lib/firmware/nvidia/gm206/gr/gpccs_inst.bin -> ../../gm200/gr/gpccs_inst.bin -rw-r--r-- 1 root root 76 Mar 1 08:55 lib/firmware/nvidia/gm206/gr/gpccs_sig.bin lrwxrwxrwx 1 root root 33 Jul 10 20:26 lib/firmware/nvidia/gm206/gr/sw_bundle_init.bin -> ../../gm200/gr/sw_bundle_init.bin lrwxrwxrwx 1 root root 25 Jul 10 20:26 lib/firmware/nvidia/gm206/gr/sw_ctx.bin -> ../../gm200/gr/sw_ctx.bin lrwxrwxrwx 1 root root 33 Jul 10 20:26 lib/firmware/nvidia/gm206/gr/sw_method_init.bin -> ../../gm200/gr/sw_method_init.bin lrwxrwxrwx 1 root root 28 Jul 10 20:26 lib/firmware/nvidia/gm206/gr/sw_nonctx.bin -> ../../gm200/gr/sw_nonctx.bin drwxr-xr-x 4 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp100 drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp100/acr -rw-r--r-- 1 root root 832 Mar 1 08:55 lib/firmware/nvidia/gp100/acr/bl.bin -rw-r--r-- 1 root root 9632 Mar 1 08:55 lib/firmware/nvidia/gp100/acr/ucode_load.bin -rw-r--r-- 1 root root 1440 Mar 1 08:55 lib/firmware/nvidia/gp100/acr/ucode_unload.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp100/gr lrwxrwxrwx 1 root root 26 Jul 10 20:26 lib/firmware/nvidia/gp100/gr/fecs_bl.bin -> ../../gm200/gr/fecs_bl.bin -rw-r--r-- 1 root root 2028 Mar 1 08:55 lib/firmware/nvidia/gp100/gr/fecs_data.bin -rw-r--r-- 1 root root 20955 Mar 1 08:55 lib/firmware/nvidia/gp100/gr/fecs_inst.bin -rw-r--r-- 1 root root 76 Mar 1 08:55 lib/firmware/nvidia/gp100/gr/fecs_sig.bin lrwxrwxrwx 1 root root 27 Jul 10 20:26 lib/firmware/nvidia/gp100/gr/gpccs_bl.bin -> ../../gm200/gr/gpccs_bl.bin -rw-r--r-- 1 root root 2080 Mar 1 08:55 lib/firmware/nvidia/gp100/gr/gpccs_data.bin -rw-r--r-- 1 root root 12458 Mar 1 08:55 lib/firmware/nvidia/gp100/gr/gpccs_inst.bin -rw-r--r-- 1 root root 76 Mar 1 08:55 lib/firmware/nvidia/gp100/gr/gpccs_sig.bin -rw-r--r-- 1 root root 7664 Mar 1 08:55 lib/firmware/nvidia/gp100/gr/sw_bundle_init.bin -rw-r--r-- 1 root root 6240 Mar 1 08:55 lib/firmware/nvidia/gp100/gr/sw_ctx.bin -rw-r--r-- 1 root root 11928 Mar 1 08:55 lib/firmware/nvidia/gp100/gr/sw_method_init.bin -rw-r--r-- 1 root root 2248 Mar 1 08:55 lib/firmware/nvidia/gp100/gr/sw_nonctx.bin drwxr-xr-x 6 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp102 drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp102/acr -rw-r--r-- 2 root root 0 Mar 1 08:55 lib/firmware/nvidia/gp102/acr/bl.bin -rw-r--r-- 1 root root 17152 Mar 1 08:55 lib/firmware/nvidia/gp102/acr/ucode_load.bin -rw-r--r-- 1 root root 3328 Mar 1 08:55 lib/firmware/nvidia/gp102/acr/ucode_unload.bin -rw-r--r-- 2 root root 0 Mar 1 08:55 lib/firmware/nvidia/gp102/acr/unload_bl.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp102/gr lrwxrwxrwx 1 root root 26 Jul 10 20:26 lib/firmware/nvidia/gp102/gr/fecs_bl.bin -> ../../gm200/gr/fecs_bl.bin -rw-r--r-- 1 root root 2256 Mar 1 08:55 lib/firmware/nvidia/gp102/gr/fecs_data.bin -rw-r--r-- 1 root root 20927 Mar 1 08:55 lib/firmware/nvidia/gp102/gr/fecs_inst.bin -rw-r--r-- 1 root root 192 Mar 1 08:55 lib/firmware/nvidia/gp102/gr/fecs_sig.bin lrwxrwxrwx 1 root root 27 Jul 10 20:26 lib/firmware/nvidia/gp102/gr/gpccs_bl.bin -> ../../gm200/gr/gpccs_bl.bin -rw-r--r-- 1 root root 1832 Mar 1 08:55 lib/firmware/nvidia/gp102/gr/gpccs_data.bin -rw-r--r-- 2 root root 0 Mar 1 08:55 lib/firmware/nvidia/gp102/gr/gpccs_inst.bin -rw-r--r-- 1 root root 192 Mar 1 08:55 lib/firmware/nvidia/gp102/gr/gpccs_sig.bin -rw-r--r-- 2 root root 0 Mar 1 08:55 lib/firmware/nvidia/gp102/gr/sw_bundle_init.bin -rw-r--r-- 1 root root 6216 Mar 1 08:55 lib/firmware/nvidia/gp102/gr/sw_ctx.bin -rw-r--r-- 2 root root 0 Mar 1 08:55 lib/firmware/nvidia/gp102/gr/sw_method_init.bin -rw-r--r-- 1 root root 2496 Mar 1 08:55 lib/firmware/nvidia/gp102/gr/sw_nonctx.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp102/nvdec -rw-r--r-- 1 root root 3840 Mar 1 08:55 lib/firmware/nvidia/gp102/nvdec/scrubber.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp102/sec2 -rw-r--r-- 1 root root 656 Mar 1 08:55 lib/firmware/nvidia/gp102/sec2/desc-1.bin -rw-r--r-- 1 root root 656 Mar 1 08:55 lib/firmware/nvidia/gp102/sec2/desc.bin -rw-r--r-- 1 root root 109568 Mar 1 08:55 lib/firmware/nvidia/gp102/sec2/image-1.bin -rw-r--r-- 1 root root 99072 Mar 1 08:55 lib/firmware/nvidia/gp102/sec2/image.bin -rw-r--r-- 1 root root 192 Mar 1 08:55 lib/firmware/nvidia/gp102/sec2/sig-1.bin -rw-r--r-- 1 root root 192 Mar 1 08:55 lib/firmware/nvidia/gp102/sec2/sig.bin drwxr-xr-x 6 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp104 drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp104/acr lrwxrwxrwx 1 root root 22 Jul 10 20:26 lib/firmware/nvidia/gp104/acr/bl.bin -> ../../gp102/acr/bl.bin lrwxrwxrwx 1 root root 30 Jul 10 20:26 lib/firmware/nvidia/gp104/acr/ucode_load.bin -> ../../gp102/acr/ucode_load.bin lrwxrwxrwx 1 root root 32 Jul 10 20:26 lib/firmware/nvidia/gp104/acr/ucode_unload.bin -> ../../gp102/acr/ucode_unload.bin lrwxrwxrwx 1 root root 29 Jul 10 20:26 lib/firmware/nvidia/gp104/acr/unload_bl.bin -> ../../gp102/acr/unload_bl.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp104/gr lrwxrwxrwx 1 root root 26 Jul 10 20:26 lib/firmware/nvidia/gp104/gr/fecs_bl.bin -> ../../gm200/gr/fecs_bl.bin -rw-r--r-- 1 root root 2576 Mar 1 08:55 lib/firmware/nvidia/gp104/gr/fecs_data.bin -rw-r--r-- 1 root root 22760 Mar 1 08:55 lib/firmware/nvidia/gp104/gr/fecs_inst.bin -rw-r--r-- 1 root root 192 Mar 1 08:55 lib/firmware/nvidia/gp104/gr/fecs_sig.bin lrwxrwxrwx 1 root root 27 Jul 10 20:26 lib/firmware/nvidia/gp104/gr/gpccs_bl.bin -> ../../gm200/gr/gpccs_bl.bin -rw-r--r-- 1 root root 1832 Mar 1 08:55 lib/firmware/nvidia/gp104/gr/gpccs_data.bin -rw-r--r-- 2 root root 13307 Mar 1 08:55 lib/firmware/nvidia/gp104/gr/gpccs_inst.bin -rw-r--r-- 1 root root 192 Mar 1 08:55 lib/firmware/nvidia/gp104/gr/gpccs_sig.bin lrwxrwxrwx 1 root root 33 Jul 10 20:26 lib/firmware/nvidia/gp104/gr/sw_bundle_init.bin -> ../../gp102/gr/sw_bundle_init.bin lrwxrwxrwx 1 root root 25 Jul 10 20:26 lib/firmware/nvidia/gp104/gr/sw_ctx.bin -> ../../gp102/gr/sw_ctx.bin lrwxrwxrwx 1 root root 33 Jul 10 20:26 lib/firmware/nvidia/gp104/gr/sw_method_init.bin -> ../../gp102/gr/sw_method_init.bin lrwxrwxrwx 1 root root 28 Jul 10 20:26 lib/firmware/nvidia/gp104/gr/sw_nonctx.bin -> ../../gp102/gr/sw_nonctx.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp104/nvdec lrwxrwxrwx 1 root root 30 Jul 10 20:26 lib/firmware/nvidia/gp104/nvdec/scrubber.bin -> ../../gp102/nvdec/scrubber.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp104/sec2 lrwxrwxrwx 1 root root 27 Jul 10 20:26 lib/firmware/nvidia/gp104/sec2/desc-1.bin -> ../../gp102/sec2/desc-1.bin lrwxrwxrwx 1 root root 25 Jul 10 20:26 lib/firmware/nvidia/gp104/sec2/desc.bin -> ../../gp102/sec2/desc.bin lrwxrwxrwx 1 root root 28 Jul 10 20:26 lib/firmware/nvidia/gp104/sec2/image-1.bin -> ../../gp102/sec2/image-1.bin lrwxrwxrwx 1 root root 26 Jul 10 20:26 lib/firmware/nvidia/gp104/sec2/image.bin -> ../../gp102/sec2/image.bin lrwxrwxrwx 1 root root 26 Jul 10 20:26 lib/firmware/nvidia/gp104/sec2/sig-1.bin -> ../../gp102/sec2/sig-1.bin lrwxrwxrwx 1 root root 24 Jul 10 20:26 lib/firmware/nvidia/gp104/sec2/sig.bin -> ../../gp102/sec2/sig.bin drwxr-xr-x 6 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp106 drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp106/acr lrwxrwxrwx 1 root root 22 Jul 10 20:26 lib/firmware/nvidia/gp106/acr/bl.bin -> ../../gp102/acr/bl.bin lrwxrwxrwx 1 root root 30 Jul 10 20:26 lib/firmware/nvidia/gp106/acr/ucode_load.bin -> ../../gp102/acr/ucode_load.bin lrwxrwxrwx 1 root root 32 Jul 10 20:26 lib/firmware/nvidia/gp106/acr/ucode_unload.bin -> ../../gp102/acr/ucode_unload.bin lrwxrwxrwx 1 root root 29 Jul 10 20:26 lib/firmware/nvidia/gp106/acr/unload_bl.bin -> ../../gp102/acr/unload_bl.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp106/gr lrwxrwxrwx 1 root root 26 Jul 10 20:26 lib/firmware/nvidia/gp106/gr/fecs_bl.bin -> ../../gm200/gr/fecs_bl.bin -rw-r--r-- 1 root root 2256 Mar 1 08:55 lib/firmware/nvidia/gp106/gr/fecs_data.bin lrwxrwxrwx 1 root root 28 Jul 10 20:26 lib/firmware/nvidia/gp106/gr/fecs_inst.bin -> ../../gp102/gr/fecs_inst.bin -rw-r--r-- 1 root root 192 Mar 1 08:55 lib/firmware/nvidia/gp106/gr/fecs_sig.bin lrwxrwxrwx 1 root root 27 Jul 10 20:26 lib/firmware/nvidia/gp106/gr/gpccs_bl.bin -> ../../gm200/gr/gpccs_bl.bin -rw-r--r-- 1 root root 1832 Mar 1 08:55 lib/firmware/nvidia/gp106/gr/gpccs_data.bin lrwxrwxrwx 1 root root 29 Jul 10 20:26 lib/firmware/nvidia/gp106/gr/gpccs_inst.bin -> ../../gp102/gr/gpccs_inst.bin -rw-r--r-- 1 root root 192 Mar 1 08:55 lib/firmware/nvidia/gp106/gr/gpccs_sig.bin lrwxrwxrwx 1 root root 33 Jul 10 20:26 lib/firmware/nvidia/gp106/gr/sw_bundle_init.bin -> ../../gp102/gr/sw_bundle_init.bin lrwxrwxrwx 1 root root 25 Jul 10 20:26 lib/firmware/nvidia/gp106/gr/sw_ctx.bin -> ../../gp102/gr/sw_ctx.bin lrwxrwxrwx 1 root root 33 Jul 10 20:26 lib/firmware/nvidia/gp106/gr/sw_method_init.bin -> ../../gp102/gr/sw_method_init.bin lrwxrwxrwx 1 root root 28 Jul 10 20:26 lib/firmware/nvidia/gp106/gr/sw_nonctx.bin -> ../../gp102/gr/sw_nonctx.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp106/nvdec lrwxrwxrwx 1 root root 30 Jul 10 20:26 lib/firmware/nvidia/gp106/nvdec/scrubber.bin -> ../../gp102/nvdec/scrubber.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp106/sec2 lrwxrwxrwx 1 root root 27 Jul 10 20:26 lib/firmware/nvidia/gp106/sec2/desc-1.bin -> ../../gp102/sec2/desc-1.bin lrwxrwxrwx 1 root root 25 Jul 10 20:26 lib/firmware/nvidia/gp106/sec2/desc.bin -> ../../gp102/sec2/desc.bin lrwxrwxrwx 1 root root 28 Jul 10 20:26 lib/firmware/nvidia/gp106/sec2/image-1.bin -> ../../gp102/sec2/image-1.bin lrwxrwxrwx 1 root root 26 Jul 10 20:26 lib/firmware/nvidia/gp106/sec2/image.bin -> ../../gp102/sec2/image.bin lrwxrwxrwx 1 root root 26 Jul 10 20:26 lib/firmware/nvidia/gp106/sec2/sig-1.bin -> ../../gp102/sec2/sig-1.bin lrwxrwxrwx 1 root root 24 Jul 10 20:26 lib/firmware/nvidia/gp106/sec2/sig.bin -> ../../gp102/sec2/sig.bin drwxr-xr-x 6 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp107 drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp107/acr lrwxrwxrwx 1 root root 22 Jul 10 20:26 lib/firmware/nvidia/gp107/acr/bl.bin -> ../../gp102/acr/bl.bin lrwxrwxrwx 1 root root 30 Jul 10 20:26 lib/firmware/nvidia/gp107/acr/ucode_load.bin -> ../../gp102/acr/ucode_load.bin lrwxrwxrwx 1 root root 32 Jul 10 20:26 lib/firmware/nvidia/gp107/acr/ucode_unload.bin -> ../../gp102/acr/ucode_unload.bin lrwxrwxrwx 1 root root 29 Jul 10 20:26 lib/firmware/nvidia/gp107/acr/unload_bl.bin -> ../../gp102/acr/unload_bl.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp107/gr -rw-r--r-- 2 root root 0 Mar 1 08:55 lib/firmware/nvidia/gp107/gr/fecs_bl.bin -rw-r--r-- 1 root root 2756 Mar 1 08:55 lib/firmware/nvidia/gp107/gr/fecs_data.bin -rw-r--r-- 1 root root 22879 Mar 1 08:55 lib/firmware/nvidia/gp107/gr/fecs_inst.bin -rw-r--r-- 1 root root 192 Mar 1 08:55 lib/firmware/nvidia/gp107/gr/fecs_sig.bin -rw-r--r-- 3 root root 0 Mar 1 08:55 lib/firmware/nvidia/gp107/gr/gpccs_bl.bin -rw-r--r-- 1 root root 2100 Mar 1 08:55 lib/firmware/nvidia/gp107/gr/gpccs_data.bin -rw-r--r-- 1 root root 12587 Mar 1 08:55 lib/firmware/nvidia/gp107/gr/gpccs_inst.bin -rw-r--r-- 1 root root 192 Mar 1 08:55 lib/firmware/nvidia/gp107/gr/gpccs_sig.bin lrwxrwxrwx 1 root root 33 Jul 10 20:26 lib/firmware/nvidia/gp107/gr/sw_bundle_init.bin -> ../../gp102/gr/sw_bundle_init.bin -rw-r--r-- 2 root root 0 Mar 1 08:55 lib/firmware/nvidia/gp107/gr/sw_ctx.bin lrwxrwxrwx 1 root root 33 Jul 10 20:26 lib/firmware/nvidia/gp107/gr/sw_method_init.bin -> ../../gp102/gr/sw_method_init.bin -rw-r--r-- 2 root root 0 Mar 1 08:55 lib/firmware/nvidia/gp107/gr/sw_nonctx.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp107/nvdec lrwxrwxrwx 1 root root 30 Jul 10 20:26 lib/firmware/nvidia/gp107/nvdec/scrubber.bin -> ../../gp102/nvdec/scrubber.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp107/sec2 lrwxrwxrwx 1 root root 27 Jul 10 20:26 lib/firmware/nvidia/gp107/sec2/desc-1.bin -> ../../gp102/sec2/desc-1.bin lrwxrwxrwx 1 root root 25 Jul 10 20:26 lib/firmware/nvidia/gp107/sec2/desc.bin -> ../../gp102/sec2/desc.bin lrwxrwxrwx 1 root root 28 Jul 10 20:26 lib/firmware/nvidia/gp107/sec2/image-1.bin -> ../../gp102/sec2/image-1.bin lrwxrwxrwx 1 root root 26 Jul 10 20:26 lib/firmware/nvidia/gp107/sec2/image.bin -> ../../gp102/sec2/image.bin lrwxrwxrwx 1 root root 26 Jul 10 20:26 lib/firmware/nvidia/gp107/sec2/sig-1.bin -> ../../gp102/sec2/sig-1.bin lrwxrwxrwx 1 root root 24 Jul 10 20:26 lib/firmware/nvidia/gp107/sec2/sig.bin -> ../../gp102/sec2/sig.bin drwxr-xr-x 6 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp108 drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp108/acr lrwxrwxrwx 1 root root 22 Jul 10 20:26 lib/firmware/nvidia/gp108/acr/bl.bin -> ../../gp102/acr/bl.bin lrwxrwxrwx 1 root root 30 Jul 10 20:26 lib/firmware/nvidia/gp108/acr/ucode_load.bin -> ../../gp102/acr/ucode_load.bin lrwxrwxrwx 1 root root 32 Jul 10 20:26 lib/firmware/nvidia/gp108/acr/ucode_unload.bin -> ../../gp102/acr/ucode_unload.bin lrwxrwxrwx 1 root root 29 Jul 10 20:26 lib/firmware/nvidia/gp108/acr/unload_bl.bin -> ../../gp102/acr/unload_bl.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp108/gr -rw-r--r-- 2 root root 576 Mar 1 08:55 lib/firmware/nvidia/gp108/gr/fecs_bl.bin -rw-r--r-- 1 root root 2248 Mar 1 08:55 lib/firmware/nvidia/gp108/gr/fecs_data.bin -rw-r--r-- 1 root root 21161 Mar 1 08:55 lib/firmware/nvidia/gp108/gr/fecs_inst.bin -rw-r--r-- 1 root root 192 Mar 1 08:55 lib/firmware/nvidia/gp108/gr/fecs_sig.bin -rw-r--r-- 3 root root 0 Mar 1 08:55 lib/firmware/nvidia/gp108/gr/gpccs_bl.bin -rw-r--r-- 1 root root 2092 Mar 1 08:55 lib/firmware/nvidia/gp108/gr/gpccs_data.bin -rw-r--r-- 1 root root 13095 Mar 1 08:55 lib/firmware/nvidia/gp108/gr/gpccs_inst.bin -rw-r--r-- 1 root root 192 Mar 1 08:55 lib/firmware/nvidia/gp108/gr/gpccs_sig.bin -rw-r--r-- 2 root root 7680 Mar 1 08:55 lib/firmware/nvidia/gp108/gr/sw_bundle_init.bin -rw-r--r-- 2 root root 6000 Mar 1 08:55 lib/firmware/nvidia/gp108/gr/sw_ctx.bin -rw-r--r-- 2 root root 12288 Mar 1 08:55 lib/firmware/nvidia/gp108/gr/sw_method_init.bin -rw-r--r-- 2 root root 2496 Mar 1 08:55 lib/firmware/nvidia/gp108/gr/sw_nonctx.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp108/nvdec lrwxrwxrwx 1 root root 30 Jul 10 20:26 lib/firmware/nvidia/gp108/nvdec/scrubber.bin -> ../../gp102/nvdec/scrubber.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gp108/sec2 lrwxrwxrwx 1 root root 27 Jul 10 20:26 lib/firmware/nvidia/gp108/sec2/desc.bin -> ../../gp102/sec2/desc-1.bin lrwxrwxrwx 1 root root 28 Jul 10 20:26 lib/firmware/nvidia/gp108/sec2/image.bin -> ../../gp102/sec2/image-1.bin lrwxrwxrwx 1 root root 26 Jul 10 20:26 lib/firmware/nvidia/gp108/sec2/sig.bin -> ../../gp102/sec2/sig-1.bin drwxr-xr-x 6 root root 0 Jul 10 20:26 lib/firmware/nvidia/gv100 drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gv100/acr -rw-r--r-- 2 root root 1280 Mar 1 08:55 lib/firmware/nvidia/gv100/acr/bl.bin -rw-r--r-- 1 root root 18688 Mar 1 08:55 lib/firmware/nvidia/gv100/acr/ucode_load.bin -rw-r--r-- 1 root root 6400 Mar 1 08:55 lib/firmware/nvidia/gv100/acr/ucode_unload.bin -rw-r--r-- 2 root root 1280 Mar 1 08:55 lib/firmware/nvidia/gv100/acr/unload_bl.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gv100/gr -rw-r--r-- 1 root root 576 Mar 1 08:55 lib/firmware/nvidia/gv100/gr/fecs_bl.bin -rw-r--r-- 1 root root 4788 Mar 1 08:55 lib/firmware/nvidia/gv100/gr/fecs_data.bin -rw-r--r-- 1 root root 25632 Mar 1 08:55 lib/firmware/nvidia/gv100/gr/fecs_inst.bin -rw-r--r-- 1 root root 192 Mar 1 08:55 lib/firmware/nvidia/gv100/gr/fecs_sig.bin -rw-r--r-- 3 root root 576 Mar 1 08:55 lib/firmware/nvidia/gv100/gr/gpccs_bl.bin -rw-r--r-- 1 root root 2128 Mar 1 08:55 lib/firmware/nvidia/gv100/gr/gpccs_data.bin -rw-r--r-- 1 root root 12643 Mar 1 08:55 lib/firmware/nvidia/gv100/gr/gpccs_inst.bin -rw-r--r-- 1 root root 192 Mar 1 08:55 lib/firmware/nvidia/gv100/gr/gpccs_sig.bin -rw-r--r-- 1 root root 7664 Mar 1 08:55 lib/firmware/nvidia/gv100/gr/sw_bundle_init.bin -rw-r--r-- 1 root root 9756 Mar 1 08:55 lib/firmware/nvidia/gv100/gr/sw_ctx.bin -rw-r--r-- 1 root root 12296 Mar 1 08:55 lib/firmware/nvidia/gv100/gr/sw_method_init.bin -rw-r--r-- 1 root root 2728 Mar 1 08:55 lib/firmware/nvidia/gv100/gr/sw_nonctx.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gv100/nvdec -rw-r--r-- 1 root root 4352 Mar 1 08:55 lib/firmware/nvidia/gv100/nvdec/scrubber.bin drwxr-xr-x 2 root root 0 Jul 10 20:26 lib/firmware/nvidia/gv100/sec2 -rw-r--r-- 1 root root 656 Mar 1 08:55 lib/firmware/nvidia/gv100/sec2/desc.bin -rw-r--r-- 1 root root 91136 Mar 1 08:55 lib/firmware/nvidia/gv100/sec2/image.bin -rw-r--r-- 1 root root 192 Mar 1 08:55 lib/firmware/nvidia/gv100/sec2/sig.bin -rw-r--r-- 1 root root 108296 Jul 8 08:27 lib/modules/5.3.18-lp152.20.7-default/updates/nvidia-drm.ko -rw-r--r-- 1 root root 27961744 Jul 8 08:27 lib/modules/5.3.18-lp152.20.7-default/updates/nvidia.ko -rw-r--r-- 1 root root 1486256 Jul 8 08:27 lib/modules/5.3.18-lp152.20.7-default/updates/nvidia-modeset.ko -rw-r--r-- 1 root root 1879016 Jul 8 08:27 lib/modules/5.3.18-lp152.20.7-default/updates/nvidia-uvm.ko -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c56 --- Comment #56 from Cor Blom --- Building my own package is not that difficult. Stephan has provided excellent instruction in X11:Driver:Video etc project. mkinitrd does not change anything for me. Based of what Matthias said I experimented a bit and got the following. When I unload all nvidia modules (rmmod nvidia-drm, rmmod nvidia-modeset and rmmod nvidia) and after that I run "modprobe nvidia", the result is that I do have "/dev/nvidia-uvm(-tools)", as well as the others.. This is way beyond what I understand, but maybe it helps. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c58 --- Comment #58 from Matthias Bach --- Created attachment 839606 --> http://bugzilla.opensuse.org/attachment.cgi?id=839606&action=edit Zypper output for force-reinstall of NVIDIA driver As it honestly confused me that I thought I'd always seen the driver install perform an initrd build but the problem looks a lot like it didn't, I ran a force reinstall of the driver packages. As you can see from the attached zypper output (I shortened irrelevant parts like the EULA), it does invoke an initrd build in the %posttrans script. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c60 --- Comment #60 from Matthias Bach --- (In reply to Mister Pend from comment #59)

(In reply to Matthias Bach from comment #52)

...

Based on the previous test I have been able to solve the problem for myself. The solution is as obvious as hidden in plain sight. All I had to do was execute the following:

/sbin/mkinitrd

Still, I don't fully understand _why_ this solves the problem. I always assumed the driver installation to trigger this.

Maybe Mister Pend or Cor Blom can confirm this behaviour.

Sorry, I've tried on separate systems and can't confirm this. Executing mkinitrd doesn't error, but doesn't solve the issue. Even after a further reboot.

After the last driver update, and having worked around bug 1174204, I know also have the issue again. The /sbin/mkinitrd didn't help this time, so it must have been something else that fixed it for me back than. Still, I have that weird effect that unloading the modules after boot will actually make the system work as expected afterwards, until the next reboot. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c62 Stefan Dirsch changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|WORKSFORME |FIXED --- Comment #62 from Stefan Dirsch --- Actually I fixed this issue by creating the nvidia-uvm-tools device node now with the latest packages, so closing as fixed. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c64 --- Comment #64 from Matthias Bach --- Created attachment 839797 --> http://bugzilla.opensuse.org/attachment.cgi?id=839797&action=edit Systemd Unit providing a workaround Thanks for all the effort you put into this Stephan! Given that you cannot reproduce it I fully understand and support your decision. In fact, if my understanding is true that your systemd does not have the NVIDIA driver in the initrd and those running into the issue have, than I suspect this is more related to initrd building than the driver itself anyhow. For anybody still running into this: I am now using the nvidia-modprobe.service files to implement an automated workaround. Just put this in /etc/systemd/system and enable it. I included dependencies for all services in openSUSE I know to be using the NVIDIA GPU. If you have further services requiring it, add them to the WantedBy and Before lines. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c66 --- Comment #66 from Bernhard Wiedemann --- One user reported that forcing dracut to include nvidia-uvm into initrd made it work for him https://www.reddit.com/r/openSUSE/comments/hszckh/no_cuda_support_with_repo_... -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c68 --- Comment #68 from Stefan Dirsch --- Oh. You need to run 'mkinitrd' after adding a dracut config file so the changes get active and reboot the machine in order to see the results. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c70 Stefan Dirsch changed: What |Removed |Added ---------------------------------------------------------------------------- Status|RESOLVED |REOPENED Resolution|FIXED |--- --- Comment #70 from Stefan Dirsch --- (In reply to Stefan Dirsch from comment #67)

2) or make sure they are not added at all

# cat > /etc/dracut.conf.d/50-nvidia-default.conf << EOF omit_dracutmodules+="nvidia nvidia-drm nvidia-modeset nvidia-uvm" EOF

Sorry, that was wrong. It should have been # cat > /etc/dracut.conf.d/50-nvidia-default.conf << EOF omit_drivers+="nvidia nvidia-drm nvidia-modeset nvidia-uvm" EOF Could you please try this as well? I believe this should result in what achieved Cor Blom by comment #56. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c71 steve edmonds changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |engineering@ptglobal.com --- Comment #71 from steve edmonds --- Sorry to jump in here, please correct me if wrong, am I correct in assuming this bug is preventing my applications requiring CUDA (Davinci Resolve, Blender) failing to run after a DUP from Leap 15.1 to 15.2. I have tried the Systemd Unit providing a workaround suggestion but that failed to work. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c73 --- Comment #73 from Mister Pend --- (In reply to steve edmonds from comment #71)

Sorry to jump in here, please correct me if wrong, am I correct in assuming this bug is preventing my applications requiring CUDA (Davinci Resolve, Blender) failing to run after a DUP from Leap 15.1 to 15.2. I have tried the Systemd Unit providing a workaround suggestion but that failed to work.

It would seek likely. A workaround (not a solution, but a workaround) that works for me was adding the following to the root crontab: @reboot nvidia-modprobe -u -c=0 (or running "nvidia-modprobe -u -c=0" as an elevated user once every boot). After this it may start working for you. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c75 Matthias Bach changed: What |Removed |Added ---------------------------------------------------------------------------- Flags|needinfo?(marix@marix.org) | --- Comment #75 from Matthias Bach --- (In reply to Stefan Dirsch from comment #70)

(In reply to Stefan Dirsch from comment #67)

...

2) or make sure they are not added at all

# cat > /etc/dracut.conf.d/50-nvidia-default.conf << EOF omit_dracutmodules+="nvidia nvidia-drm nvidia-modeset nvidia-uvm" EOF

Sorry, that was wrong. It should have been

# cat > /etc/dracut.conf.d/50-nvidia-default.conf << EOF omit_drivers+="nvidia nvidia-drm nvidia-modeset nvidia-uvm" EOF

Could you please try this as well? I believe this should result in what achieved Cor Blom by comment #56.

I can confirm that this also fixes the issue for me. I like this even better than force-including them into the initrd as this gives a nice reduction in initrd size from 37 MiB to 14 MiB. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c77 --- Comment #77 from steve edmonds --- (In reply to Matthias Bach from comment #76)

That initrd looks correct to my non-expert eye. Some other things that might be interesting:

1) Output of `lsmod | grep nvidia` 2) Output of `ls -lh /dev/nvidia*` 3) Is you user a member of the group `video`? 4) Output of `clinfo | head -n 5`

1.>lsmod | grep nvidia (nothing) 2.>ls -lh /dev/nvidia* ls: cannot access '/dev/nvidia*': No such file or directory 3. Yes 4. clinfo | head -n 5 Number of platforms 0 The same video card and GO5 driver (450.57) working in Leap 15.1 gives quite different responses. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c79 Stefan Dirsch changed: What |Removed |Added ---------------------------------------------------------------------------- Status|REOPENED |CONFIRMED --- Comment #79 from Stefan Dirsch --- (In reply to Mister Pend from comment #72)

(In reply to Stefan Dirsch from comment #67)

...

Check which nvidia modules are in your initrd by running

Looks like no nvidia-uvm on a clean installed system:

-rw-r--r-- 1 root root 1484 Jul 17 22:49 etc/modprobe.d/50-nvidia-default.conf -rw-r--r-- 1 root root 18 Jul 17 05:43 etc/modprobe.d/nvidia-default.conf -rw-r--r-- 1 root root 119664 Jul 17 22:49 lib/modules/5.3.18-lp152.19-default/updates/nvidia-drm.ko -rw-r--r-- 1 root root 27465704 Jul 17 22:49 lib/modules/5.3.18-lp152.19-default/updates/nvidia.ko -rw-r--r-- 1 root root 1574168 Jul 17 22:49 lib/modules/5.3.18-lp152.19-default/updates/nvidia-modeset.ko lrwxrwxrwx 1 root root 54 Jul 17 22:49 lib/modules/5.3.18-lp152.26-default/weak-updates/updates/nvidia-drm.ko -> ../../../5.3.18-lp152.19-default/updates/nvidia-drm.ko lrwxrwxrwx 1 root root 50 Jul 17 22:49 lib/modules/5.3.18-lp152.26-default/weak-updates/updates/nvidia.ko -> ../../../5.3.18-lp152.19-default/updates/nvidia.ko lrwxrwxrwx 1 root root 58 Jul 17 22:49 lib/modules/5.3.18-lp152.26-default/weak-updates/updates/nvidia-modeset.ko -> ../../../5.3.18-lp152.19-default/updates/nvidia-modeset.ko

Yes, exactly the same issue as Matthias Bach had.

...

2) or make sure they are not added at all

Ran your command in comment #70, followed by a mkinitrd and a reboot. And at this point, blank screen, X doesn't seem to load :(

My fault, the advice was wrong. Please try instead - as already corrected in my comment #70 # cat > /etc/dracut.conf.d/50-nvidia-default.conf << EOF omit_drivers+="nvidia nvidia-drm nvidia-modeset nvidia-uvm" EOF # mkinitrd According to Matthias Bach this should work. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c81 --- Comment #81 from Stefan Dirsch --- (In reply to Matthias Bach from comment #75)

(In reply to Stefan Dirsch from comment #70)

...

(In reply to Stefan Dirsch from comment #67)

...

2) or make sure they are not added at all

# cat > /etc/dracut.conf.d/50-nvidia-default.conf << EOF omit_dracutmodules+="nvidia nvidia-drm nvidia-modeset nvidia-uvm" EOF

Sorry, that was wrong. It should have been

# cat > /etc/dracut.conf.d/50-nvidia-default.conf << EOF omit_drivers+="nvidia nvidia-drm nvidia-modeset nvidia-uvm" EOF

Could you please try this as well? I believe this should result in what achieved Cor Blom by comment #56.

I can confirm that this also fixes the issue for me. I like this even better than force-including them into the initrd as this gives a nice reduction in initrd size from 37 MiB to 14 MiB.

Thanks for feedback! I've implemented this now in our packages. Anyone building the packages themselves from obs://X11:Drivers:Video can test this right now. Hello @Cor Blom, glad to know that at least one person is making use of this service! :-) -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c83 --- Comment #83 from Cor Blom --- I have built the latest version and can confirm it fixes this bug. Thanks. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c85 --- Comment #85 from steve edmonds --- (In reply to Stefan Dirsch from comment #82)

Seems you're failing on a complete different level. No nvidia modules installed at all. I suggest to reinstall nvidia-gfxG05-kmp-default package. If this doesn't help, open a separate bug. It's really unrelated to this one ...

Do you think it could be related to this release note; 4.1 Secure Boot: Third-Party Drivers Need to Be Properly Signed openSUSE Leap 15.2 now enables a kernel module signature check for third-party drivers (CONFIG_MODULE_SIG=y). This is an important security measure to avoid untrusted code running in the kernel. This may prevent third-party kernel modules from being loaded if UEFI Secure Boot is enabled. Importantly, this affects NVIDIA...... Although I can't see why my CAD complains of no openGL if I remove the installed Nvidia packages. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c87 --- Comment #87 from steve edmonds --- (In reply to Matthias Bach from comment #86)

(In reply to steve edmonds from comment #85)

...

(In reply to Stefan Dirsch from comment #82)

...

Seems you're failing on a complete different level. No nvidia modules installed at all. I suggest to reinstall nvidia-gfxG05-kmp-default package. If this doesn't help, open a separate bug. It's really unrelated to this one ...

Do you think it could be related to this release note; 4.1 Secure Boot: Third-Party Drivers Need to Be Properly Signed

Yes, if you are using secure boot your issues are most likely be caused by this. But that too should be solved with the latest package version. You'll have to manually import the package signing key once, though. See bug 1173682 for details.

May be secure boot is not my issue, I am booting with GRUB2 without EFI and enable trusted boot support off. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c89 --- Comment #89 from steve edmonds --- The errors in mkinitrd are not related, it is another bug preventing the purge-kernels service running. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c91 --- Comment #91 from steve edmonds --- I thought I had this all under control so moved on to DUP the next Leap 15.1 machine to 15.2. After the upgrade the Nvidia driver loads except for nvidia-uvm, so I have openGL support but no CUDA support. If I run clinfo | head -n 5 as normal user, nvidia_uvm doesn't load but if I run the command elevated it does load and stays loaded. (output below) The previous suggestions of cat > /etc/dracut.conf.d/50-nvidia-default.conf.... don't work her because after the dup I have only 1 file there

ls /etc/dracut.conf.d 99-debug.conf

I do have /etc/modprobe.d/50-nvidia-default.conf /etc/modprobe.d/nvidia-default.conf I suspect the @reboot nvidia-modprobe -u -c=0 solution may be my option

lsmod | grep nvidia nvidia_drm 61440 16 nvidia_modeset 1187840 34 nvidia_drm nvidia 19726336 1586 nvidia_modeset drm_kms_helper 229376 1 nvidia_drm drm 544768 19 drm_kms_helper,nvidia_drm clinfo | head -n 5 Number of platforms 0 steve@linux-qw83:~> lsmod | grep nvidia nvidia_drm 61440 17 nvidia_modeset 1187840 36 nvidia_drm nvidia 19726336 1671 nvidia_modeset drm_kms_helper 229376 1 nvidia_drm drm 544768 20 drm_kms_helper,nvidia_drm sudo clinfo | head -n 5 [sudo] password for root: Number of platforms 1 Platform Name NVIDIA CUDA Platform Vendor NVIDIA Corporation Platform Version OpenCL 1.2 CUDA 11.0.210 Platform Profile FULL_PROFILE lsmod | grep nvidia nvidia_uvm 1110016 0 nvidia_drm 61440 17 nvidia_modeset 1187840 36 nvidia_drm nvidia 19726336 1672 nvidia_uvm,nvidia_modeset drm_kms_helper 229376 1 nvidia_drm drm 544768 20 drm_kms_helper,nvidia_drm

-- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c93 --- Comment #93 from steve edmonds --- (In reply to Stefan Dirsch from comment #92)

Removed /etc/dracut.conf.d/50-nvidia-default.conf could be explained by having suse-prime package installed (Optimus systems with Intel/NVIDIA GPU combo), but then you would have a /etc/dracut.conf.d/90-nvidia-dracut-G05.conf or /usr/lib/dracut/dracut.conf.d/90-nvidia-dracut-G05.conf installed with the same content and you still shouldn't have any nvidia modules in your initrd.

I don't have an explanation for this right now.

The files were there under Leap 15.1, I am assuming nvidia-computeG05 provides /etc/modprobe.d/50-nvidia-default.conf but I have no idea what process leads to the presence of /etc/dracut.conf.d/50-nvidia-default.conf -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.opensuse.org/show_bug.cgi?id=1173733 http://bugzilla.opensuse.org/show_bug.cgi?id=1173733#c95 --- Comment #95 from steve edmonds --- (In reply to Stefan Dirsch from comment #94) An updated Nvidia driver just installed from the repository and CUDA apps are working as expected now. -- You are receiving this mail because: You are on the CC list for the bug.