Similar behavior on Ubuntu 22.04.2 with the mainline kernel 6.4.3 (no kernel panic, but system hangs). I'm sure it's upstream issue.