As suggested on the factory ml, I've removed drm-kmp-default, nomodeset and rebooted. So far I haven't had a gpu hang.