After some more poking around, I've narrowed it down more specifically to drivers from the amdgpu repo. Drivers from repo-oss work just fine.