Edit: Also I like to note that there seems to be a bug in nouveau too. Because if I have any displays connected to the nvidia GPU the desktop randomly freezes after a few minutes. If I attach my display directly to my integrated AMD GPU (thankfully this desktop CPU has one) I can operate the system properly.