I am also experiencing this issue too on XFCE. I switched to Wicked for now but this is still a major problem.