I logged out of X, restarting the Xorg server, and logged back in with the mouse restored. The time before when this happened, I had switched to vt2, and could not switch back to the Xorg screen after. I had to reboot to recover.