Comment # 1 on bug 1007676 from Fabian Vogt

This is the KWin "Mouse Mark" effect.
If you do not want this behaviour, you can disable it in the configuration,
under "Desktop Behaviour" -> "Desktop Effects".
The default shortcut for cleaning the arrows up is Meta+Shift+F11.