So, the issue is that udev default rules allows uncontrollable device rebinding. What if we drop this rules and left it for users to allow device rebinding based on USB device serial number (for instance)? There could be template in /etc/udev/rules.d to fill serial and uncoment.