I tried turning off IPv6 and it didn't make any difference. Also, I have been running IPv6 on my network for almost 5 years and it was only after 11.4 that the problem occurred. One thing I noticed before and verified again today is that a new user will be able to connect for a while, before it fails for that user too.