Turns out this was an issue with the .Xauthority file storing a hostname without the domain part, due to /etc/hosts missing an entry for the local hostname when on the road.