Following the mobile phone test I decided to try Linphone on my computer. Sure enough, I was able to make connections both ways. It appears that the issue is that Ring and Ekiga don't connect on UDP, while my SIP provider accepts only UDP connections.