Finally. As expected only the no-X version of emacs is installed. Install emacs-x11 package and you're done.