OracleVM Manager has built-in browser based Java VNC console accessible from “Console” button:
In order this to work properly you need to have the right VNC rpm installed in the server side:
http://oss.oracle.com/oraclevm/manager/RPMS/tightvnc-java-1.3.9-3.noarch.rpm
For those that want to access the virtual server console directly using e.g. TightVNC viewer you can do so by first looking at the right VNC port from OracleVM manager.
Then connect to the actual bare metal server (not the virtual server) with the VNC Port. In this example the OracleVM server IP might have been 10.1.1.1.
You might as well leave the port 5900 since this points to the display 0 which in short can be defined:
If you had Virtual server VNC console defined in 5901, you can connect to 10.1.1.1:1 etc.