If you were really concerned you could even do vnc through an ssh tunnel too. Perhaps even x11vnc which allows you to see the :0.0 session (or was it r0vnc).