When using X over ssh there is also the danger of a broken ssh connection. I guess when you loose the connection you have to start the installation over, unless you have something like the 'screen' program that also allows to re-attach to forwarded X programs as well. So VNC is propably the best.
