It's also pretty easy to write an installer in Tcl which compiles everything from source.
What we did here is add all the open sourced packages to our own separate subversion repository. The installer does a few sanity checks, and then downloads each piece of source and downloads it.
Also, since it's written in Tcl, it uses the same skills as what everyone is familiar with.