Yes, that test function call verifies that PL/pgSQL has been installed and is working. If it fails that test it tells you to do a "createlang' on your database.
I'm somewhat stymied by your problem. How did you get your OpenACS 4 sources? One of the nightly tarballs? The alpha2 tarball? From CVS directly?