As Simon mentioned above, we've been doing some work with automated testing as well. We as an organisation use an XP development methodology, i.e. we write test scripts before the actual code.
I've been working on a tool for testing the functionality of Tcl functions within the system. This is slightly lower level to Tilmann's system, which is testing the system from the perspective of a user. Really, each approach complements the other.
This package is currently based on the AD-ACS 4.2, but I'm in the process of porting it to OpenACS 4.
To summurise, this tool allows you to:
- Register testcases (chunks of code)
- Report test results in a standard way
- Web tool for running complete set of tests, or individual tests.
- View testcase bodys and test results through the web-based admin tool.
- Stub Tcl functions for driving the logic-flow and testing incoming parameter values.
We've used this tool for a little while now, and have found it extremely useful, and has significantly reduced overall development effort by trapping problems early. I'll post up more information once the port is complete, but if anyone would like any other info in the meantime, just drop me an email.