To set up a test server, see
For each server that will be monitored. Step 4 of that section describes how to get the results xml to a file. What we need to do is instead get that xml to the new test.openacs.org, once it exists. I am thinking that a scheduled rsync or scp would work.
Regarding perl web testing, please see my response in the same thread. regression testing is nice; regression testing that uses the already working scheme for reporting and aggregating results through the central test.openacs.org is nicer.