Matthias, there are several issues. First, this tool isn't just for the OACS toolkit developers (although that's a great use too); rather, it's for OACS toolkit *users* who are developing their own applications using it. We want to make it as easy as possible for them to build high-quality, usable applications.
Second, the point of the usability testing module was to do more than simply gather more usability feedback. Its intent is to gather more *accurate* usability feedback by teaching the testers how to use Jakob Neilsen's empirically tested heuristic usability evaluation method. This method has been shown to produce results that correlate well with far more expensive video-based observational usability tests.