Would robot detection work here? Does htDig has a user-agent? If you can customize it you should be able to identify your htDig and setup robot detection to allow htDig to see those parts of your site.
Robot-detection for Postgresql in OpenACS 4 is not ported yet according to the status document.
