We're building a site that has a protected area that htDig cannot index.
As a quick fix, I was thinking, a quick way of indexing the protected area is to let the system allow htDig to circumvent openACS's password screen.
Perhaps, by looking at the http header and confirming that the search is being done from the same box (i.e. htDig is running on the same computer).
htDig will still create the index, but when site users attempt to go to the protected pages from the search results, they are then required to login.
It's quick and dirty, but you'll have to admit, quite an easy way to index a site.
My question now is:
Where should I look in the source code to enable this functionality?