Jerry,
I had no idea that you worked at Google!
It seems then that you are the perfect person to ask about the robot detection module for a difinitive answer.
Originally PhilG described in his book how the robots module would detect a web crawler and serve customised textual content to it instead of the full or password protected page.
Does Google in fact revisit pages anonymously and compare them to pages retrieved by the googlebot to detect masquerading? If so am I correct in assuming that the robot detection package, though still in OpenACS 4.6.3 is no use any more?
Regards
Richard
