Forum OpenACS Q&A: Robot detection disappeared?

Collapse
Posted by Paul Doerwald on
I'm working on a web site based on OpenACS 3.2.4, and I want to set
up robot detection so that my dynamic content can be indexed by
search engines.

So, remembering what Philip wrote in The Book, I checked for existing
bboard robot detection code.  I didn't find any.

I checked The Book to see what he actually said, and he wrote that he
did in fact write bboard robot detection.

Does anyone know what happened to it?  Did it disappear somewhere
along the line?  There's hooks in the code, but there's still a lot of
implementation stuff that has to be written.  I wanted to use bboard
robot detection, as well as tweak it for my modules.

If no one knows what happened to it, does someone know if someone
else wrote code that I can adapt?

Failing that, if I were to write it, would there be interest in the
OpenACS 3.x community?

Collapse
Posted by Rodger Donaldson on

The tools are probably less useful than they used to be - search engines have gotten smarter (someone started reading the HTTP specs).

Google, for example, will generate and index GET requests with parameters if need be - consider the query http://www.google.com/search?hl=en&q=ask+philip+java, which returns a number of GET forms. Which is reasonable, since GET requests are supposed to return consistently.