Forum OpenACS Q&A: Problem in robots.txt in 5.0

Collapse
Posted by Jeff Davis on
I noticed the user agent key in the www/robots.txt file was given as "UserAgent:" rather than "User-agent:" which means that the robots.txt file would not be used. I fixed it in CVS but anyone with a deployed site might want to take a look at theirs and consider fixing it.