Forum OpenACS Q&A: openacs.org/robots.txt

Collapse
Posted by Nis Jørgensen on
Hello all

The robots.txt for openacs.org looks like this:

User-agent: *
Disallow: /
Disallow: /doc/
Disallow: /api-doc/
Disallow: /register/
Disallow: /comments/
Disallow: /notifications/
Disallow: /test/
Disallow: /workflow/
Disallow: /acs-service-contract/
Disallow: /acs-lang/
Disallow: /acs-admin/
Disallow: /RPC2/

So openacs.org should be completely ignored by the robots. Some pages still show up - I guess these are linked externally. Could we change this? Seems like a bad PR move to remove ourselves from Google.

Collapse
2: Re: openacs.org/robots.txt (response to 1)
Posted by Jeff Davis on
It looks like that got added when the site was moved to 5.1.

I changed it to what was on head (and allowed doc and api-doc)