Forum OpenACS Q&A: not archived on

Request notifications

Posted by Brian Fenton on
Hi, I frequently use the Internet Archive Wayback Machine ( to look at archives of websites. I tried to see if was archived and it appears that it's not because of a robots.txt file:*/*

We're sorry, access to* has been blocked by the site owner via robots.txt.

I think it would be nice if we removed the robots.txt entry for the Wayback Machine. They use the Alexa spider, so we would need to remove the block on Alexa. It's always useful to look back and see your own history.*sa_/



Posted by russell muetzelfeldt on
hmmm... does that robots.txt not also block the google spider? surely the forums (at the very least) should be searchable in google...