The referer check is nearly transparent. If you go to a page with the wrong referer host you are redirected to page with a link. Clicking the link completes the action. This is so you can get to acs-admin by just typing mysite/acs-admin. There could be times when clicking on the link would be a bad idea and I may disable the link if referer host is not null or go thru the sudo login page if the referer is null.
Unless you can javascript the referer on a url request (and I'm sure someone has figured out how) this should make remote attacks difficult. I'm also thinking that if you create a DNS entry like admin.mysite.com and force all admin thru that url then links from www.mysite.com become remote attacks. That would also require a seperate login on admin.mysite.com. Between the two I think that would make openacs safer than most sites.