Forum OpenACS Q&A: Response to Robot detection - source for "Web Robots Database" vanished

Unless I'm misunderstanding your problem, all you need to do is set the param in your nsd.tcl file:

ns_section ns/server/${server}/acs/robot-detection
  
ns_param WebRobotsDB http://www.robotstxt.org/wc/active/all.txt 

and things should Just Work Right. Does for me anyway. HTH.