I think this search stuff is *crucial* to OpenACS, and certainly not a
distraction. I'm fairly confident that OpenFTS will provide a number
of good solutions to the problems posed above, but you're right that
it may not be enough.
In theory, I like the design you're pushing. I am worried about the
efficiency of the call-back mechanism you're talking about. We have to
worry about updating indexes when content changes, either live or
batch mode, and we have to have this be efficient... I'm not saying a
callback interface isn't possible, I'm saying the efficiency issues
are going to be non-negligible.
Jerry, do you have time to lead investigation on this front? I'd love
to have you handle this, in cooperation with the OpenFTS folks.