libxml is used by the query dispatcher, not the APM at this point. If anything, though, the query dispatcher is more crucial than the APM. So yes, you need it.
(we plan to rewrite the APM to use libxml later so there will only be one XML parsing package used by OpenACS 4 rather than two, as is true today).