That patches that Eric commented were for aolserver-3.x so they are not needed in the aolserver4 Debian package.
I've been using the Debian package of aolserver4 (aolserver4, aolserver4-nscache, aolserver4-nsopenssl, aolserver4-nspostgres and aolserver4-nssha1) for more than two months both in production and development with success, so please try it and report any problems to the Debian bug tracking system.