Forum .LRN Q&A: glibc detected: free () : invalid pointer ? double free (fast)

Request notifications

Hello, excuse me, have anyone find this error or something similar on dotlrn 2.5 on debian?
It appears to me so frecuently (on VM a couple of times by hour and on physical servers once in a day), and sometimes it appear like "invalid pointer" and others like "double free or corruption (fast)".
I'm not sure if this error is about dotlrn, aolserver or OS, and I don't have idea about where to look to fix it.
Thank you for your help in advance.

PD: my SO is debian 2.6.32-5 amd 64, PG 8.4 , dotlrn 2.5

** glibc detected *** /usr/lib/aolserver4/bin/nsd: free(): invalid pointer: 0x00007fc23ef51238 ***
======= Backtrace: =========
/lib/libc.so.6(+0x71bd6)[0x7fc23ec64bd6]
/lib/libc.so.6(cfree+0x6c)[0x7fc23ec6994c]
/usr/lib/libpq.so.5(+0xa161)[0x7fc23c386161]
/usr/lib/aolserver4/lib/libnspostgres.so(+0x27ca)[0x7fc23c1767ca]
/usr/lib/aolserver4/lib/libnsdb.so(Ns_DbExec+0x38)[0x7fc23c7a9718]
/usr/lib/aolserver4/lib/libnsdb.so(Ns_DbSelect+0x49)[0x7fc23c7a9659]
/usr/lib/aolserver4/lib/libnsdb.so(Ns_Db0or1Row+0x1e)[0x7fc23c7ab64e]
/usr/lib/aolserver4/lib/libnspostgres.so(+0x4c24)[0x7fc23c178c24]
/usr/lib/libtcl8.4.so.0(TclInvokeStringCommand+0x7c)[0x7fc23f83d59c]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(Tcl_EvalObjv+0xe3)[0x7fc23f83ea13]
/usr/lib/libtcl8.4.so.0(Tcl_EvalObjEx+0x234)[0x7fc23f83f8c4]
/usr/lib/libtcl8.4.so.0(Tcl_UplevelObjCmd+0xf0)[0x7fc23f896670]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(+0x5a6bf)[0x7fc23f8676bf]
/usr/lib/libtcl8.4.so.0(TclCompEvalObj+0xff)[0x7fc23f864d9f]
/usr/lib/libtcl8.4.so.0(Tcl_EvalObjEx+0xee)[0x7fc23f83f77e]
/usr/lib/libtcl8.4.so.0(Tcl_SwitchObjCmd+0x2bb)[0x7fc23f84f58b]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(+0x5a6bf)[0x7fc23f8676bf]
/usr/lib/libtcl8.4.so.0(TclCompEvalObj+0xff)[0x7fc23f864d9f]
/usr/lib/libtcl8.4.so.0(TclObjInterpProc+0x21d)[0x7fc23f896aed]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(Tcl_EvalEx+0x427)[0x7fc23f83f457]
/usr/lib/libtcl8.4.so.0(Tcl_EvalTokensStandard+0x2cd)[0x7fc23f83ef0d]
/usr/lib/libtcl8.4.so.0(Tcl_EvalEx+0x161)[0x7fc23f83f191]
/usr/lib/libtcl8.4.so.0(Tcl_EvalObjEx+0x79)[0x7fc23f83f709]
/usr/lib/libtcl8.4.so.0(Tcl_UplevelObjCmd+0xf0)[0x7fc23f896670]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(+0x5a6bf)[0x7fc23f8676bf]
/usr/lib/libtcl8.4.so.0(TclCompEvalObj+0xff)[0x7fc23f864d9f]
/usr/lib/libtcl8.4.so.0(TclObjInterpProc+0x21d)[0x7fc23f896aed]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(+0x5a6bf)[0x7fc23f8676bf]
/usr/lib/libtcl8.4.so.0(TclCompEvalObj+0xff)[0x7fc23f864d9f]
/usr/lib/libtcl8.4.so.0(TclObjInterpProc+0x21d)[0x7fc23f896aed]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(+0x5a6bf)[0x7fc23f8676bf]
/usr/lib/libtcl8.4.so.0(TclCompEvalObj+0xff)[0x7fc23f864d9f]
/usr/lib/libtcl8.4.so.0(TclObjInterpProc+0x21d)[0x7fc23f896aed]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(+0x5a6bf)[0x7fc23f8676bf]
/usr/lib/libtcl8.4.so.0(TclCompEvalObj+0xff)[0x7fc23f864d9f]
/usr/lib/libtcl8.4.so.0(TclObjInterpProc+0x21d)[0x7fc23f896aed]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(+0x5a6bf)[0x7fc23f8676bf]
/usr/lib/libtcl8.4.so.0(TclCompEvalObj+0xff)[0x7fc23f864d9f]
/usr/lib/libtcl8.4.so.0(TclObjInterpProc+0x21d)[0x7fc23f896aed]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(+0x5a6bf)[0x7fc23f8676bf]
/usr/lib/libtcl8.4.so.0(TclCompEvalObj+0xff)[0x7fc23f864d9f]
/usr/lib/libtcl8.4.so.0(TclObjInterpProc+0x21d)[0x7fc23f896aed]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(Tcl_EvalEx+0x427)[0x7fc23f83f457]
/usr/lib/aolserver4/lib/libnsd.so(+0x4ab3f)[0x7fc23fd31b3f]
/usr/lib/aolserver4/lib/libnsd.so(NsRunFilters+0x9e)[0x7fc23fd1742e]
/usr/lib/aolserver4/lib/libnsd.so(NsConnThread+0x2e5)[0x7fc23fd1f605]
/usr/lib/aolserver4/lib/libnsthread.so(+0x6404)[0x7fc23fae3404]
/lib/libpthread.so.0(+0x68ca)[0x7fc23f3f38ca]
/lib/libc.so.6(clone+0x6d)[0x7fc23ecc292d]
======= Memory map: ========
00400000-00401000 r-xp 00000000 08:01 7602196 /usr/sbin/aolserver4-nsd
00600000-00601000 rw-p 00000000 0.......

Dear Jacqueline,

is the nsd binary 32 or 64bit? (file /usr/sbin/aolserver4-nsd)
Do have a chance to use a recent version of tcl 8.5?

It looks to me as though a database query is exposing a bug in libpq (the library which is used by programs which communicate with postgres). Possibly postgres is returning a bad value to libpq, or it's a bug in libpq.

Looking at the trace:

/lib/libc.so.6(+0x71bd6)[0x7fc23ec64bd6]
/lib/libc.so.6(cfree+0x6c)[0x7fc23ec6994c]
/usr/lib/libpq.so.5(+0xa161)[0x7fc23c386161]
/usr/lib/aolserver4/lib/libnspostgres.so(+0x27ca)[0x7fc23c1767ca]
/usr/lib/aolserver4/lib/libnsdb.so(Ns_DbExec+0x38)[0x7fc23c7a9718]
/usr/lib/aolserver4/lib/libnsdb.so(Ns_DbSelect+0x49)[0x7fc23c7a9659]
/usr/lib/aolserver4/lib/libnsdb.so(Ns_Db0or1Row+0x1e)[0x7fc23c7ab64e]

you can see that it appears that a "0or1row" query is being done.

Is the backtrace the same each time it crashes with invalid pointer? Always in the database?

If so, one approach for debugging this would be to turn on database query logging in your config.tcl file. The query that's causing the crash should be logged before the crash happens.

It's important to try to figure out if each of the two types of crashes you cause have single causes, in this case if it's a single query that causes the database library (libpq) to die.

Also, as Gustav has asked, could you give us information on the server, 32-bit or 64-bit and also which version of postgres?

When you upgraded to 2.5, did you upgrade other software, too?

The more information you can give us, the better.

Thanks ...

Hello Don and Gustav,thank you for your answers.

Well nsd is 64bits, and tcl is 8.4... I going to try to upgrade it.

About Don questions, the error is not the same one each time. It is always about memory, but sometimes it say: "double free corruption (fast)".... And it could happen even on sending mails...

About database, it is on postgresql 8.4 and the process don't stop when aolserver fails. Also, there is no fail log on postgresql.log.

When we change the version of dotlrn, we did it on new server using debian squeeze (2.6.32-5) the older one used to be on debian lenny (2.5), the package dependencies where took from the specified ones on synaptic.

Additional we installed tsoap and tcl-tls.

This week a new kind of error appears but I'm not sure it is related to the first one. Around 3-5 times by hour, the network interface stop to publish the site (nsd process is alive, but the public interface is not accesible), and we fix it provisionally with an "/etc/init.d/networking restart" on crontab.

I going to publish a complete log with the error, because the last one is truncate.

Thank you in advance for your time and help.
Best regards,

Jacqueline

** glibc detected *** /usr/lib/aolserver4/bin/nsd: free(): invalid pointer: 0x00007fc23ef51238 ***
======= Backtrace: =========
/lib/libc.so.6(+0x71bd6)[0x7fc23ec64bd6]
/lib/libc.so.6(cfree+0x6c)[0x7fc23ec6994c]
/usr/lib/libpq.so.5(+0xa161)[0x7fc23c386161]
/usr/lib/aolserver4/lib/libnspostgres.so(+0x27ca)[0x7fc23c1767ca]
/usr/lib/aolserver4/lib/libnsdb.so(Ns_DbExec+0x38)[0x7fc23c7a9718]
/usr/lib/aolserver4/lib/libnsdb.so(Ns_DbSelect+0x49)[0x7fc23c7a9659]
/usr/lib/aolserver4/lib/libnsdb.so(Ns_Db0or1Row+0x1e)[0x7fc23c7ab64e]
/usr/lib/aolserver4/lib/libnspostgres.so(+0x4c24)[0x7fc23c178c24]
/usr/lib/libtcl8.4.so.0(TclInvokeStringCommand+0x7c)[0x7fc23f83d59c]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(Tcl_EvalObjv+0xe3)[0x7fc23f83ea13]
/usr/lib/libtcl8.4.so.0(Tcl_EvalObjEx+0x234)[0x7fc23f83f8c4]
/usr/lib/libtcl8.4.so.0(Tcl_UplevelObjCmd+0xf0)[0x7fc23f896670]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(+0x5a6bf)[0x7fc23f8676bf]
/usr/lib/libtcl8.4.so.0(TclCompEvalObj+0xff)[0x7fc23f864d9f]
/usr/lib/libtcl8.4.so.0(Tcl_EvalObjEx+0xee)[0x7fc23f83f77e]
/usr/lib/libtcl8.4.so.0(Tcl_SwitchObjCmd+0x2bb)[0x7fc23f84f58b]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(+0x5a6bf)[0x7fc23f8676bf]
/usr/lib/libtcl8.4.so.0(TclCompEvalObj+0xff)[0x7fc23f864d9f]
/usr/lib/libtcl8.4.so.0(TclObjInterpProc+0x21d)[0x7fc23f896aed]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(Tcl_EvalEx+0x427)[0x7fc23f83f457]
/usr/lib/libtcl8.4.so.0(Tcl_EvalTokensStandard+0x2cd)[0x7fc23f83ef0d]
/usr/lib/libtcl8.4.so.0(Tcl_EvalEx+0x161)[0x7fc23f83f191]
/usr/lib/libtcl8.4.so.0(Tcl_EvalObjEx+0x79)[0x7fc23f83f709]
/usr/lib/libtcl8.4.so.0(Tcl_UplevelObjCmd+0xf0)[0x7fc23f896670]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(+0x5a6bf)[0x7fc23f8676bf]
/usr/lib/libtcl8.4.so.0(TclCompEvalObj+0xff)[0x7fc23f864d9f]
/usr/lib/libtcl8.4.so.0(TclObjInterpProc+0x21d)[0x7fc23f896aed]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(+0x5a6bf)[0x7fc23f8676bf]
/usr/lib/libtcl8.4.so.0(TclCompEvalObj+0xff)[0x7fc23f864d9f]
/usr/lib/libtcl8.4.so.0(TclObjInterpProc+0x21d)[0x7fc23f896aed]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(+0x5a6bf)[0x7fc23f8676bf]
/usr/lib/libtcl8.4.so.0(TclCompEvalObj+0xff)[0x7fc23f864d9f]
/usr/lib/libtcl8.4.so.0(TclObjInterpProc+0x21d)[0x7fc23f896aed]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(+0x5a6bf)[0x7fc23f8676bf]
/usr/lib/libtcl8.4.so.0(TclCompEvalObj+0xff)[0x7fc23f864d9f]
/usr/lib/libtcl8.4.so.0(TclObjInterpProc+0x21d)[0x7fc23f896aed]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(+0x5a6bf)[0x7fc23f8676bf]
/usr/lib/libtcl8.4.so.0(TclCompEvalObj+0xff)[0x7fc23f864d9f]
/usr/lib/libtcl8.4.so.0(TclObjInterpProc+0x21d)[0x7fc23f896aed]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(+0x5a6bf)[0x7fc23f8676bf]
/usr/lib/libtcl8.4.so.0(TclCompEvalObj+0xff)[0x7fc23f864d9f]
/usr/lib/libtcl8.4.so.0(TclObjInterpProc+0x21d)[0x7fc23f896aed]
/usr/lib/libtcl8.4.so.0(TclEvalObjvInternal+0x313)[0x7fc23f83e7a3]
/usr/lib/libtcl8.4.so.0(Tcl_EvalEx+0x427)[0x7fc23f83f457]
/usr/lib/aolserver4/lib/libnsd.so(+0x4ab3f)[0x7fc23fd31b3f]
/usr/lib/aolserver4/lib/libnsd.so(NsRunFilters+0x9e)[0x7fc23fd1742e]
/usr/lib/aolserver4/lib/libnsd.so(NsConnThread+0x2e5)[0x7fc23fd1f605]
/usr/lib/aolserver4/lib/libnsthread.so(+0x6404)[0x7fc23fae3404]
/lib/libpthread.so.0(+0x68ca)[0x7fc23f3f38ca]
/lib/libc.so.6(clone+0x6d)[0x7fc23ecc292d]
======= Memory map: ========
00400000-00401000 r-xp 00000000 68:01 15089880 /usr/sbin/aolserver4-nsd
00600000-00601000 rw-p 00000000 68:01 15089880 /usr/sbin/aolserver4-nsd
01261000-2a171000 rw-p 00000000 00:00 0 [heap]
7f806c000000-7f806c305000 rw-p 00000000 00:00 0
7f806c305000-7f8070000000 ---p 00000000 00:00 0
7f8070f36000-7f8070f37000 ---p 00000000 00:00 0
7f8070f37000-7f807c000000 rw-p 00000000 00:00 0
7f807c000000-7f807ff7c000 rw-p 00000000 00:00 0
7f807ff7c000-7f8080000000 ---p 00000000 00:00 0
7f8080000000-7f8083e0f000 rw-p 00000000 00:00 0
7f8083e0f000-7f8084000000 ---p 00000000 00:00 0
7f8084000000-7f8088000000 rw-p 00000000 00:00 0
7f8088353000-7f8088354000 ---p 00000000 00:00 0
7f8088354000-7f8088ed4000 rw-p 00000000 00:00 0
7f8088f06000-7f8088f07000 ---p 00000000 00:00 0
7f8088f07000-7f8089008000 rw-p 00000000 00:00 0
7f8089008000-7f8089009000 ---p 00000000 00:00 0
7f8089009000-7f808910a000 rw-p 00000000 00:00 0
7f808910a000-7f808910b000 ---p 00000000 00:00 0
7f808910b000-7f808920c000 rw-p 00000000 00:00 0
7f808920c000-7f808920d000 ---p 00000000 00:00 0
7f808920d000-7f808930e000 rw-p 00000000 00:00 0
7f808930e000-7f808930f000 ---p 00000000 00:00 0
7f808930f000-7f8089410000 rw-p 00000000 00:00 0
7f8089410000-7f8089411000 ---p 00000000 00:00 0
7f8089411000-7f8089c11000 rw-p 00000000 00:00 0
7f8089c11000-7f8089c12000 ---p 00000000 00:00 0
7f8089c12000-7f8089d13000 rw-p 00000000 00:00 0
7f8089d13000-7f8089d18000 r-xp 00000000 68:01 68321744 /lib/libnss_dns-2.11.3.so
7f8089d18000-7f8089f17000 ---p 00005000 68:01 68321744 /lib/libnss_dns-2.11.3.so
7f8089f17000-7f8089f18000 r--p 00004000 68:01 68321744 /lib/libnss_dns-2.11.3.so
7f8089f18000-7f8089f19000 rw-p 00005000 68:01 68321744 /lib/libnss_dns-2.11.3.so
7f8089f19000-7f8089f1b000 r-xp 00000000 68:01 68322605 /lib/libnss_mdns4_minimal.so.2
7f8089f1b000-7f808a11a000 ---p 00002000 68:01 68322605 /lib/libnss_mdns4_minimal.so.2
7f808a11a000-7f808a11b000 rw-p 00001000 68:01 68322605 /lib/libnss_mdns4_minimal.so.2
7f808a11b000-7f808a11c000 ---p 00000000 00:00 0
7f808a11c000-7f808a21d000 rw-p 00000000 00:00 0
7f808a21d000-7f808a21e000 ---p 00000000 00:00 0
7f808a21e000-7f808a31f000 rw-p 00000000 00:00 0
7f808a31f000-7f808a320000 ---p 00000000 00:00 0
7f808a320000-7f808a421000 rw-p 00000000 00:00 0
7f808a421000-7f808a422000 ---p 00000000 00:00 0
7f808a422000-7f808a523000 rw-p 00000000 00:00 0
7f808a523000-7f808a524000 ---p 00000000 00:00 0
7f808a524000-7f808a625000 rw-p 00000000 00:00 0
7f808a625000-7f808a626000 ---p 00000000 00:00 0
7f808a626000-7f808a727000 rw-p 00000000 00:00 0
7f808a727000-7f808a728000 ---p 00000000 00:00 0
7f808a728000-7f808a829000 rw-p 00000000 00:00 0
7f808a829000-7f808a832000 r-xp 00000000 68:01 63414870 /usr/lib/libtls1.50.so
7f808a832000-7f808aa32000 ---p 00009000 68:01 63414870 /usr/lib/libtls1.50.so
7f808aa32000-7f808aa33000 rw-p 00009000 68:01 63414870 /usr/lib/libtls1.50.so
7f808aa33000-7f808aa59000 r-xp 00000000 68:01 15089883 /usr/lib/libexpat.so.1.5.2
7f808aa59000-7f808ac59000 ---p 00026000 68:01 15089883 /usr/lib/libexpat.so.1.5.2
7f808ac59000-7f808ac5b000 rw-p 00026000 68:01 15089883 /usr/lib/libexpat.so.1.5.2
7f808ac5b000-7f808acb7000 r-xp 00000000 68:01 15548589 /usr/lib/tcltk/tdom0.8.3/libtdom0.8.3.so
7f808acb7000-7f808aeb6000 ---p 0005c000 68:01 15548589 /usr/lib/tcltk/tdom0.8.3/libtdom0.8.3.so
7f808aeb6000-7f808aebd000 rw-p 0005b000 68:01 15548589 /usr/lib/tcltk/tdom0.8.3/libtdom0.8.3.so
7f808aebd000-7f808aee6000 r-xp 00000000 68:01 15541056 /usr/lib/tcltk/xotcl1.6.6/libxotcl1.6.6.so
7f808aee6000-7f808b0e6000 ---p 00029000 68:01 15541056 /usr/lib/tcltk/xotcl1.6.6/libxotcl1.6.6.so
7f808b0e6000-7f808b0ed000 rw-p 00029000 68:01 15541056 /usr/lib/tcltk/xotcl1.6.6/libxotcl1.6.6.so
7f808b0ed000-7f808b101000 r-xp 00000000 68:01 15541361 /usr/lib/tcltk/thread2.6.5/libthread2.6.5-aolserver.so
7f808b101000-7f808b300000 ---p 00014000 68:01 15541361 /usr/lib/tcltk/thread2.6.5/libthread2.6.5-aolserver.so
7f808b300000-7f808b301000 rw-p 00013000 68:01 15541361 /usr/lib/tcltk/thread2.6.5/libthread2.6.5-aolserver.so
7f808b301000-7f808b304000 r-xp 00000000 68:01 15094140 /usr/lib/libgpg-error.so.0.4.0
7f808b304000-7f808b503000 ---p 00003000 68:01 15094140 /usr/lib/libgpg-error.so.0.4.0
7f808b503000-7f808b504000 rw-p 00002000 68:01 15094140 /usr/lib/libgpg-error.so.0.4.0
7f808b504000-7f808b578000 r-xp 00000000 68:01 15094142 /usr/lib/libgcrypt.so.11.5.3
7f808b578000-7f808b778000 ---p 00074000 68:01 15094142 /usr/lib/libgcrypt.so.11.5.3
7f808b778000-7f808b77c000 rw-p 00074000 68:01 15094142 /usr/lib/libgcrypt.so.11.5.3
7f808b77c000-7f808b78c000 r-xp 00000000 68:01 15094144 /usr/lib/libtasn1.so.3.1.9
7f808b78c000-7f808b98b000 ---p 00010000 68:01 15094144 /usr/lib/libtasn1.so.3.1.9
7f808b98b000-7f808b98c000 rw-p 0000f000 68:01 15094144 /usr/lib/libtasn1.so.3.1.9
7f808b98c000-7f808ba28000 r-xp 00000000 68:01 15090467 /usr/lib/libgnutls.so.26.14.12
7f808ba28000-7f808bc27000 ---p 0009c000 68:01 15090467 /usr/lib/libgnutls.so.26.14.12
7f808bc27000-7f808bc2e000 rw-p 0009b000 68:01 15090467 /usr/lib/libgnutls.so.26.14.12
7f808bc2e000-7f808bc47000 r-xp 00000000 68:01 15094163 /usr/lib/libsasl2.so.2.0.23
7f808bc47000-7f808be46000 ---p 00019000 68:01 15094163 /usr/lib/libsasl2.so.2.0.23
7f808be46000-7f808be47000 rw-p 00018000 68:01 15094163 /usr/lib/libsasl2.so.2.0.23
7f808be47000-7f808be54000 r-xp 00000000 68:01 15094165 /usr/lib/liblber-2.4.so.2.5.6
7f808be54000-7f808c054000 ---p 0000d000 68:01 15094165 /usr/lib/liblber-2.4.so.2.5.6
7f808c054000-7f808c055000 rw-p 0000d000 68:01 15094165 /usr/lib/liblber-2.4.so.2.5.6
7f808c055000-7f808c068000 r-xp 00000000 68:01 68321750 /lib/libresolv-2.11.3.so
7f808c068000-7f808c267000 ---p 00013000 68:01 68321750 /lib/libresolv-2.11.3.so
7f808c267000-7f808c268000 r--p 00012000 68:01 68321750 /lib/libresolv-2.11.3.so
7f808c268000-7f808c269000 rw-p 00013000 68:01 68321750 /lib/libresolv-2.11.3.so
7f808c269000-7f808c26b000 rw-p 00000000 00:00 0
7f808c26b000-7f808c26d000 r-xp 00000000 68:01 68321347 /lib/libkeyutils.so.1.3
7f808c26d000-7f808c46c000 ---p 00002000 68:01 68321347 /lib/libkeyutils.so.1.3
7f808c46c000-7f808c46d000 rw-p 00001000 68:01 68321347 /lib/libkeyutils.so.1.3
7f808c46d000-7f808c474000 r-xp 00000000 68:01 15090491 /usr/lib/libkrb5support.so.0.1
7f808c474000-7f808c674000 ---p 00007000 68:01 15090491 /usr/lib/libkrb5support.so.0.1
7f808c674000-7f808c675000 rw-p 00007000 68:01 15090491 /usr/lib/libkrb5support.so.0.1
7f808c675000-7f808c69a000 r-xp 00000000 68:01 15090476 /usr/lib/libk5crypto.so.3.1
7f808c69a000-7f808c899000 ---p 00025000 68:01 15090476 /usr/lib/libk5crypto.so.3.1
7f808c899000-7f808c89b000 rw-p 00024000 68:01 15090476 /usr/lib/libk5crypto.so.3.1
7f808c89b000-7f808c8b2000 r-xp 00000000 68:01 15090769 /usr/lib/libz.so.1.2.3.4
7f808c8b2000-7f808cab1000 ---p 00017000 68:01 15090769 /usr/lib/libz.so.1.2.3.4
7f808cab1000-7f808cab2000 rw-p 00016000 68:01 15090769 /usr/lib/libz.so.1.2.3.4
7f808cab2000-7f808caf9000 r-xp 00000000 68:01 15094166 /usr/lib/libldap_r-2.4.so.2.5.6
7f808caf9000-7f808ccf8000 ---p 00047000 68:01 15094166 /usr/lib/libldap_r-2.4.so.2.5.6
7f808ccf8000-7f808ccfb000 rw-p 00046000 68:01 15094166 /usr/lib/libldap_r-2.4.so.2.5.6
7f808ccfb000-7f808ccfd000 rw-p 00000000 00:00 0
7f808ccfd000-7f808cd05000 r-xp 00000000 68:01 68321736 /lib/libcrypt-2.11.3.so
7f808cd05000-7f808cf04000 ---p 00008000 68:01 68321736 /lib/libcrypt-2.11.3.so
7f808cf04000-7f808cf05000 r--p 00007000 68:01 68321736 /lib/libcrypt-2.11.3.so
7f808cf05000-7f808cf06000 rw-p 00008000 68:01 68321736 /lib/libcrypt-2.11.3.so
7f808cf06000-7f808cf34000 rw-p 00000000 00:00 0
7f808cf34000-7f808cf67000 r-xp 00000000 68:01 15090480 /usr/lib/libgssapi_krb5.so.2.2
7f808cf67000-7f808d167000 ---p 00033000 68:01 15090480 /usr/lib/libgssapi_krb5.so.2.2
7f808d167000-7f808d169000 rw-p 00033000 68:01 15090480 /usr/lib/libgssapi_krb5.so.2.2
7f808d169000-7f808d16c000 r-xp 00000000 68:01 68321353 /lib/libcom_err.so.2.1
7f808d16c000-7f808d36b000 ---p 00003000 68:01 68321353 /lib/libcom_err.so.2.1
7f808d36b000-7f808d36c000 rw-p 00002000 68:01 68321353 /lib/libcom_err.so.2.1
7f808d36c000-7f808d42a000 r-xp 00000000 68:01 15090486 /usr/lib/libkrb5.so.3.3
7f808d42a000-7f808d629000 ---p 000be000 68:01 15090486 /usr/lib/libkrb5.so.3.3
7f808d629000-7f808d634000 rw-p 000bd000 68:01 15090486 /usr/lib/libkrb5.so.3.3
7f808d634000-7f808d7a9000 r-xp 00000000 68:01 15090452 /usr/lib/libcrypto.so.0.9.8
7f808d7a9000-7f808d9a9000 ---p 00175000 68:01 15090452 /usr/lib/libcrypto.so.0.9.8
7f808d9a9000-7f808d9d1000 rw-p 00175000 68:01 15090452 /usr/lib/libcrypto.so.0.9.8
7f808d9d1000-7f808d9d5000 rw-p 00000000 00:00 0
7f808d9d5000-7f808da24000 r-xp 00000000 68:01 15090454 /usr/lib/libssl.so.0.9.8
7f808da24000-7f808dc23000 ---p 0004f000 68:01 15090454 /usr/lib/libssl.so.0.9.8
7f808dc23000-7f808dc2a000 rw-p 0004e000 68:01 15090454 /usr/lib/libssl.so.0.9.8
7f808dc2a000-7f808dc32000 r-xp 00000000 68:01 15534320 /usr/lib/aolserver4/lib/libnspostgres.so
7f808dc32000-7f808de31000 ---p 00008000 68:01 15534320 /usr/lib/aolserver4/lib/libnspostgres.so
7f808de31000-7f808de32000 rw-p 00007000 68:01 15534320 /usr/lib/aolserver4/lib/libnspostgres.so
7f808de32000-7f808de57000 r-xp 00000000 68:01 63414701 /usr/lib/libpq.so.5.2
7f808de57000-7f808e057000 ---p 00025000 68:01 63414701 /usr/lib/libpq.so.5.2
7f808e057000-7f808e058000 r--p 00025000 68:01 63414701 /usr/lib/libpq.so.5.2
7f808e058000-7f808e05a000 rw-p 00026000 68:01 63414701 /usr/lib/libpq.so.5.2
7f808e05a000-7f808e05b000 r--p 00000000 68:01 15534319 /usr/lib/aolserver4/bin/nspostgres.so
7f808e05b000-7f808e25a000 ---p 00001000 68:01 15534319 /usr/lib/aolserver4/bin/nspostgres.so
7f808e25a000-7f808e25b000 rw-p 00000000 68:01 15534319 /usr/lib/aolserver4/bin/nspostgres.so
7f808e25b000-7f808e264000 r-xp 00000000 68:01 15533450 /usr/lib/aolserver4/lib/libnsdb.so
7f808e264000-7f808e463000 ---p 00009000 68:01 15533450 /usr/lib/aolserver4/lib/libnsdb.so
7f808e463000-7f808e464000 rw-p 00008000 68:01 15533450 /usr/lib/aolserver4/lib/libnsdb.so
7f808e464000-7f808e465000 r-xp 00000000 68:01 15533465 /usr/lib/aolserver4/bin/nsdb.so
7f808e465000-7f808e664000 ---p 00001000 68:01 15533465 /usr/lib/aolserver4/bin/nsdb.so
7f808e664000-7f808e665000 rw-p 00000000 68:01 15533465 /usr/lib/aolserver4/bin/nsdb.so
7f808e665000-7f808e667000 r-xp 00000000 68:01 15534321 /usr/lib/aolserver4/lib/libnssha1.so
7f808e667000-7f808e866000 ---p 00002000 68:01 15534321 /usr/lib/aolserver4/lib/libnssha1.so
7f808e866000-7f808e867000 rw-p 00001000 68:01 15534321 /usr/lib/aolserver4/lib/libnssha1.so
7f808e867000-7f808e868000 r--p 00000000 68:01 15534322 /usr/lib/aolserver4/bin/nssha1.so
7f808e868000-7f808ea67000 ---p 00001000 68:01 15534322 /usr/lib/aolserver4/bin/nssha1.so
7f808ea67000-7f808ea68000 rw-p 00000000 68:01 15534322 /usr/lib/aolserver4/bin/nssha1.so
7f808ea68000-7f808ea69000 ---p 00000000 00:00 0
7f808ea69000-7f808eb6a000 rw-p 00000000 00:00 0
7f808eb6a000-7f808eb6d000 r-xp 00000000 68:01 15533451 /usr/lib/aolserver4/lib/libnslog.so
7f808eb6d000-7f808ed6c000 ---p 00003000 68:01 15533451 /usr/lib/aolserver4/lib/libnslog.so
7f808ed6c000-7f808ed6d000 rw-p 00002000 68:01 15533451 /usr/lib/aolserver4/lib/libnslog.so
7f808ed6d000-7f808ed6e000 r-xp 00000000 68:01 15533466 /usr/lib/aolserver4/bin/nslog.so
7f808ed6e000-7f808ef6d000 ---p 00001000 68:01 15533466 /usr/lib/aolserver4/bin/nslog.so
7f808ef6d000-7f808ef6e000 rw-p 00000000 68:01 15533466 /usr/lib/aolserver4/bin/nslog.so
7f808ef6e000-7f808ef6f000 r-xp 00000000 68:01 15533454 /usr/lib/aolserver4/lib/libnssock.so
7f808ef6f000-7f808f16e000 ---p 00001000 68:01 15533454 /usr/lib/aolserver4/lib/libnssock.so
7f808f16e000-7f808f16f000 rw-p 00000000 68:01 15533454 /usr/lib/aolserver4/lib/libnssock.so
7f808f16f000-7f808f170000 r-xp 00000000 68:01 15533469 /usr/lib/aolserver4/bin/nssock.so
7f808f170000-7f808f36f000 ---p 00001000 68:01 15533469 /usr/lib/aolserver4/bin/nssock.so
7f808f36f000-7f808f370000 rw-p 00000000 68:01 15533469 /usr/lib/aolserver4/bin/nssock.so
7f808f370000-7f808f371000 ---p 00000000 00:00 0
7f808f371000-7f808fb71000 rw-p 00000000 00:00 0
7f808fb71000-7f808fb7b000 r-xp 00000000 68:01 68321747 /lib/libnss_nis-2.11.3.so
7f808fb7b000-7f808fd7a000 ---p 0000a000 68:01 68321747 /lib/libnss_nis-2.11.3.so
7f808fd7a000-7f808fd7b000 r--p 00009000 68:01 68321747 /lib/libnss_nis-2.11.3.so
7f808fd7b000-7f808fd7c000 rw-p 0000a000 68:01 68321747 /lib/libnss_nis-2.11.3.so
7f808fd7c000-7f808fd91000 r-xp 00000000 68:01 68321741 /lib/libnsl-2.11.3.so
7f808fd91000-7f808ff90000 ---p 00015000 68:01 68321741 /lib/libnsl-2.11.3.so
7f808ff90000-7f808ff91000 r--p 00014000 68:01 68321741 /lib/libnsl-2.11.3.so
7f808ff91000-7f808ff92000 rw-p 00015000 68:01 68321741 /lib/libnsl-2.11.3.so
7f808ff92000-7f808ff94000 rw-p 00000000 00:00 0
7f808ff94000-7f808ff9b000 r-xp 00000000 68:01 68321743 /lib/libnss_compat-2.11.3.so
7f808ff9b000-7f809019a000 ---p 00007000 68:01 68321743 /lib/libnss_compat-2.11.3.so
7f809019a000-7f809019b000 r--p 00006000 68:01 68321743 /lib/libnss_compat-2.11.3.so
7f809019b000-7f809019c000 rw-p 00007000 68:01 68321743 /lib/libnss_compat-2.11.3.so
7f809019c000-7f80901a8000 r-xp 00000000 68:01 68321745 /lib/libnss_files-2.11.3.so
7f80901a8000-7f80903a7000 ---p 0000c000 68:01 68321745 /lib/libnss_files-2.11.3.so
7f80903a7000-7f80903a8000 r--p 0000b000 68:01 68321745 /lib/libnss_files-2.11.3.so
7f80903a8000-7f80903a9000 rw-p 0000c000 68:01 68321745 /lib/libnss_files-2.11.3.so
7f80903a9000-7f8090502000 r-xp 00000000 68:01 68321733 /lib/libc-2.11.3.so
7f8090502000-7f8090701000 ---p 00159000 68:01 68321733 /lib/libc-2.11.3.so
7f8090701000-7f8090705000 r--p 00158000 68:01 68321733 /lib/libc-2.11.3.so
7f8090705000-7f8090706000 rw-p 0015c000 68:01 68321733 /lib/libc-2.11.3.so
7f8090706000-7f809070b000 rw-p 00000000 00:00 0
7f809070b000-7f8090721000 r-xp 00000000 68:01 68321283 /lib/libgcc_s.so.1
7f8090721000-7f8090920000 ---p 00016000 68:01 68321283 /lib/libgcc_s.so.1
7f8090920000-7f8090921000 rw-p 00015000 68:01 68321283 /lib/libgcc_s.so.1
7f8090921000-7f80909a1000 r-xp 00000000 68:01 68321739 /lib/libm-2.11.3.so
7f80909a1000-7f8090ba1000 ---p 00080000 68:01 68321739 /lib/libm-2.11.3.so
7f8090ba1000-7f8090ba2000 r--p 00080000 68:01 68321739 /lib/libm-2.11.3.so
7f8090ba2000-7f8090ba3000 rw-p 00081000 68:01 68321739 /lib/libm-2.11.3.so
7f8090ba3000-7f8090bba000 r-xp 00000000 68:01 68321480 /lib/libpthread-2.11.3.so
7f8090bba000-7f8090db9000 ---p 00017000 68:01 68321480 /lib/libpthread-2.11.3.so
7f8090db9000-7f8090dba000 r--p 00016000 68:01 68321480 /lib/libpthread-2.11.3.so
7f8090dba000-7f8090dbb000 rw-p 00017000 68:01 68321480 /lib/libpthread-2.11.3.so
7f8090dbb000-7f8090dbf000 rw-p 00000000 00:00 0
7f8090dbf000-7f8090dc1000 r-xp 00000000 68:01 68321738 /lib/libdl-2.11.3.so
7f8090dc1000-7f8090fc1000 ---p 00002000 68:01 68321738 /lib/libdl-2.11.3.so
7f8090fc1000-7f8090fc2000 r--p 00002000 68:01 68321738 /lib/libdl-2.11.3.so
7f8090fc2000-7f8090fc3000 rw-p 00003000 68:01 68321738 /lib/libdl-2.11.3.so
7f8090fc3000-7f8091083000 r-xp 00000000 68:01 63414779 /usr/lib/libtcl8.4.so.0
7f8091083000-7f8091283000 ---p 000c0000 68:01 63414779 /usr/lib/libtcl8.4.so.0
7f8091283000-7f8091291000 rw-p 000c0000 68:01 63414779 /usr/lib/libtcl8.4.so.0
7f8091291000-7f8091293000 rw-p 00000000 00:00 0
7f8091293000-7f809129c000 r-xp 00000000 68:01 15533455 /usr/lib/aolserver4/lib/libnsthread.so
7f809129c000-7f809149c000 ---p 00009000 68:01 15533455 /usr/lib/aolserver4/lib/libnsthread.so
7f809149c000-7f809149d000 rw-p 00009000 68:01 15533455 /usr/lib/aolserver4/lib/libnsthread.so
7f809149d000-7f8091509000 r-xp 00000000 68:01 15533449 /usr/lib/aolserver4/lib/libnsd.so
7f8091509000-7f8091708000 ---p 0006c000 68:01 15533449 /usr/lib/aolserver4/lib/libnsd.so
7f8091708000-7f809170f000 rw-p 0006b000 68:01 15533449 /usr/lib/aolserver4/lib/libnsd.so
7f809170f000-7f8091711000 rw-p 00000000 00:00 0
7f8091711000-7f809172f000 r-xp 00000000 68:01 68321729 /lib/ld-2.11.3.so
7f809179c000-7f8091911000 r--p 00000000 68:01 15107304 /usr/lib/locale/locale-archive
7f8091911000-7f8091916000 rw-p 00000000 00:00 0
7f809192c000-7f809192e000 rw-p 00000000 00:00 0
7f809192e000-7f809192f000 r--p 0001d000 68:01 68321729 /lib/ld-2.11.3.so
7f809192f000-7f8091930000 rw-p 0001e000 68:01 68321729 /lib/ld-2.11.3.so
7f8091930000-7f8091931000 rw-p 00000000 00:00 0
7fff37b20000-7fff37b3c000 rw-p 00000000 00:00 0 [stack]
7fff37bff000-7fff37c00000 r-xp 00000000 00:00 0 [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]

This week a new kind of error appears but I'm not sure it is related to the first one. Around 3-5 times by hour, the network interface stop to publish the site (nsd process is alive, but the public interface is not accesible), and we fix it provisionally with an "/etc/init.d/networking restart" on crontab.

This is the problem reported by Mauricio ... the fact that restarting networking fixes it makes it clear that it's probably not AOLserver at fault.

When this happens, can you "ping" or otherwise access the network interface?

If not, there's some other problem with your machine, maybe you have a bad network interface? The fact that you describe this as a new problem makes me suspect that it's a hardware problem ...

Gustav is the best resource regarding which versions of Tcl/AOLserver work best in a 64-bit environment.

Well,it is weird to explain... when it fails, the server disconect us from ssh (port 8082), but if you try a "telnet" on aolserver port, the interface respond.
I'm agree this is not an aolserver problem, but we request for help to the staff on charge of conections and they are "sure" that the problem if not about networks or interfaces... they say it is an application issue, so I mentioned it on the last post.
How often do you experience the crash of the server? If you say "Around 3-5 times per hour" the network interface crashes that is pretty scary. Did you experience the same problems on debian lenny and on debian squeeze?

The memory map lists the kerberos libraries (and ldap). Where are these coming from? Our experience from the kerberos libraries is that these we have tried (mit, heimdal) are not thread safe.

For hat purpose are you using tcl-tls? Can you run the system without it?

Hi, sorry for answer too late.

I already fixed the problem of network interfaces after editing a script file. It was not about aolserver, it was about git.

Thanks for all help .