You are right:
ns_set put [ns_conn outputheaders] Content-Type "text/html; charset=yourcharset"
Will do the trick. I confused this with the case where I wanted to set the charset on some HTML pages sitting in the filesystem and output witn ns_returnfile.
