IE does have caching issues and it seems like this may be causing your problem. I use Mozilla Firebird and certainly haven't looked back (for this reason and MANY others).
As Jade said, installing the telnet client isn't a security risk, it's the server that can cause problems. Just remember when using the client that all data including usernames and passwords is sent in clear text. When debugging a server connection this is no problem.
