When you have registered your nickname, to "identify" yourself you must enter the password like so: /nickserv id password. If you don't type it exactly like that and hit enter then your password winds up showing in chat.
I've done this a few times. forget the / or accidentally have a space in...