When adding a mail server configuration, enter host/username/password. Then an invalid From address. The password box still shows content, as if the password was saved.
Now add a valid from email and save. Go back to the page. The password is lost (and never got saved, cause emails don't come through).