The "Application password" isn't refreshed with the "Apply" button. Rather, the correct password doesn't register after an incorrect one has been input.

The peculiar part is that if the password is entered correctly the first time, the system will register a subsequent incorrect password. But if the correct password is then input, it just won't take.

See the attached screenshot.

###

Administration > Security Settings > Authentication > JIRA or Crowd Authentication Settings