This only happens in wiki markup. I'm not sure when the bug was introduced.

Pressing Enter in a macro browser field usually confirms the insert or edit (not for text area fields like body obviously).
When using the wiki markup editor it Cancels the dialog instead.