Remove the hidden buttons entirely, no hacky JavaScript fix required here. Just make sure that button you want as the default action appears first in the markup then use CSS to position the buttons appropriately.

Though the easiest option is to set tabindex="-1" on the hidden buttons.