Current State:

At this moment, you can reorder queues, but not priority groups.
 

Proposed Future State:

As we have an option to reorder queues, we could have one to reorder priority groups in queues.
 

Alternative (e.g. Third Party Plugin):

To reorder them, you would have to either rename them or delete/recreate them.