While setting the swimlanes and Quick Filters ordered by another field (e.g. Priority ASC or DESC) does not work as it seems to inherit Rank order from the Rapid Board main filter.
See attached screenshots:
Rapid Board Filter
Swimlane Filter
Quick Filter
Work Swimlane
Work Quick Filter