Rank (drag and drop) swimlane when grouped by story

When our SCRUM board is grouped into Story swimlanes, I cannot change the rank of the stories when viewing the board. The simple workaround is to change the rank in the backlog, and then switch back to the board where the swimlanes are re-ordered. It would be good to be able to Rank the grouped stories/swimlanes directly.