Builds seem to get picked off the queue in random order

I can have multiple builds in my queue (looking at it via the live activity screen) and builds that were added to the queue first are not being picked up by agents first, they seem to get chosen randomly.