Previous/next can cause long delays on view issue

When viewing an issue from the issue navigator, the previous/next links are shown to navigate to respective issues.
To generate these, a search request is done. This can cause long delays, esp. when there are a lot of results returned from the search.