'Sorry, you're not authorized to read/unread a file from this review now' after leaving a review

HTR:

1. Open a review that you're not a reviewer on
2. Join the review
3. Remove yourself from the reviewer list
4. Try going to a file

Expected

• no errors

Actual:

• you get an error message saying 'Sorry, you're not authorized to read/unread a file from this review now.'

Workaround is to reload the review page