Comment button jumps after adding a comment

1. Notice the position of the comment button.
2. Add a comment.
3. Notice that the position of the comment button has changed.

This is easier to notice when you collapse the "Activity" block, but the same happens with that block is expanded too.