Currently, inline comments can't be added to image captions on published pages. The comment option is greyed out when you highlight text in an image caption.

Inline comments can be added to image captions in edit mode though.

So, it will be useful to have this option on published pages.