Currently capabilities can be shared between all local agents as well as between all remote agents. As this documentation states:

Shared remote executable capabilities are not shared with elastic agents.

This is particularly detrimental to OnDemand customers as they can only utilize Elastic Agents making shared capabilities mostly useless to OnDemand users.