If I use url like /path:to.image/image.png in markdown then it will be filtered away however I can use %3a to work around that.

It's minor inconvenience as most of the images and other resources coming from plugins will have colon in their urls.