When first installing the subversion plugin it attempts to create a directory at $indexdir/plugins/atlassian-subversion-revisions.
The problem is that it fails to create this directory unless the $indexdir/plugins directory exists already. The workaround was to manually create the "plugins" directory and reboot Jira and it worked fine.