Re-release of version to Bamboo from JIRA returning errors

Summary

When attempting to re-release (release, unrelease and then release again), Bamboo returns the error below :

Bamboo failed to trigger the release build for version 'version1', errors: [Subscription already exists for this project and version so build has not been triggered]	

Steps to Replicate

1. Create a test version in JIRA and then create a test build plan in Bamboo
2. Find the test version and click ... >> Build and Release next to it
3. Select With new build and then select a Bamboo plan as build
4. Click Release
5. The problem will happen