There are a few ways of implementing this;

1. Clean up the temp directory during start-up
2. Have an expiry mechanism (cron job similar to build expiry)
3. Bamboo should automatically clean up itself after each build

Note: If you are planning to delete this directory, it is important to cleanup when Bamboo server is not running (as there might be builds using the files in this directory).