Currently the ehcache.xml file is located at:

$BAMBOO_INST/atlassian-bamboo/WEB-INF/classes

This file contains user repository cache configuration.

Backups don't include this file, hence it needs to be manually copied over from the old instance into the new instance after upgrades.
A suggestion is to move this file to:

$BAMBOO_HOME/xml-data/configuration