Slow Crowd integration for large number of groups and users

Fisheye provides integration with Crowd. However sync or group list may be really slow when there are many users and groups. Eg. it is reported that for 9000 users and 6000 groups a screen showing group list may take ~14 mins to render and sync takes several hours.