Manage Filters page is slow if user is a member of many groups

The problem is that a separate query is run for each filter for each group the user is a member. If the user is a member of many groups and has access to many filters the ManageFilters page can take a long time to load.