Using issue security makes use of portal "List ALL Filters" very slow

We are using one issue security scheme with one security level. The security level allows access via Group (jira-developers), Reporter and Group Selector (Customer ID).

Out of about 115 projects about 90 have associated this security scheme. All other projects have no security scheme associated.

If you configure the portlet "List ALL Filters" to your dashboard and have 35 filters it takes about 50 seconds to show that dashboard. Without that portlet it takes about 5 seconds.

Without issue security schemes and using the portlet "List ALL Filters" it takes about 3 seconds to show the dashboard.