Adding group selector permission makes project name visible to everyone

JIRA 3.6 and above has the ability to grant a permission to a group custom field.

When one of these "Group Selector" permissions is granted in a scheme, that project becomes visible in portlets and in the "Browse" menu, even though no issues in it are visible. The project should only become visible to people in a group selected for visibility by at least one issue.