Split Edit and Restrict permissions on page level

Here's the use case:

A user has restricted a page "Secret." He wants his secret-team to edit this page, but he doesn't want any members of his team to add any other groups to this secret page.

There currently isn't a way in Confluence to support this scenario: Allow editing, but not change my page restrictions. The only other way is to completely remove page restrictions from the entire space.