Currently the guest role is added automatically to permission schemes and can't be removed. 

As a site admin, it'd be useful to decide which spaces can have guest users and update the permission scheme accordingly.