When we turn off the contact admin form (Settings> General Configuration) the Contact Administrators Message is also gone and displays a message that the form has not been configured.

Instead, the message should be there which has been configured in the Contact Administrators Message