Adding Mail Service requires restart

After configuring services for "Comment Emailing" and "Issue Creation from Email" a restart of Tomcat is required, otherwise the server log says the the class is not valid.