It would be helpful if I could disable all notifications while I'm modifying the build plan and testing the changes. This way people wouldn't be bothered by spurious notifications caused by incorrect changes in the build plan.  Once all changes are done, I could re-enable all notifications.

Currently, there is no way how to (temporarily) disable all notifications. The only remove them completely.