Cannot configure a build that doesn't produce test results

When I uncheck the "The build will produce test results." checkbox, and then save, and then edit again, the checkbox is still checked, and so if the build doesn't have a JUnit test XML file, the build will always fail.