In the new TestNG result parser they are not failing the build if setup test methods fail (i.e. those marked as is-config=”true”). We should be able to fail the build if setup methods fail.

Also, they are not reporting the number of skipped tests; just a lower number of passed test. This can make it difficult to tell when things go wrong in a build.