Uploaded image for project: 'Bitbucket Cloud'
  1. Bitbucket Cloud
  2. BCLOUD-21054

Allow Pipelines to combine/show multiple assertion failures within the same test case

XMLWordPrintable

    • Our product teams collect and evaluate feedback from a number of different sources. To learn more about how we use customer feedback in the planning process, check out our new feature policy.

      Pipelines test report is unable to identify if the failure is a testcase failure or assertion failure.

      Example:

      <?xml version="1.0"?>
<testsuites failures="3" errors="0" tests="1">
  <testsuite name="CH.....uage" errors="0" failures="3" hostname="" id="" package="CH.....uage" skipped="0" tests="1" time="39.01" timestamp="">
    <testcase name="......." time="39.01" assertions="7">
      <failure message="1st Failure: ......; (5149ms)">    ..... </failure>
      <failure message="2nd Failure: ......; (5834ms)">    ......</failure>
      <failure message="3rd Failure: ........ (5929ms)">    .........</failure>
    </testcase>
  </testsuite>
</testsuites>

      Pipelines identify the `failures="3"` in the `<testsuites>` as the number of failed `<testcases>`, but their generated test-report is calculated based on the number of "Assertion" failure in the test.

      Current Result: 3/1 tests failed

        1. Screen Shot 2021-06-21 at 2.35.02 pm.png
          451 kB
          mkleint

              Unassigned Unassigned
              a3002c6cc185 Swetha Boyapati
              Votes:
              2 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: