Uploaded image for project: 'Bamboo Data Center'
  1. Bamboo Data Center
  2. BAM-20632

tests tab displays only the first 1000 test result entries

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Low Low
    • None
    • 6.9.1
    • Tests
    • None

      Issue Summary

      If a test report contains more than 1000 test results, Bamboo doesn't list them all when we navigate to 'tests' tab in build result summary.

      Steps to Reproduce

      1. Add a test report xml file with more than 1000 test results in a build
      2. Add a JUnit parser task to parse this test report.
      3. Run this build

      Expected Results

      All the test results in the Build result summary page are listed (preferably paginated showing only the first few and leave the rest in next subsequent pages).

      Actual Results

      Only the first 1000 test results are listed, but the Tests tab clearly shows there are more test passed/failed.

      Workaround

      There is no workaround to display the remaining tests for now.

            [BAM-20632] tests tab displays only the first 1000 test result entries

            Displaying tests on a tab was designed for a user. It works best for devs if they've few tests failing so they can quickly see what's wrong and fix it. From that perspective anything >100 doesn't make sense, because it seems like global failure and you wouldn't fix it one-by-one anyway.

            For code analysis I'd recommend relatively new feature - build warnings parser (https://confluence.atlassian.com/bamboo/configuring-build-warnings-parser-task-957148051.html). It's sent to Bitbucket Server and you can see it with your code.

            For more automated tasks - processing xml tests results file would be much better in comparison to processing web page; whatever your use case is.

            Showing more tests at once can quickly become a performance issue.

            I like the idea about paging this data, but then it's more like improvement request. I'd love to see more interest before I can prioritise it on our roadmap.

            Pawel Skierczynski added a comment - Displaying tests on a tab was designed for a user. It works best for devs if they've few tests failing so they can quickly see what's wrong and fix it. From that perspective anything >100 doesn't make sense, because it seems like global failure and you wouldn't fix it one-by-one anyway. For code analysis I'd recommend relatively new feature - build warnings parser ( https://confluence.atlassian.com/bamboo/configuring-build-warnings-parser-task-957148051.html).  It's sent to Bitbucket Server and you can see it with your code. For more automated tasks - processing xml tests results file would be much better in comparison to processing web page; whatever your use case is. Showing more tests at once can quickly become a performance issue. I like the idea about paging this data, but then it's more like improvement request. I'd love to see more interest before I can prioritise it on our roadmap.

            Soeren Rumpf added a comment - - edited

            We're using the tests to display code analysis results via test failures. Since we have a large code base, we have some cases where we have 2k or even more test failures. Since we can't view more than the first 1000 existing test failures and also not more than 1000 new test failures, this bug is a blocker for us. This doesn't allow me to quarantine or even get a proper overview for the test failures which sadly makes it unusable to work with large test suites.

            Please allow to display all parsed test failures and paginate them or something similar, so that we can view the whole data the Junit parser has parsed.

            Please consider setting the Symptom Severity to at least Major (A feature is unavailable, application performance is significantly degraded, or users job functions are impaired.), since Minor only matches when there is a workaround available and we're having some kind of (drastically spoken but somehow true) "data loss" in this case.

            Soeren Rumpf added a comment - - edited We're using the tests to display code analysis results via test failures. Since we have a large code base, we have some cases where we have 2k or even more test failures. Since we can't view more than the first 1000 existing test failures and also not more than 1000 new test failures, this bug is a blocker for us. This doesn't allow me to quarantine or even get a proper overview for the test failures which sadly makes it unusable to work with large test suites. Please allow to display all parsed test failures and paginate them or something similar, so that we can view the whole data the Junit parser has parsed. Please consider setting the Symptom Severity to at least Major ( A feature is unavailable, application performance is significantly degraded, or users job functions are impaired. ), since Minor only matches when there is a workaround available and we're having some kind of (drastically spoken but somehow true) "data loss" in this case.

              Unassigned Unassigned
              jinbasekaran Jeyanthan I (Inactive)
              Affected customers:
              2 This affects my team
              Watchers:
              6 Start watching this issue

                Created:
                Updated: