• Icon: Suggestion Suggestion
    • Resolution: Obsolete
    • None
    • Tests
    • None
    • On Tomcat + JDK 1.5.09
    • Our product teams collect and evaluate feedback from a number of different sources. To learn more about how we use customer feedback in the planning process, check out our new feature policy.

      We use TestNG for all our tests and would it be absolutely necessary that our continuous integration server can execute these tests.

            [BAM-538] TestNG test integration

            edwin added a comment -

            Hi guys,

            As it stands, Bamboo does work with TestNG results, but there are some limitations. Currently, we are aware of (linked):

            • BAM-2174 Implement support for TestNG's ability to skip tests
            • BAM-2627 Incorrect JUnit test count when multiple tests have the same name

            Moving forward, we will track individual issues working with TestNG, so I will close this more generic issue off for now. Please don't hesitate to raise any other issues you may find with Bamboo and TestNG.

            Cheers,
            Edwin

            edwin added a comment - Hi guys, As it stands, Bamboo does work with TestNG results, but there are some limitations. Currently, we are aware of (linked): BAM-2174 Implement support for TestNG's ability to skip tests BAM-2627 Incorrect JUnit test count when multiple tests have the same name Moving forward, we will track individual issues working with TestNG, so I will close this more generic issue off for now. Please don't hesitate to raise any other issues you may find with Bamboo and TestNG. Cheers, Edwin

            Craig added a comment -

            If you are using the maven builder and the maven-surefire-plugin defaults, the "Failed to parse test result file "testng-results.xml" error can be worked around by setting the "Specify custom results directories" to **/surefire-reports/TEST-TestSuite.xml. But TestNG support would be nice.

            Craig added a comment - If you are using the maven builder and the maven-surefire-plugin defaults, the "Failed to parse test result file "testng-results.xml" error can be worked around by setting the "Specify custom results directories" to **/surefire-reports/TEST-TestSuite.xml. But TestNG support would be nice.

            Please fix the "Failed to parse test result file "testng-results.xml" " error message; either parse the file correctly or allow an option to not flag this as an error.

            David A. Riggs added a comment - Please fix the "Failed to parse test result file "testng-results.xml" " error message; either parse the file correctly or allow an option to not flag this as an error.

            I'm sorry I might not be of much help on this. But currently we use eclipse and the testng plugin for eclipse to manually run our tests. The code is then checked into svn. Certainly we'd want to automate running the tests from the code in the respository and this is one area I think a CI server such a Bamboo should help us.

            Sudhakar Ramasamy added a comment - I'm sorry I might not be of much help on this. But currently we use eclipse and the testng plugin for eclipse to manually run our tests. The code is then checked into svn. Certainly we'd want to automate running the tests from the code in the respository and this is one area I think a CI server such a Bamboo should help us.

            MarkC added a comment -

            Sudhakar,

            Thanks for the feedback.

            Is it possible for you to describe your current build processes so we can see how Bamboo could fit into your workflow? i.e. You have a project in SVN, you build a JAR using a custom script that runs your TestNG reports etc. I guess I want to understand how you use TestNG at the moment - what command you use to run the tests and create the HTML files.

            I've made this issue private for now, in case you're worried about discussing your build processes publicly.

            Cheers,

            Mark C

            MarkC added a comment - Sudhakar, Thanks for the feedback. Is it possible for you to describe your current build processes so we can see how Bamboo could fit into your workflow? i.e. You have a project in SVN, you build a JAR using a custom script that runs your TestNG reports etc. I guess I want to understand how you use TestNG at the moment - what command you use to run the tests and create the HTML files. I've made this issue private for now, in case you're worried about discussing your build processes publicly. Cheers, Mark C

            I'm not very familiar with the internals of TestNG and use it as an end-user (programmer). What I did find out is that it produces HTML output. I did not see any sort of xml files.

            Sudhakar Ramasamy added a comment - I'm not very familiar with the internals of TestNG and use it as an end-user (programmer). What I did find out is that it produces HTML output. I did not see any sort of xml files.

            MarkC added a comment -

            Sudhakar,

            Does TestNG produce JUnit compatible XML test reports? If this is the case, then you should be able to use Bamboo as your CI server still.

            Do you use Ant or Maven to run your tests? Or something else?

            Cheers,

            Mark C

            MarkC added a comment - Sudhakar, Does TestNG produce JUnit compatible XML test reports? If this is the case, then you should be able to use Bamboo as your CI server still. Do you use Ant or Maven to run your tests? Or something else? Cheers, Mark C

              Unassigned Unassigned
              c63c1e202abf Sudhakar Ramasamy
              Votes:
              3 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: