I am using CA DevTest v:10.3 and setup a Jenkins pipeline to run the tests.
Using Jenkins I am able to deploy the virtual services and executed the tests.
But after the execution of the tests, the Jenkins marked the build as failed for the passed tests.
Please see this Jenkins log:
20:41:39 Test/Suite from MAR file was successfully deployed, id = D2KJHKHF94985BSMBDF ]
20:42:31 Test/Suite run finished with status: FAILED
20:42:31 Test/Suite run details: 2 test(s) executed (1 test(s) passed, 0 test(s) failed)
Not sure what went wrong here and tried the same test suite from the DevTest tool and its working fine.
Anyone see this type of error before?
Thank you in advance.
Please go through the execution report from Devtest portal console, for the test suite which you ran. It shows clear details about the pass and failure count.
If there are any environmental errors with the test run, Jenkin report shows as failed. If you still see the mismatch in test execution report, after going through the portal console, please raise a support case.
Thanks & Regards,