Search This Blog

June 19, 2020

CloudTest: No error message appears in the Azure Pipeline if data-driven tests fail.

Our team at Microsoft decided to use CloudTest framework to run Selenium Tests against React Portal in Azure Devops.

I have developed many localization tests. Today I saw many failed, but there was no error message showing up in the release pipeline and it was hard to debug.

I posted the issue in Stackoverflow.microsoft.com where everyone working at Microsoft can post the questions.

The dev in the CloudTest team replied and said the main issue is that these tests are data-driven tests, and they are not handling the results (especially the way they are reported using InnerResults) correctly while parsing trx files. They have created the work item to track this request.

Hopefully this feature can be finished and deployed shortly..

No comments: