When you run a Regression Test, the raw test data is stored in a regression test output log file with the extension .mxrlg. The Regression Report is a set of XML files. This report is generated automatically when you run a regression test command file. You can re-generate the report at any time as long as you keep the Regression Result Set folder available on your hard drive.
Once a regression job is complete you can generate a comprehensive XML report from the regression test output log file. Note that when starting a batch job you should use command line options: /o[a] /c to generate a comprehensive log suitable for report generation.
Select Tools->Regression Test from the main menu or use the right-click menus of the Regression Folder in the Project Explorer to launch the Regression Test Wizard that allows you to create and edit Regression Command/Script files. To run an existing Regression Test Script, select Execute. Regression Script files have a .mxreg suffix.
See Regression Testing.
By default, Regression Reports are stored in folders under the Project Folder. The folders are named "Regression-" followed by the date and time of the test.
To view a previously generated report, locate the report in the Project Explorer, under Regression->Runs and the appropriate folder. Double-click on Report.RegResults.xml to open the report in a browser.
The Regression Report contains the following:
•Statistics on the results of the regression test, sorted by folder and group
•Scenario Results: A listing of the results of scenarios and TestCases run as part of the regression test with links to Scenario Result Logs (.mxlog files)
•Failure Details: An optional listing of TestCases for failed Scenarios, including reasons for the failure. A Scenario does no Pass/Fail testing itself. A Scenario passes if all its referenced TestCases pass.
•Text transmitted from the MxV RegressionInfo system command
Note: Not ALL the actual results are stored in the scenario .mxlog file. It isn’t practically feasible to present all the expected and actual data in the same table. It can be done better graphically, so this is how we show the actual data. To see the detailed results for any Scenario, you can click the link in the report to load the .mxlog file into MxVDev. In MxVDev, you can view results graphically and use tools such as the Transition List to review data.
Link to Scenario
DoorTurnScenario with Link to Test Case
Door Test Case with Link to Transitions Detail
You can use the MxV RegressionInfo System Signal to capture data from the Test Harness and include it in the Regression Test Report.
Here is a typical use case:
•In your TestCases, use diagnostic requests to capture actual software/hardware version data from the ECU under test.
•Create a Custom Transform and set it up to:
oReceive the diagnostic responses.
oFormat the version data in the diagnostic responses into a printable ASCII format.
oSend the ASCII-formatted version strings to a port named MxV RegressionInfo. The strings sent to this port appear in the Regression Report header.
For information on using the System Signal, see MxV RegressionInfo.
After a Regression Report has been generated, you can convert it to PDF. This has the advantage of storing all report data in a single file.
1.In the Project Explorer, right-click on Regression > Runs > report node
2.Select Convert to PDF.
3.Select your Conversion Options.
4.Click the Convert button.
5.Use Adobe Acrobat or Adobe Acrobat Reader to view the PDF file.
Errors/Warnings in the conversion process are displayed in the command window. Sometimes warnings may occur, but not affect the overall report output. If the report is successfully converted, the resulting PDF file is named "Report.RegResults.pdf" and is placed in the specified Destination directory. If the report does not convert successfully, please copy the output of this window and e-mail it along with the MxVDev error logs to firstname.lastname@example.org.