Regression Test Report

Select Tools->Regression Test from the main menu or use the right-click menus of the Regression Folder in the Project Explorer to launch the Regression Test Wizard that allows you to create and edit Regression Command/Script files. To run an existing Regression Test Script, select Execute. Regression Script files have a .mxreg suffix.

See Regression Testing.

By default, Regression Reports are stored in folders under the Project Folder. The folders are named "Regression-" followed by the date and time of the test.

To view a previously generated report, locate the report in the Project Explorer, under Regression->Runs and the appropriate folder.  Double-click on Report.RegResults.xml to open the report in a browser. Microsoft Edge is recommended.

The Regression Report contains the following:

•Statistics on the results of the regression test, sorted by folder and group

•Scenario Results: A listing of the results of scenarios and TestCases run as part of the regression test with links to Scenario Result Logs (.mxlog files).

•Failure Details: An optional listing of TestCases for failed Scenarios, including reasons for the failure. A Scenario does no Pass/Fail testing itself. A Scenario passes if all its referenced TestCases pass.

•Tolerances, Triggers, and Reactive Settings for each TestCase

•Text transmitted from the MxV RegressionInfo system command

Note: It isn’t practical to present all expected and actual data in a table. It can be done better graphically, so this is how we show the actual data.  To see the detailed results for any Scenario, you can click the link in the report to load the .mxlog file into MxVDev. In MxVDev, you can view results graphically and use tools such as the Transition List to review data.

In the report, click on links (red text as shown below) to display detail on Scenarios, TestCases, and transitions.

Link to Scenario

DoorTurnScenario with Link to Test Case

Door Test Case with Link to Transitions Detail

You can use the MxV RegressionInfo System Signal to capture data from the Test Harness and include it in the Regression Test Report.

Here is a typical use case:

•In your TestCases, use diagnostic requests to capture actual software/hardware version data from the ECU under test.

•Create a Custom Transform and set it up to:

oReceive the diagnostic responses.

oFormat the version data in the diagnostic responses into a printable ASCII format.

oSend the ASCII-formatted version strings to a port named MxV RegressionInfo. The strings sent to this port appear in the Regression Report header.

For information on using the System Signal, see MxV RegressionInfo.

After a Regression Report has been generated, you can convert it to PDF. This has the advantage of storing all report data in a single file.

1.In the Project Explorer, right-click on Regression > Runs > report node

2.Select Convert to PDF.

3.Select your Conversion Options.

4.Click the Convert button.

5.Use Adobe Acrobat or Adobe Acrobat Reader to view the PDF file.

Errors/Warnings in the conversion process are displayed in the command window. Sometimes warnings may occur, but not affect the overall report output. If the report is successfully converted, the resulting PDF file is named "Report.RegResults.pdf" and is placed in the specified Destination directory. If the report does not  convert successfully, please copy the output of this window and e-mail it along with the MxVDev error logs to mxsupport@danlawinc.com.

Command Window