Regression Test
User Manual

Ali Monadi
amondi2@connect.carleton.ca

Systems and Computer Engineering
Carleton University

Guide to the Regression Test

IMPORTANT: Every time the test is run, it will delete all files from the last iteration (if there were any!). There will be an error when try to remove the project if you have opened any of the files in the directory that is being deleted. Make sure they are all closed. To avoid this problem, open the project in eclipse only. To view the results please open the project AFTER running it. It will be located in the workspace. Go to the file menu, click on import. On the dialog window that opens click on “Existing projects into the workspace”. Now find the project. It should be named “______Regression”, where the blank is either Devs or CellDevs (this will depend on the test you are running).

ALSO: all projects should be tested for 1 MIN because the original projects have been run for 1 MIN.

How the regression test works:

The Devs button in the Regression perspective is used to do a regression test on a couple of projects (as many as you would like).What the Devs button does is, copy a folder (DevsRegression) from the cd++ plugin directory to the workspace directory.

This folder contains the projects that will be used for the regression test. They have been run before and contain all the files that would appear as the output or result files.

Within the “_____Regression” folder there is a Results folder which will contain all the results of the tests. There will be a folder created for every project in the Results folder.  These folders will contain the original output files (renamed as orig.out or orig.log) and the newly created files (renamed as new.out or new.log). In these folders there will also be a file called Results.txt which will indicate the difference between the files.

How to do your own tests:

To do a test all that needs to be done is to press the Devs button in the Regression perspective. A dialog box will appear asking for a new SIMU location and a few other options.  This will be the new simu.exe that you would like to test. By default there will be a certain set of files that will be used for the test. If you would like to use a different set of files to test the simulation, place the projects of your choice in folder at this path;...\plugins\CD++Builder_1.1.0\DevsRegression\Models.  

The folder name must NOT have any spaces. It must only contain ONE ".ma" file and ONE ".ev" file and must have been run before with the original sumi found in the cd++ plugin to contain the ".log" or ".out" files (or both).

The detailed results of each project can be found in the "...\workspace\DevsRegression\Results\" directory. This directory will contain a folder for each project holding the results of the test.