Test Execution Management
This document provides guidelines on how to create, manage, and execute test plans in the TESTaide application.
Test Execution Management requires the correct permissions, such as Project Manager, Create Plan/TC …, TC Execute. For more information, please refer to the Global Permissions guide.
Before being able to execute a test plan, the following prerequisites must be satisfied.
The status of test plan must be changed to testing.
To be able to add a regression for execution, the desired test plan must include at least one test case.
For more information regarding this, please refer to the guide on Test Plans.
Adding a new Regression
When a new regression is added, all the test cases within that test plan are targeted for testing.
Therefore, test cases that are no longer needed to be tested should be deleted and new test cases should be added before adding a new regression.
Before continuing with this guide, make sure the prerequisites are satisfied!
When a user has moved a test plan with at least one test case to the testing phase, you will be able to view that test plan on the ‘Test Execution’ page of the project. You will find the ‘Test Execution’ page on the left-hand side navigation bar available after having selected a project from the TESTaide homepage.
From the list of available test plans, select the test plan that you want to add a regression to. This will redirect you to a page containing any existing regression for that test plan.
On the top right of the page, click the ‘Add Regression’ button and when the pop-up window appears, enter the required and any optional information, refer to the table below for more information regarding the regression fields.
Click the ‘Save’ button at the bottom to complete the adding a regression.
Field | Description |
|---|---|
Test Plan Key | The key of the selected test plan cannot be modified. It is automatically created using the name of the test plan. |
Regression Title | The maximum length for the title is 50 characters. |
Environment | (Optional) Test environment selected when creating the test plan. |
Test Execution
Once you have created a regression you will be able to view it on the list of regressions for that test plan. This list contains detailed information about regression such as which environment it is attached to, any start or end dates of an execution, and any latest result.
Furthermore, you will be able to see the ‘Run’ button, by pressing this button will the regression start to execute and you will be redirected to the appropriate page depending on the type of the test plan that is executed.
Cancel an Execution
After having started a regression and the execution is still in progress, the ‘Run’ icon on the execution list page will have changed to display a ‘Stop’ icon instead for that regression.
Simply press the ‘Stop’ icon.
This opens a pop-up window asking for confirmation for the action, by pressing ‘Yes’, the execution will be canceled.
Checking the results of the test execution
After having started a regression you will be redirected another page depending on type of the plan that has been executed…
For a test plan of the manual type
For manual test plans, executing a regression will redirect you to the results page where you are able to observe the regression result together with the details of the test case.
On the result page for the test case, you can enter the result collectively for all of the test steps with the ALL PASS/ALL FAIL button.
Alternatively, in the test step list table, you can enter the result for each test step with the Pass or Fail button in the 'Expected Results' column.
You can go to the previous or next test case in the execution by using corresponding buttons on the upper right or the lower right of the page.
For a test plan of the auto type
For auto test plans, executing a regression will redirect you to the execution page where you are able to observe the progress of the regression and the test cases that are being run with their results updating after each test has completed. You are also able to check the execution log for additional information for each test case and its test scripts.
When the execution is complete, by clicking on any test case, you will be further redirected to the result page with the details of the test case, where you can additionally modify the results.
On the result page for the test case, you can enter the result collectively for all of the test scripts with the ALL PASS/ALL FAIL button.
Alternatively, in the test script list table, you can enter the result for each test script with the Pass or Fail button in the 'Expected Results' column.
You can go to the previous or next test case in the execution by using corresponding buttons on the upper right or the lower right of the page.
Understanding the results
Below you can find information regarding the meaning of the regression results.
Execution Result: PASS
The overall execution result of the test case becomes PASS ONLY when all of the test steps/scripts included in the test case have resulted in PASS.
Execution Result: FAIL
If one or more of the test step or script included in the test case resulted in a FAIL, the overall execution result of the test case will result in a FAIL.
If the execution for a specific test case result is FAIL, by selecting the failed test case, an option to add a defect becomes available.
You can create a bug issue in connected Jira project.