ISEB Foundation Certificate in Software Testing Re-Testing & Regression Testing SIM Group Ltd., SQS Group AG, 2002 Re-Testing & Regression Testing In this session we will
Understand how fault fixing and re-testing are key to the overall testing process
Look at how test repeatability helps
Understand what regression testing is and where it fits in
Understand how to select test cases for regression testing SIM Group Ltd., SQS Group AG, 2002 Re-Testing Testing is directed at finding faults
These faults will need to be corrected and a new version of the software released
The tests will need to be run again to prove that the fault is fixed
This is known as Re-Testing SIM Group Ltd., SQS Group AG, 2002 Re-Testing The need for re-testing needs to be planned & designed for
Schedules need to allow for re-testing
Tests need to be easily re-run
The environment needs to be easily restored SIM Group Ltd., SQS Group AG, 2002 Regression Testing Re-testing of a previously tested program following modification to ensure that FAULTS have not been introduced or uncovered as a result of the changes made SIM Group Ltd., SQS Group AG, 2002 Regression Testing Module 14 v1.4.2
~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~ Declare String x =Date(); ~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~
Module 41 v1.8.9
~~~~~~~~~~~~~~~~ Declare Integer x = 0; ~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~ For x = 1 to 5 ~~~~~~~~~~~~~~~~
~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~ Global String x = Date(); ~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~
How can you fix this but break that?
SIM Group Ltd., SQS Group AG, 2002 Regression Testing Tests will also need to be re-run when checking software upgrades
Regression tests should be run whenever there is a change to the software or the environment
Regression tests are executed to prove aspects of a system have not changed
Regression Testing is a vital testing technique SIM Group Ltd., SQS Group AG, 2002 Regression Testing Selecting cases for regression:
Tests that cover safety or business critical functions
Tests that are repetitive
Tests that need accurate data
Tests for areas that change regularly
Tests of functions that have a high level of defects SIM Group Ltd., SQS Group AG, 2002 Regression Testing Regression Testing is the ideal foundation for Automation
Selecting test cases is vital, and requires a degree of knowledge of the applications and their expected evolution SIM Group Ltd., SQS Group AG, 2002 Re-Testing & Regression Testing Summary
Once a fault has been fixed the software MUST be re-tested New faults may have been introduced by the fix Existing faults may have been uncovered by the fix Tests need to be written to enable their re-use
Re-testing is the rerunning of failed tests once a fix has been implemented to check that the fix has worked
Regression testing is running of a wider test suite to check for unexpected errors in unchanged code