Incessant Technologies

Automation Testing Approach And Framework

AUTOMATION TESTING

STEPS INVOLVED IN APPROACH FOR TEST AUTOMATION

Requirement gathering from the client

Understanding and Analyzing the Requirement

Grouping the requirement into Test cases Preparing the Design for Automation Building Scripts depending on the Design Review of Scripts at Offshore Delivery to the Client

DESIGN STEPS OF THE APPROACH FOR TEST AUTOMATION

Identification of Test Cases for Automation Identification of Common Functionality and coding Standards, Naming Conventions & Templates Building the Re-Usable Library for example: Application Login, Logout, Common Functionality Related code etc Tool & Application Settings, Restoring, Object Repository, Recovery, House Keeping etc Error handling, Log Reporting, messaging etc Script Development and deliver after Verification & Validation

BENEFITS OF AUTOMATION TESTING

Speed up Test Execution: In less span of time can run more no of test scripts which reduces the time and speeds up the execution task. Achieved Improved Test Coverage: covers more than what could be done manually. Ensures Consistency, Accuracy and Efficiency: The tests run are consistent, accurate and efficient.

Reliability and Transparency: The tests can perform the exact same steps every time without concern about human error.
Repeatability and Reusability: Once automate test cases i.e. convert the test cases into test scripts, can be run any number of times and can be reused at a later point of time when needed. Helps in Reduce coding for Large Test Cases and ease of testing of timeConsuming & Complex Test Cases

AUTOMATION FRAME WORK

AUTOMATION FRAMEWORK
What an Automation Framework is ? How many types of Automation Framework are there ?

What are the Constituents of Automation Framework ?

WHAT IS TEST AUTOMATION FRAMEWORK

A framework is an integrated system that sets the rules of Automation of a specific product. Automation system integrates the function libraries, test data sources, object details and various reusable modules. The framework provides the basis of test automation and simplifies the automation effort. Provides an Outline of overall Test Structure Ensures Consistency of Testing Minimizes the Amount of Code for Development - thereby Less maintenance Maximizes Reusability

Enables Test Automation using Data - Datapool

TYPES OF AUTOMATION FRAMEWORKS

Automation Framework are of four Types :

Data Driven Automation Framework

Keyword Driven Automation Framework Modular Automation Framework Hybrid Automation Framework

DATA DRIVEN AUTOMATION FRAMEWORK

Data-driven framework is where test input and output values are read from data files (ODBC sources, cvs files, Excel files) and are loaded into variables in captured or manually coded scripts Repeated use of Test Scripts with Different Inputs and Response Data coming out of Predefined Dataset Easy to implement in IBM - RFT with the help of Data pools Helps in Reducing Coding for Large Test Cases Ease of Testing of Time-Consuming & Complex Test Cases

MERITS OF DATA-DRIVEN TESTING

Continue..

Scripts may be developed while application development is still in progress Utilizing a modular design, and using files or records to both input and verify data, reduces redundancy and duplication of effort in creating automated test scripts If functionality changes, only the specific "Business Function" script needs to be updated Data input/output and expected results are stored as easily maintainable text records. Functions return "TRUE" or "FALSE" values to the calling script, rather than aborting, allowing for more effective error handling, and increasing the robustness of the test scripts. This, along with a well-designed "recovery" routine, enables "unattended" execution of test scripts.

DEMERITS OF DATA-DRIVEN TESTING

Requires proficiency in the Scripting language used by the tool (technical personnel) Multiple data-files are required for each Test Case. There may be any number of data-inputs and verifications required, depending on how many different screens are accessed. This usually requires data-files to be kept in separate directories by Test Case Tester must not only maintain the Detail Test Plan with specific data, but must also re-enter this data in the various required data-files If a simple "text editor" such as Notepad is used to create and maintain the data-files, careful attention must be paid to the format required by the scripts/functions that process the files, or script-processing errors will occur due to data-file format and/or content being incorrect

KEYWORD DRIVEN AUTOMATION FRAMEWORK

Keyword-driven testing is a technique that separates much of the programming work from the actual test steps so that the test steps can be developed earlier and can often be maintained with only minor updates, even when the application or testing needs change significantly. As the Name suggests, it enables Keyword Driven Testing or Table Driven Testing Data & Keyword Tables being Independent of the Automation Tool The Keyword Driven framework consists of the basic components given below 1. Control File 2. Test Case File 3. Startup Script 4. Driver Script 5. Utility Script

COMPONENTS KEYWORD DRIVEN AUTOMATION FRAMEWORK

1. Control File a. Consists details of all the Test scenarios to be automated b. User will be able to select a specific scenario to execute based on turning on or off a flag in the Control File c. Control File is in the form of an excel worksheet and contains columns for Scenario ID, Execute (Y/N), Object Repository Path, Test Case File Path 2. Test Case File a. Contains the detailed steps to be carried out for the execution of a test case b. It is also in the form of an excel sheet and contains columns for Keyword, Object Name, Parameter 3. Startup Script a. The Startup script is utilized for the initialization and reads the control files b. It then calls the driver script to execute all the scenarios marked for execution in the control file

Contd
4. Driver Script a. It Reads the Test Case files. Checks the keywords and calls the appropriate utility script functions based on specific keyword b. Error Handling is taken care of in the driver script. Utility Scripts a. Perform generic tasks that can be used across applications. It should not be application dependent

5.

ADVANTAGES
The main advantage of this framework is the low cost for maintenance. If there is change to any test case then only the Test Case File needs to be updated and the Driver Script and Startup script will remain the same. No need to update the scripts in case of changes to the application

DISADVANTAGES
Development of "customized" (Application- Specific) Functions and Utilities requires proficiency in the tools Scripting language. If application requires more than a few "customized" Utilities, this will require the tester to learn a number of "Key Words" and special formats. This can be time-consuming, and may have an initial impact on Test Plan Development. Once the testers get used to this, however, the time required to produce a test case is greatly improved.

MODULAR AUTOMATION FRAMEWORK

Dividing the large files into smaller scripts. Two types of Frameworks Test Script Modularity Framework: Enables creation of Small, Independent Scripts representing Modules & Functions of the Application under Test (AUT) Test Library Architecture Framework: Enables creation of Library Files representing Modules & Functions of the Application under Test (AUT)

HYBRID AUTOMATION FRAMEWORK

It is the Most Popularly Implemented Framework It is a Combination of the above three types of Frameworks described It has an Ability of evolving Itself Over a Passage of Time and Over Many Projects

HYBRID AUTOMATION FRAMEWORK

This hybrid test automation framework is what most frameworks evolve and multiple projects. The most successful automation frameworks generally accommodate both KeywordDriven testing as well as Data-Driven scripts. The framework utilities can make the data driven scripts more compact and less failure. The utilities can also facilitate the gradual and manageable conversion of existing scripts to keyword driven equivalents when and where that appears desirable. The framework can use scripts to perform some tasks that might be too difficult to re-implement in a pure keyword driven approach, or where the keyword driven capabilities are not yet in place.

BENEFITS OF AUTOMATION FRAMEWORK APPROACH

Significant Reduction in Testing Cycle Time Comprehensive Coverage against Requirements Use of a "Common Standard" across all the Project Teams Generation of Reusable Test Scripts ( Utility Functions) Systematic Maintenance of Automation Scripts Data Pooling

Thank You

Incessant Technologies Pvt Ltd., A3 Mariner Block, VBIT, Madhapur, Hyderabad, A.P. 500 081, INDIA.