Turning Ideas Into Reality

InterraIT Testing & Quality Assurance Services (iTQAS)

Interra Information Technology, Inc 25 Metro Dr., Ste 550, San Jose, CA 95110 Tel +1 408 451 1700 Fax +1 408 441 7495 www.InterraIT.com

Business Transformation - Innovative Technology Solution

The material contained in this document is Confidential and Proprietary to InterraIT.

iTQAS: InterraIT Testing & Quality Assurance Services

Testing Center of Excellence (TCoE) Subject matter experts Latest versions of software Develop solution frameworks Dashboard Development & Tracking Center of Excellence Infrastructure Test Labs Virtual Test Labs ( Device Anywhere ) Robust IP protection mechanisms Information security framework Infrastructure

iTQAS
Team Methodology Methodology Cross Application Testing Product QA & Testing Risk based Testing QA & Testing Tools Expertise Test Suite Management: Test Link, Quality Center, Rational Quality Manager Test Lab Virtualization: VMWare Memory Profiling Tools: JProfiler, OptimizeIT, JConsole, YourKit Defect Tracking: JIRA, ClearQuest, Remedy, BugZilla, Rational Team Concert Unit Testing & Code Coverage: JUnit/ HTTPUnit, NUnit, Eclipse, Clover Cloud Provisioning: Amazon EC2 Cloud Management: Hyperic, Right Scale Tools Testing Tools: QTP, Silk Test, RIA Test, Watir, Selenium, RTC, HTTP Analyzer, Firebug, HTTP Fox, Robotium Perl/ Java based Frameworks Load Testing: Jmeter, Neoload, TeamSuite Critical Mass of Resources Knowledge sharing Resource flexibility Access to in-depth expertise Package Training / Certification

InterraIT Confidential

Challenges in Mobile Application Testing

Diversity of device environment Hardware and network related challenges Network Latency

Resource intensive transactions Utilize corporate computing environment Integration with Existing systems Maintaining Security

400+ mobile network operators with different types of networks ( CDMA/GSM/Wi-Fi) Network Latency

Mobile Business Applications

Enterprise Application

Networking & Device Environment

Mobile computing ecosystem consists of various OEMs with open standards, different application runtime Difference in screen sizes & resolution , rendering of images

Limited memory size & processing power Network landscape often act as data optimizers & restrict flow of information High Cost involved in buying multiple devices

Diversity in Device Behaviour

Hardware Configuration & Networking

InterraIT Confidential

Testing Strategy

InterraIT Confidential

Testing carried out at InterraIT

Type of Testing

Manual Testing Devices Emulators

Automated Testing

Unit Testing Integration Testing

System Testing Regression Testing Compatibility Testing GUI Testing Performance Testing

Yes Yes
Yes Yes Yes Yes Yes

Yes Yes
No No No No No

No No
No Yes Yes No Yes

Security Testing
Synchronization Testing

Yes
Yes

No
No

Yes
No

InterraIT Confidential

Mobile Testing Manual and Automation

Testing of Mobile Application is traditionally done by manual execution of test cases and visual verification of results. But it is an effort intensive and time consuming process. Automating the appropriate areas of a testing program can yield quantifiable results. Emulators are beneficial for testing the features which are device independent, however the actual devices should be used for validating the results. Due to diversity in mobile hardware and platforms GUI and compatibility testing to be done along with functional testing

InterraIT Confidential

Testing Activities Manual & Automation

Manual

Automated Develop the framework to develop Automation suite Creation of Test Plan and Test Strategy

Define objectives
Creation of Test Plan and Test Strategy

Creation of Test Cases

Execution of Test Cases Reporting Defects Creation of Test Reports and Defect Reports

Develop high impact test cases based on scores

Use high level scripting functions which are not dependent on menu structure of the device Carried out using emulators & performance Testing tools using PC Reporting Defects Creation of Test Reports and Defect Reports

InterraIT Confidential

InterraIT - Test Automation Architecture

Application Under Test

Business Functions

GUI Interface

Define Test Case

Database

Non-GUI Interface

Review & Approval

Test Data
Pull Test Data Database .CSV Spread sheet

Automated Script Recording Script Script Enhancement

Change & Configuration Management

Execution

Test Management
Report Status

Defect Management
Report defect

InterraIT Confidential

NANT Automated Test Process for Windows

Automated Test Bed Setup

Scheduler

Automated HTML Reports with screenshots of Errors Email .. ..

Application Under Test

SVN

NANT

Test Test Scripts Test Test Scripts Test Scripts Scripts . . .. . .. .. Test Test Scripts Test Scripts Scripts . . .. . .. ..

Release Candidate

InterraIT Confidential

Successful Mobile Engagements

InterraIT Confidential

10

Field Service Mobility - Dell

Customer Background
Project Vision is to provide a web and mobile accessible application that will allow the field technicians/engineers quick access to tools while on-site with customers. It supports empowering the field technicians/engineers to resolve customer issues that drive repeat dispatch (RD) tails. It also supports positively impacting customer resolution time and customer experience (CE).

Testing Expertise
Automation using Scripts Used Java and Eclipse framework for automation with Ant scripts( Android) Used C# , Nunit with Nant Scripts for Windows 7 Importing Robotium wrappers for testing interactivity interactions. Complete application flow was tested using UI controls Android testing was carried out on multiple devices ( 6-7) covering OS 1.6 to 2.3 It was tried out on 2 major operators in India & 3 in US.

InterraITs Services
Black Box Testing

Tools Used
Automation Tools
Robotium ( Android)
Junit Jmeter for performance testing on server

UAT Testing
Functional Testing Logs Testing.

Performance Testing
Server Side Performance Testing Client Side Performance Testing
InterraIT Confidential

Defect Tracking
Bugzilla

11

MyMazda Garage - Mazda

Customer Background
InterraIT adds value to My Mazda project by developing a native iphone application that enables MNAO customers to access Service History ,Maintenance Schedule, Locate a Dealer, Find my car ,Service Offers and Service Reminders .

Testing Expertise
Manual Testing: 1. UI & content, Testing 2. Functional Testing
Device Anywhere for testing and monitoring the usability, performance and availability of the app.

Tested across 2major operators in India and 2in US. Tested across multiple handsets iPhone 3G,3GS and 4G

InterraITs Services
Black Box Testing

Tools Used
Automation Tools
JMeter for Server side Load Testing
SenTestingframework for Unit testing

UAT Testing
Functional Testing UI & Content Testing

Performance Testing
Server Side Performance Testing Load Testing
InterraIT Confidential

Defect Tracking
Bugzilla

12

MyMazda Sales iPad - Mazda

Customer Background
InterraIT adds value to Mazda Sales I Pad application by developing a web based I Pad application that enables MNAO Sales consultants and dealers to get video and textual information during the various steps of the Sales process.

Testing Expertise
Manual Testing: 1. UI & content, Testing

Tested across 2 operators in US and 2 in India Tested on Ipad1 & Ipad2 devices

InterraITs Services
Black Box Testing
UAT Testing UI & Content Testing

Tools Used

Tools
iPhone SDK 3.1.3 XCode 3.2.4

Defect Tracking
Bugzilla

InterraIT Confidential

13

Market Street - USM

Customer Background
Market Street lets you build, save and alter any number of grocery list on your iPhone. Application will also populate the weekly special offers for Shopping Stores products if applicable. Based on your requirement you can add items and quantity you want, in your shopping cart. At any point of time you can also find out your current location & near by Shopping Stores location at Google map. Application will also give privilege to browse multiple recipes, based on different level of categories. Marking recipes into Favorite Recipes List is also permitted.

Testing Expertise
SenTestingframework Automation from Instruments native application

InterraITs Services
Black Box Testing UAT Testing Functional Testing Regression Testing. Client side Performance Testing Leaks Activity Monitor Time Profile Network Connections
InterraIT Confidential

Tools Used

Tools
iPhone SDK 3.1.3 XCode 3.2.4

Defect Tracking
BugZilla

14

GPS Navigation Application - TCS (Telecommunication Systems)

Customer Background
TCS (Formerly known as Networks In Motion, Inc. (NIM)) is a product base company. Atlasbook is

base product of TCS. Atlasbook is a GPS based Navigation application with different features. The activities include feature development on BREW, porting, bug fixing for different mobile and R&D as per the product and mobiles

Testing Expertise
Bugzilla is used for bug tracking & Perforce is used for the tracking of code check- ins. For code review there is a specific owner from developer team to approve the code. Car drive testing is done for testing the navigational feature Testing out on different BREW devices from Samsung, ZTE, LG , Pantec and Casio etc. Tested across more than 5 operators in US (Verizon, AT&T, US Cellular, MetroPCS, Cricket etc.)

InterraITs Services
Black Box Testing UAT Testing Functional Testing Logs Testing.

Tools Used
For Non GPS testing Hopman Box is used to test various scenarios and behavior of app. Logging tool ( QALOG) which is responsible to log all the information in encoded format which can be decoded on the server for analysis purpose. Defect Tracking Bugzilla

InterraIT Confidential

15

Successful Enterprise Engagements

InterraIT Confidential

16

InterraIT QA & Test Automation Role

InterraIT Service Offerings
Databases

On-demand Applications
XML / Web Services

Flat-files (FTP, HTTP, E-mail) Custom Applications

Physical Appliance, Virtual Appliance, Cloud Testing QA strategy document for every major release Test Plan from functional specifications Test cases from Test Plan identified positive, negative and boundary
conditions BFAT Build Functional Acceptance Testing Use of RTC, JIRA for bug tracking & QC/ RQM/ Testlink for test case repository Value added quality processes bug tracking, classification blocker, priority, severity Analysis of need for test Automation Components Studio, Connectors, Platform, WMC Different automation techniques Use of RTC, QTP, Perl, RIA Test Development of a QA data warehouse for defect analysis Comparison and consultancy on Automation Tools Escape Analysis Lab Virtualization (use of VMWare) State of the art test labs

B2B (EDI, XML, Excel)

ERP/CRM

Middleware

Tools Used
Quality Center, Testlink QTP, RIA Test, Perl Harness JIRA, Confluence VMWare Code Coverage on Clover Code Profiling: Jprofiler, GDB, TotalView (C++)

Achievements & Clients Benefits

High Customer satisfaction and quality of support Lower costs due to higher productivity of quality resources Participating in version upgrades
InterraIT Confidential

17

Cloud Based Application Testing Experience

Expertise on Cloud
Leveraging our expertise in integration space to test integration solutions on Amazons EC2 cloud On Premise & Cloud Integration
Testing SAAS Applications on Cloud. Leveraging various cloud features such as Multi Tenancy, Multi Environment to test real customer scenarios Session Management

Security Testing using Key Authentication

Tools Used
Hyperic
Right Scale

Leveraging Secure Agent to connect to the servers behind the firewall Server Management for Cloud Instances using Hyperic

Achievements & Clients Benefits

Lower cost of ownership Reduced infrastructure management responsibility Service delivered through a browser Faster application rollout
InterraIT Confidential

18

Partner Tools QA & Test Automation - VMware

Project Background

Workbench VMware ships workbench (a Desktop Development Environment ) as

a Virtual Appliance in the Linux environment to its partners. The partners use the workbench as tool for running their Hardware Certification Test Cases. Workbench is build on Eclipse platform using Java SWT.

Hardware

Compatibility Guide Web HCL is a portal used by the VMware partners to verify if their Hardware Products are compatible with the VMware products. The portal is re-engineered to meet Web 2.0 standards and it uses LAMP technology to overcome the usability and performance issues of the existing portal.

InterraITs QA Services
White Box Testing Automated JUnit test cases of the new features

Tools Used
Automation Tools
Window Tester Pro for White Box Testing Silk Test 2009 for Functional Testing JMeter for Performance Testing

Build Acceptance Testing

Black Box Testing Integration Testing

Functional Testing of New Features

UI Driven End to End Use Case Scenarios Performance Testing Server Side Performance Testing Client Side Performance Testing

Test Case Management , Defect Management & Configuration Management Tools

TCRMS

Bugzilla
Perforce

InterraIT Confidential

19

QA Services for content Delivery - Knewco

Customer Background
InterraIT adds value to Knewco by automating the content discovery, phrase extraction and Definition retrieval from their websites. It helps them to build an automation strategy and manually test the rest of the chunks on their web application

Testing Expertise
Automation using Selenium: Used Java and Eclipse framework for automation with Selenium Injecting the java script code to Selenium code Crawling URLs against each website & Listing concepts from each URLs Fetching concept Definitions and checking any disambiguation Manual Testing: UI & content, Testing Bubble & ads Testing

InterraITs Services
Black Box Testing
UAT Testing Functional Testing

Tools Used

Automation Tools
JMeter for Server side Performance Testing Selenium for Functional Testing of URLs Crawling and concept handling HTTP Analyzer for Client side performance testing on IE Firebug and HTTP Fox for Mozilla, Safari and Chrome browsers

Logs Testing.
Multi Browser Testing Performance Testing

Server Side Performance Testing

Client Side Performance Testing

Defect Tracking
Bugzilla

InterraIT Confidential

20

QA Services for Online Marketing Company - Vertrue

InterraIT Service Offerings
Project Release Cycle Management Manual Testing: Migration Testing System Testing Regression Testing Tickets Resolution Test Automation Design Automation Framework Automation Scripts Creation and Execution Automation Execution Metrics Test Reporting and Analysis

Tools Used
Quick Test Pro Quality Center Clarity

Achievements & Clients Benefits

Client leveraged InterraITs strong expertise in AS400 and QTP automation Migration from .Net 1.1 to .Net 4.0 tested successfully Salesforce Test Automation using HP QTP-QC

InterraIT Confidential

21

IBM Cast Iron - InterraIT Engineering Relationship

Cloud
2009 2010 5.X and 6.x Testing Automation Generic projects Hyperic, RightScale

3.x to 5.x version support

Virtual Appliance
2008

Management API Harness

InterraIT team conducted Training Key Partner on 4.x Product Support Knowledgebase QA Automation expansion; CLI Automation initiated
2007

Hardware Appliance based Integration

2006

Connector & WMC development, testing on RIA Test Offshore Consulting work initiated

InterraIT team expanded to include Professional Services engagement

Perl RT Harness expanded Install / Upgrade & QTP Automation initiated

InterraIT became an integral part of 3.x product line with support on 2.x
2005

QA Automation kicked off with Perl Harness May 2004 - Cast Iron & InterraIT relationship established with 2.x product version
2004

July 2004 ODC established in India with strong team on Integration skills Team started with Testing / QA followed by development and Customer Support

InterraIT Confidential

22

Turning Ideas Into Reality

Thank You

Interra Information Technology, Inc

25 Metro Dr., Ste 550 San Jose, CA 95110 Tel +1 408 451 1700 Fax +1 408 441 7495 sales@interrait.com www.interrait.com

Business Transformation - Innovative Technology Solution

The material contained in this document is Confidential and Proprietary to InterraIT.

Testing Methodology for Mobile Applications

InterraIT Confidential

24