Beruflich Dokumente
Kultur Dokumente
IVS-TRAINING
2005 Infosys Technologies Limited. All rights reserved. The information provided in this presentation is intended for
the sole use of the recipient and is for educational purposes only. No part of this presentation may be reproduced or
transmitted in any form or by any means, including photocopying and recording, without written permission. Permission
must also be obtained before any part of this presentation is stored in a retrieval system in any nature. No responsibility
can be accepted by Infosys Technologies Limited, the Editorial Board or contributors for action taken as a result of
information contained in this presentation. The views expressed in this presentation by the presenter are not necessarily
those of the Editorial Board or Infosys Technologies Limited.
Session Objectives
Project management overview
Testing lifecycle
Initiation
Execution
Test execution
Status reporting
Defect management
Closure
Test process analysis
-2-
Test metrics
Stakeholder management
Test management challenges
Test management best practices
Summary
-3-
Quality
Management
Time
Management
Team
Management
Communication
Management
Scope
Management
Risk
Management
Cost
Management
Integration
Management
Vendor/Subcontractor
Management
-4-
Testing Lifecycle
Test Process
It is a combination of different lifecycle stages of a testing project. Each
lifecycle stage is characterised by a definite Entry criteria, activities,
necessary checks, deliverables, exit criteria
Control and management of critical information can be handled by
applying different tools and techniques
At high level there are 3 Life cycle stages
In some projects initiation and execution stages can be iterative
Initiation
Execution
Closure
-5-
Initiation
Initiation
This stage includes the Requirement Analysis, Test Planning, Test case
development phases of the Software Testing Lifecycle
Activities
Understand contract, proposal, application and objective of all stakeholders
Prepare Requirement Traceability Matrix (RTM) in the initial stages to keep
track of every requirement
Deliverables (Strategy/plan, test scenarios, test cases, project plan),
commitments, estimates approved by client
Define critical success factors for the project to plan the milestones
Test data & Test environment set up
Standardize templates, checklists, process to have consistency in usage of
artifacts
Structured formal communication
Automation feasibility analysis and tool selection in case of test automation
-7-
Initiation (Contd)
Deliverables
RTM
Test Strategy / plan
Test scenarios and test cases
Configuration Management Plan
Training Plan, Quality Plan
Estimation
Automation feasibility analysis report
-8-
-10-
-13-
-14-
Release Management
Get the Sign-off from the designated stakeholder for the release
-15-
-16-
Expert speaks
Pradeep Yadlapati (GTM) says There is a lot a manager can do by
understanding the value that the project can add to the customer
-17-
Case study
For the scenario given in the file,
1. As a Test Manager, how will you approach the Test strategy / plan?
2. Prepare staffing plan
3. Decide on mile-stones and deliverables
-18-
-19-
Log New
defects
RTM
based
Test Case
Impact
Analysis
Code
fixes
Add,
Modify,
Delete test
cases &
Test data
Build next
Release
Version
Next Test
Cycle
Test Team
Dev Team
-20-
Case study
Prepare an approach to test the change in scope specified in the example
May 12th: Arjun is a Test Manager working for a Insurance client. He has a team of 3
TAs and 15 TEs. At present they are into the execution mode. The testing is
expected to be completed by 30th June.
The system has 6 modules with 2 modules (M1, M2) released for testing from the
client development team and 4 interfaces (I1, I2, I3, I4) from other vendors. On 3rd
June client decides to replace I2 with a component being developed in house.
The development is expected to be completed on 11th June. I2 interacts with I3, M1
and M2. Client wants the testing to be completed by 8th July.
-21-
-22-
Support activities
Prepare CM plan
Identification of
Configuration
Management
tool
Configuration
Management
Regular CM
audits
-24-
Track status of
configurable
items
Quality
Assurance
Test coverage
using the
Traceability
matrix
-25-
Defect
prevention
activities
Infrastructure
Set up
Software
installation or
deployment
-26-
Data security
for sensitive
data
Estimation
Test Estimation
Effective software test estimation helps track and control cost/effortoverrun
Estimation is a continuous process that should be completed at the
beginning of a project, but reviewed throughout the lifecycle
-28-
Development
Testing (Unit to
System)
Effort
20% to 30%
25% to 40%
25% to 40%
-29-
SMC method
Business requirements for each function are identified and
classified as Simple (S), Medium (M), or Complex (C)
Define the SMC criteria. Example
Test Case with less than 5 steps Simple
Test case with 5 -10 steps Medium
Test Case with more than 10 steps Complex
The average implementation effort on S/M/C can be got from the
baseline if it exists
-30-
SMC method
If a project-specific baseline does not exist, the project type,
technology are used to get the test effort from similar project
If the technology/domain is unknown, then the average testing
effort for S/M/C is derived from past experiences
General activities like Test Environment & Data Setup form input
parameters to calculate the total effort estimates
-33-
Scheduling
Scheduling
-35-
Execution
Test execution
Activities
Verification of Entry & Exit criteria to understand whether the
necessary criteria are met to start and end the project
respectively
Verification of Suspension & Resumption criteria to understand
when should testing stop and resume
Execution of test cases, test scripts and updates to test artifacts
Tracking testing progress through milestone and metrics analysis
-37-
-38-
Defect report
Status report
Test cases
Review report
Metrics report
Test log
Status reporting
Status reporting
Status report is used to update the stakeholders regarding the
Depending on the
Role of the stakeholder in the project, the status data is distributed
Complexity and need, the frequency (Weekly, Monthly) and type of
status is reported
-41-
Defect management
Defect management
Classification based on priority, the urgency at which the defect fix is
needed and on severity, the impact the defect is causing on the
application
Identifying defect life cycle. This depends on tool, but may need
customization. Movement of defect from one stage to other and who
are involved in it.
Metrics collection like defect density, defect detection rate, defect fix
rate etc
Check to see if there exists mapping between defects and failed test
cases
-44-
Closure
Closure Report
Contains detailed information regarding
Process Details
Risks
Size and Schedule
Effort
Defects
Test Metrics
Best Practices
Customer Appreciations / Complaints
To
Derive best practices
& identify areas of
improvement
Implement techniques to
narrow the gap
Changes in requirements
-49-
Risk management
What is a Risk?
A possible event or situation, potentially having either positive or
negative impact on the project.
Example Your company is the only Testing service provider for your
client. For a new service, this client requests for a proposal from you
and two of your competitors (Risk to your relationship with the client).
You do a thorough due diligence and arrive at a solution package that
impresses the customer and you get a go ahead from the customer to
carry out this project.
Risk
Opportunity
-52-
Benefit
What is a Risk?
Example You get a new service request from your client. You plan to
include fresh test engineers in to the project and prepare their training
plan. Few weeks into the project, due to lack of expertise among the
testers you start seeing problems related to test case development,
understanding of test process etc. which could potentially lead to Crisis
Risk
Problem
-53-
Crisis
Risk management
Risk Assessment
Risk management is an
iterative process of
identifying, assessing
and responding to risk
Identify risks
Proactively at the
beginning of the project
Throughout the testing
life cycle
Risk
Identification
Risk
Prioritization
Risk Control
Response
Risk
Planning
Monitoring
Assess risks
Classify them
Identify the impact on testing
Review the assessment in the light
of changing circumstances and risk
management actions
-54-
Contingency planning
The idea behind contingency planning is to reduce the impact of a risk
by creating alternatives
Assumes that the worst will occur and tries to figure out methods so
the project can continue
-55-
-57-
Case study
Identify the risks in the scenario given and prepare contingency plan
The project is about a system of Mortgages. The development PM Saroj and testing TA
Vijay are at onsite doing a system study. They are expected to complete estimation for this.
The system is to be implemented using Microsoft Visual C++ and a Sybase RDBMS. The
system would interface with an existing legacy system to maintain audit trail. The company
for which Saroj and Vijay work is a reputed solution provider.
Saroj and Vijay decide to prepare their respective estimation and then review it. End of
same day they decide to meet. When Vijay presents his estimation sheet to Saroj, she
does not agree to that. She agrees on the accuracy but her idea is, to sustain competition,
the estimation given should be less than what the competitor could have given. Saroj has
previously managed projects with such tough timelines with members in her team slogging.
She quotes comparatively very less time for testing and Vijay is completely against this.
Since she is the POC for client, she presents her case to Peter (client contact) and Peter is
very happy to note the estimation. Peter thinks 'so much work in such a short duration?
The company is anyway reputed they will deliver the goods'. Saroj's team gets the project
and Vijay has to handle testing.
-58-
-59-
Test metrics
-61-
Metrics
Adherence to
schedule
On time delivery
Meeting SLAs
Return on
Investment
(ROI)
-62-
Stakeholder management
Management
Client
Developer
Challenged TM
Tester
Customer management
Understand the customers objective of executing the project
Obtain sign off for the deliverables
Communicate regularly to
Update the status
Resolve issues
Understand any scope changes
Mode of communication could be face to face meeting, conference call,
email, video conference
Capture periodic feedback to know customer satisfaction level and work
on the areas needing improvement
-66-
Expert speaks
Kapil Saxena (GTM) says Client management plays a very
important part in the business
-67-
Test team
Test team Identification
Willingness to learn new technologies, domain and be part of
the overall testing team
Constructive attitude towards quality
Destructive creativity
Probing skills
Flexibility to adapt to frequent changes
A skeptical, yet not hostile attitude
-69-
Test team
Benefits of effective test team identification
Minimal training effort and costs
-70-
Training
Identify the skills required for short term and long term
Conduct training
Evaluate feedback
Periodically assess the relevance and benefits of training programs
through metrics
Training (Contd)
Benefits of effective training
Higher effectiveness and productivity of testing effort
Better test coverage of the requirements with Shortened cycles
-72-
-73-
Expert speaks
Rajneesh Malviya (DM) says Challenging the testing team to own
their task makes them contribute their best
-74-
-75-
Case study
Resolve the case study and prepare a communication strategy for the
given scenario
Sesha is appointed as a manager to handle a testing project with 8 testers for a
RETAIL client. Sesha has expertise in System Integration testing only. The scope
of testing in the new engagement is manual, System Integration, Usability,
compatibility and the project has two parallel tracks spanned across 3 geographic
locations. Team composition is
2 experienced testers at Australia
1 in USA
4 freshers + 1 experienced tester at offshore.
Sesha is at offshore
The client is at USA
Looking at the tough timelines, Sesha decides to help his team with execution.
Sesha needs help to devise a strategy for communication with the team and client
-76-
-77-
Development team
Diagram below shows development and testing phases in parallel
Role play
Vishal is a very good Test Engineer. He is testing a web application. The defects
logged by him are generally accepted by the development team and fixed.
-80-
-81-
Other Challenges
Prioritization of activities
-83-
Test
Scenario
Test
Case
Test Data
requirements
-85-
Complexity
Business
Criticality
Market
Priority
Risk of not
testing
Expert speaks
Indira R (GTM) says How quickly can, one scale up to meet client
expectations is an important factor in client relationship
management
-86-
Case study
Resolve the case study and prioritize the tasks
Two testers Rekha - well experienced in functional test automation and Nirmala well experienced in performance testing have been working together for 2 years
now in the same project along with their manager Nisha. Both of them are
excellent performers and have never missed the timelines.
-89-
Summary
Summary
Initiation
Thorough understanding of the contract, proposal, application,
customer, objective of the project
Deliverables, commitments, estimates, plan and strategy approved by
client
Understand the project value addition to each stakeholder
Define critical success factors for the project
Standardize templates, checklists, process
Structured formal communication
-91-
Decide if a Proof
of Concept (POC)
test is required
Effort estimation
and planning
Test
Strategy
/Plan
Decide on
entry/exit criteria
and finalize
scope
-92-
Decide on Test
Environment
Setup
Summary (Contd)
Execution
Request acknowledgement and signoff for deliverables
Regular milestone analysis and release to get intermediate feedback
and process improvement
Defect management
Closure
Identify the re-usable artifacts
Publish the best practices and lessons learnt
Provide feedback to team on their performance
-93-
Questions?
Further Reading *
PMElite
PRIDE
QIVS
* Open in the slide show to access the links
Thank You
IVS-TRAINING
Any doubts or suggestions for improvement can be
forwarded to: IVS_TRAINING@infosys.com