Brushing Up

Performance Testing
Basics
@STIG- Dec 15, 2007

Rahul Verma

Copyright © Rahul Verma

http://www.testingperspective.com/
Licensed under the Creative Commons Attribution-Noncommercial-No Derivative Works 2.5 India License. To view a copy
of this license, visit Creative Commons.

Image source: http://www.hilltopfarminc.com/images/stallions/QE_3_L.jpg

Agenda

 Performance Testing (PT) Discipline

 PT - Process at a Glance
 PT – Terminology – Workload Distribution Pattern
 PT – Terminology – Types of Performance Testing
 PT – Performance Metrics
 PT – Toolkit
 Q&A
Performance Testing (PT) Discipline
 Good Old Bad Days for PT
 PT Gurus
 PT as a focused profession
 Beyond PT – Performance Engineering
 From Reactive to Proactive Performance Engineering
 Performance Engineer – A Business Analyst, System Engineer,
Test Planner, Usability Engineer, Test Designer, Functional
Tester and Programmer
PT - Process at a Glance

This image is taken from Scott Barber’s PerfTestPlus site: www.perftestplus.com. He is one of the PT gurus.
PT – Terminology –
Workload Distribution Pattern
 Identification of the usage pattern of the application in production
 If not in production, is based on business projections
 Transaction Mix
 User Mix
 User Think Time
 Ramp-up Pattern
 Type (s) of Testing to be employed
 Introduction to Web Usage Signature (WUS), UCML
PT – Terminology –
Workload Distribution Pattern
Identification of the usage pattern of the application in production
If not in production, is based on business projections
Transaction Mix
User Mix
User Think Time
Ramp-up Pattern
Type (s) of Testing to be employed
Introduction to Web Usage Signature (WUS), UCML

Hack
Search

Buy
PT – Terminology –
Workload Distribution Pattern
Identification of the usage pattern of the application in production
If not in production, is based on business projections
Transaction Mix
User Mix
User Think Time
Ramp-up Pattern
Type (s) of Testing to be employed
Introduction to Web Usage Signature (WUS), UCML

Normal
Admin

Power
PT – Terminology –
Workload Distribution Pattern
Identification of the usage pattern of the application in production
If not in production, is based on business projections
Transaction Mix
User Mix
User Think Time
Ramp-up Pattern
Type (s) of Testing to be employed
Introduction to Web Usage Signature (WUS), UCML

function
5 sec

random
 PT – Terminology –
Workload Distribution Pattern
Identification of the usage pattern of the application in production
If not in production, is based on business projections
Transaction Mix
User Mix
User Think Time
Ramp-up Pattern
Type (s) of Testing to be employed
Introduction to Web Usage Signature (WUS), UCML

User Load

Time
PT – Terminology –
Workload Distribution Pattern
Identification of the usage pattern of the application in production
If not in production, is based on business projections
Transaction Mix
User Mix
User Think Time Do I look
Ramp-up Pattern like a
Type (s) of Testing to be employed signature
Introduction to Web Usage Signature (WUS), UCML ?

User1 User1 User1 Usern

PT – Terminology –
Types of Performance Testing
 Performance Validation, Performance Testing and Performance
Engineering/Tuning
 Reactive and Proactive Performance Engineering
 Load Vs Stress Testing
 Goal based Performance Testing
 Type (s) of Testing to be employed
 Other Terms - Soak Testing / Endurance Testing, Spike Testing,
Scalability Vs Stability Testing, Application Speed Vs Application
Scalability, Scaling Up Vs Scaling Out
PT – Terminology –
Types of Performance Testing
Performance Validation, Performance Testing and Performance
Engineering/Tuning
Reactive and Proactive Performance Engineering
Load Vs Stress Testing
Goal based Performance Testing
Other Terms - Soak Testing / Endurance Testing, Spike Testing,
Scalability Vs Stability Testing, Application Speed Vs Application
Scalability, Scaling Up Vs Scaling Out

Report Report
PT – Terminology –
Types of Performance Testing
Performance Validation, Performance Testing and Performance
Engineering/Tuning
Reactive and Proactive Performance Engineering
Load Vs Stress Testing
Goal based Performance Testing
Other Terms - Soak Testing / Endurance Testing, Spike Testing,
Scalability Vs Stability Testing, Application Speed Vs Application
Scalability, Scaling Up Vs Scaling Out

Web Server (s)

App Server (s)

DB
PT – Terminology –
Types of Performance Testing
Performance Validation, Performance Testing and Performance
Engineering/Tuning
Reactive and Proactive Performance Engineering
Load Vs Stress Testing
Goal based Performance Testing
Other Terms - Soak Testing / Endurance Testing, Spike Testing,
Scalability Vs Stability Testing, Application Speed Vs Application
Scalability, Scaling Up Vs Scaling Out
PT – Terminology –
Types of Performance Testing
Performance Validation, Performance Testing and Performance
Engineering/Tuning
Reactive and Proactive Performance Engineering
Load Vs Stress Testing
Goal based Performance Testing
Other Terms - Soak Testing / Endurance Testing, Spike Testing,
Scalability Vs Stability Testing, Application Speed Vs Application
Scalability, Scaling Up Vs Scaling Out
PT – Terminology –
Types of Performance Testing
Performance Validation, Performance Testing and Performance
Engineering/Tuning
Reactive and Proactive Performance Engineering
Load Vs Stress Testing
Goal based Performance Testing
Other Terms - Soak Testing / Endurance Testing, Spike Testing,
Scalability Vs Stability Testing, Application Speed Vs Application
Scalability, Scaling Up Vs Scaling Out
PT – Performance Metrics
 Client-side V/s Server-side Performance Metrics
 Server-side Metrics – Application level and OS level
 Client side – Response Time, Pass Fail Statistics, Throughput,
Hits/sec, Customized Functionality Validation Counters, User
Abandonment
 Server-side – OS – CPU, Memory, Network and Disk I/O
 Server-side – Performance related metrics and observations for
Web Server (s), Application Server (s) and/or Database Server
(s)
PT – Toolkit
 Performance Testing Tools – LoadRunner, SilkPerformer,
WebLoad, JMeter, QALoad etc.
 Sniffers – Ethereal, HttpWatch, IEWatch
 Programming Knowledge – C, Java, JavaScript, Quick Learning
Capacity for Vendor-specific scripts
 Knowledge of commonly used protocols
 PerfMon, Shell Scripting, Perl, Python
 MS Office, EditPlus/UltraEdit, Putty, WinSCP
 Need for PSEs – Operating Systems in discussion, Web Servers,
Application Servers, Database Servers
“I hear and I forget. I see and I remember . I do and I understand” - Confucious

rahul.verma81@gmail.com

Copyright © Rahul Verma

http://www.testingperspective.com/
Licensed under the Creative Commons Attribution-Noncommercial-No Derivative Works 2.5 India License. To view a copy
of this license, visit Creative Commons.