Beruflich Dokumente
Kultur Dokumente
Effective
Performance Testing
Strategy
Ross Collard
Collard & Company
• The bad:
1.3 Assess
1.1 Understand 1.2 Understand
the
the Business the Technical
Current
Context Context
Status
Warehouse
Senior Group
Management
Group 50 PCs
25 PCs
IT
Data Group
Services Remote
25 PCs
Satellite
Office
Database 10 PCs
Fax and
Email Internet
Services
Domain Proxy
Name Services
Services
Web
Services
Staging Web
Services Database
Copyright 2005 Collard & Co. 16
System Architecture
2B. Back End Functional View
Voice
Services
Print
Services
External
Voice Application
Lines Services
Printers
Wireless
Services Data
LAN
Services
Network
Services
Wireless
Devices
LAN
Database
1.9 Perform
1.7 Understand 1.8 Specify
the Initial
Likely Patterns Performance
Impact
Of Use Requirements
Assessment
2.3 Decide
2.1 Decide on 2.2 Select the Where to
Baselines and Methods of Observe
Benchmarks Testing and What
to Monitor
2.6 Balance
2.4 Determine 2.5 Calculate
Structured vs.
the Test Focus the Test
Exploratory
(Risk Assessment) Work Loads
Testing
2.12 Conduct
2.10 Plan how 2.11 Plan
Trial Runs
to Analyze Follow-up
as Data
and Interpret Actions, such
Becomes
Test Results as Tuning
Available
2.15 Coordinate
2.13 Estimate 2.14 Decide
Performance
the Test Whether to
Testing with
Cycles and Outsource
Concurrent
Overheads the Test
Activities
2.16 Coordinate
2.17 Develop
with the
the
Post-Delivery
Migration
Plans for Live
Strategy
Monitoring
A. Automate the
Performance Test
Test Environment
Management
(See Diagram C)
Complexity
Analyzer
Automated
Test Planner
Test Case
Generator
Performance/
Test Case/ Load Test
Data Library Driver
Test DB
Loader
Test Case
Version
Control
Copyright 2005 Collard & Co. 55
Test Automation Framework
Diagram C: Test Environment Management
S.U.T.
Version S.U.T.
Control Tool Prototype/
Simulator
Interface Simulators
S.U.T. To/From Other
Build and Related Systems
Load Tool
System
Test Input Interfaces Under Test Output Interfaces
Test
S.U.T. S.U.T.
Data Base Diagnostic
Integrity Platform Tool
Management Management
Tools
- Configurator
- Configuration Manager
-Platform Simulator
- Platform Diagnosis and Control
Copyright 2005 Collard & Co. 56
Test Automation Framework
Performance Operational
Diagram D: Back End Tools
Measurement Profile
Tool Builder
(Debugging
Test Problem and Fixing,
Coverage
Results Reports System Tuning,
Analyzer
Log DB Enhancements)
Enhancements
Coverage Change
Analyzer Management
Tool
B. Develop the
Test Scenarios
C. Set Up the
Performance Test Lab
4.4 Consolidate
4.5 Review
the
the Integrated
Performance
Test Strategy
Test Plans