Beruflich Dokumente
Kultur Dokumente
Copyright 2007
Quality Engineering Defined
• A systematic approach in delivering a product of
sound quality
Quality Paradigm
Performance &
Automation
Simulation
Presentation
Overview
Copyright 2007
Quality Engineering Drivers
Standards
• Company Standards
• Quality Methodology
Quality Output
Tools • Approved Test Plans
Outputs
Inputs
Copyright 2007
Quality Engineering … Cont’d
Copyright 2007
What is a WSDL?
• Stands for Web Service Definition Language
• Describes the Webservice and its associated methods
• Defines the data elements/types (XML Request)
• Defines the data elements/types (XML Response)
• Defines the Operation or the “Web Method”
• 1-way operation (i.e. Get Data)
• 2-way operation (i.e. Request for service with Response)
• Defines Service Bindings
• How to access the services
• Port
• Network Address
Copyright 2007
SOA Architecture
Service Client Integration Tier Service Provider
3 XMlL
Request
4
XML
Response
WSDL Location
Copyright 2007
Web Service Test Example
• M2K airlines is a new subsidiary of World Airlines and would
like to book their existing customer base on WA flights as
well
• M2K does not want to migrate their existing platform or use
World Airline’s User Interface to leverage WA’s booking
process
• World Airlines to revamp current workflow into a suite of
Booking Webservices for present and future considerations
• QuoteFlight
• BookFlight
• QueryFlightReservation
• DeleteFlightReservation
• EditFlightReservation
Copyright 2007
Webservice Architecture
DB
Legacy Screen
Copyright 2007
Testing Techniques
• Derive your test cases from existing test conditions
• Break out the testing into Phases (End to End last)
• Isolate each web method and test manually
• Test Error Conditions thoroughly
• Understand the behavior of your Web Application
• Application Level
• Database Level (Fields and Table Structure)
• Data Level
• Understand the “Web Method” Elements and associated
relation to above
• Understand your End-Users input at the Integration Layer
Copyright 2007
Controlling the Test (Isolate)
Booking WS
QuoteFlight
XML XML
Request BookFlight
Response
Invoke QueryRSVP
Dummy Client
XML
Request Response DeleteRSVP
XML EditRSVP
Response
DB
External Test Data Action DB
http://WebServices/Genoa/bookingflightService.asmx?wsdl
Copyright 2007
Test Integration (End-End Beta)
QuoteFlight
XML
BookFlight
Response
Invoke QueryRSVP
Dummy
Client App XML
DeleteRSVP
Requests
Client Response
EditRSVP
XML
Responses
DB
Real Test Data Action DB
Copyright 2007
Use raw XML to invoke WS
Copyright 2007
External Data Source
Copyright 2007
Chaining Operations
Copyright 2007
Batch Processing
Copyright 2007
Detailed
Reporting
Copyright 2007
Performance Testing
Copyright 2007
Why Performance Test?
• Applications are getting more Web “Rich”
• Flash
• AJAX Rich Text
• Applications are getting loaded
• Response times need to be in line with user
expectations
• Know when you are failing SLA (Service Level
Agreement)
• Validate that Hardware meets consumer
growth
Copyright 2007
Why Performance Test? Cont’d …
• Find your breaking point
• Anticipate peak seasons (understand your
business)
• Isolate “slow performers”
• Server CPU %
• Server Response times
• DB stored procedures
• Fine tune your application’s performance
• Baseline your system’s current performance
Copyright 2007
Performance Testing Tips
• Understand current user usage and future
trend
• Isolate business processes that are user-
heavy
• Test important paths
• Anticipate fast users vs. slow users
• Some users are more tolerant then others
• Anticipate traffic patterns (inconsistent)
• Validate server condition on simulated fail
over Copyright 2007
Testing Tool Evaluation
• Ease of use (training time)
• Select the right number of virtual users
• Web service testing included
• Handles the latest web enhancements
• 3rd party navigation menus
• AJAX/Rich Text
• Push to the “workhorse” - Distributing the
load
• Load scheduling (understand you SLAs)
Copyright 2007
The End
email: derekw@oceanwide.com
Copyright 2007