Beruflich Dokumente
Kultur Dokumente
Corporation. All other names are used for identification purposes only
and may be trademarks of their respective owners.
Empirix, Inc.
Contents
Contents
Preface
vii
Introduction
About e-Tester..................................................................................................2
e-Tester Feature Highlights .....................................................................2
About e-Manager.............................................................................................4
e-Manager Feature Highlights ................................................................5
About e-Load ...................................................................................................6
e-Load Feature Highlights.......................................................................7
About e-Monitor..............................................................................................8
e-Monitor Feature Highlights .................................................................9
About e-Reporter............................................................................................10
e-Reporter Feature Highlights ...............................................................10
About ServerStats...........................................................................................11
ServerStats Feature Highlights...............................................................11
System Requirements .....................................................................................12
iii
Chapter 2
13
iv
Contents
Chapter 3
e-Tester Tutorial
33
e-Manager Tutorial
81
e-Monitor Tutorial
93
ServerStats Tutorial
107
Chapter 7
e-Load Tutorial
117
vi
Preface
Preface
Welcome to Getting Started with e-TEST suite. This guide explains how to
get started using the features and options of e-Tester, e-Manager,
e-Monitor, e-Load, ServerStats, and e-Reporter for testing Web pages or
applications.
This guide is for Web test engineers who will be using the e-TEST suite
applications for regression testing, performance testing (load and
scalability), and monitoring of a Web site or application.
The tutorials in this guide assume an understanding of software or Web
application testing concepts. Test engineers using the e-TEST suite
should be familiar with the concepts of regression testing, load testing,
scalability testing, and operational monitoring.
explanations for building regression test scripts for testing Web pages or
applications with e-Tester. The tutorial includes examples that highlight
the Visual Script features, the Data Bank Wizard, test cases, and custom
tests using Visual Basic for Applications (VBA).
Chapter 4 ee-Monitor Tutorial: provides step-by-step instructions for
vii
Related Documentation
The e-TEST suite includes a complete set of printed manuals, electronic
manuals, and online help.
Preface
e-Manager User Guide explains how to use the features and options of
e-Manager to schedule and play back multiple Visual Scripts for
regression testing of Web sites or applications. e-Manager uses the Visual
Scripts developed by e-Tester.
e-Monitor User Guide explains how to use the features and options of
e-Monitor to perform periodic or continuous monitoring of Web sites
and related servers. e-Monitor uses the Visual Scripts developed by
e-Tester.
e-Load User Guide explains how to use the features and options of
e-Load to simulate multiple users accessing a Web site or application for
performance and scalability testing. e-Load uses the Visual Scripts
developed by e-Tester.
ServerStats User Guide explains how to use the features and options of
ServerStats to monitor operational performance of a variety of application
servers, Web servers, database servers and systems.
e-Reporter User Guide explains how to use the features and options of
e-Reporter and WebReporter to generate graphs and reports for e-Load,
e-Monitor, and ServerStats performance data.
ix
Electronic Documentation
The e-TEST suite download from our Web site automatically installs an
Adobe Portable Document Format (PDF) version of the Getting Started
with e-TEST suite manual and an e-Spider Tutorial. These documents
require the Adobe Acrobat Reader, version 4.x, to open and view the
.PDF files. You can download the free Acrobat Reader from the Adobe
Web site: http://www.adobe.com/products/acrobat/readstep2.html.
The Getting Started with e-TEST suite PDF file is an option on the
e-TEST suite Start menu. The e-Spider Tutorial PDF file is copied to the
e-TEST suite installation directory (C:\Empirix\eTEST is the default).
The installation also includes a readme.doc file that contains release notes
and the latest updates to the product documentation. The readme.doc file
opens in Microsoft Wordpad when you select the Release Notes option
on the e-TEST suite Start menu. Also included is an e-Monitor v5.0 to
v5.1 conversion documentation (Wm50-51Conv.pdf) file that explains how
to migrate existing 5.0 Shell Scripts to 5.1 jobs and schedules.
The full e-TEST suite documentation set is provided on the product CDROM in Adobe Portable Document Format (PDF). You can use the
Acrobat Reader, version 4.x, to view, search, and print the documentation
set. The e-TEST suite CD-ROM includes the Acrobat Reader application.
You can install Acrobat Reader using the e-TEST suite CD-ROM setup
program or by selecting ar40eng.exe in the Acrobat Reader directory. See
the Adobe Web site, http://www.adobe.com, for additional information
about Acrobat Reader.
The full documentation set includes the following files:
E e-Test Suite Getting Started.pdf
E e-Tester User Guide.pdf
E e-Tester for WAP User Guide.pdf
E e-Manager User Guide.pdf
E e-Monitor User Guide.pdf
E e-Load User Guide.pdf
All of the .PDF files are in the Documentation directory of the product
CD-ROM. The e-Test Suite Getting Started.pdf, e-Spider Tutorial.pdf,
WM50-51Conv.pdf, and readme.doc files are installed during the e-TEST
x
Preface
suite setup procedure. You can copy the user guide .PDF files to a local
drive or open them in Acrobat Reader from the CD-ROM.
If you downloaded the product from the our Web site and wish to receive
electronic versions of the User Guides in .PDF format, please send an
email message to webtest_support@empirix.com. Youll need the Acrobat
Reader v4 to open and view the documents.
The e-TEST suite CD-ROM also includes the Microsoft Visual Basic
Scripting Edition (VBScript) Language Reference documentation. You
can install the files using the e-TEST suite CD-ROM setup program or by
selecting vbsdoc.exe in the MS VB Script Documentation directory.
Using Help
e-Tester provides a comprehensive on-line help system. The help topics
include step-by-step how to instructions for common tasks and a
complete reference.
You can press the F1 key at any open dialog box for an explanation of the
options. You can select Help Contents to open the on-line help contents
and index.
Conventions
This guide uses the following typographical conventions to identify
specific items:
Convention
Description
Sans Serif
Fixed-Pitch type
Program code.
xi
Fax.
Key Requests: To request a software license key, please call (781) 9938500 or send your request via email to keys@empirix.com.
xii
Introduction
Chapter 1
Introduction
The e-TEST suite is an easy-to-use, seamlessly integrated test solution
optimized for Web applications. e-TEST suite includes e-Tester for
functional/regression testing, e-Load for load/scalability testing, and
e-Monitor for 7x24 quality monitoring of deployed applications. The
following illustration shows how each of the products in the e-TEST suite
fits into the development, testing, and deployment stages:
All three tools are powered by a common set of Visual Scripts and require
no programming. There are no proprietary languages to learn, no special
proxies to set up, no training classes required. As your application
changes, any differences in your tests are highlighted in the Visual Scripts,
and can be automatically updated in-place. That means that your
regression, load, and monitoring tests will always stay synchronized with
your application, and you can make automated testing a routine part of
your Web development process.
This manual introduces you to the e-TEST suite and provides step-bystep tutorials to help you get started using the tools.
About e-Tester
e-Tester is used for functional/regression testing and serves as the script
recorder for the entire e-TEST suite. e-Tester records all of the objects on
every page that you visit and automatically inserts tests to validate the
objects. The components of each page are represented graphically in the
Visual Script and can be masked or augmented using simple point and
click actions.
Visual Scripts Show
Page Objects in a
Tree Hierarchy
e-Tester lets you easily create, maintain, and execute regression testing
scripts for your Web applications. e-Tester features a powerful, intuitive
visual script, an automated test case generator, a specialized text matching
component, and the ability to execute data-driven tests using the Data
Bank Wizard.
and test your entire application in minutes with reusable, objectoriented Visual Scripts. Recorded Visual Scripts automatically capture
and test Anchors, Elements, Forms, Frames, HTML, Images, Image
Maps, Links, ActiveX controls, Java Applets, VBScript, and
JavaScript. Visual Scripts require no programming.
Introduction
E Graphical Test Results and Simple Script Updating test failures and
single Visual Script can be used over and over with varying input and
response data using values from an external data source.
E Visual Test Case Insertion additional test cases can be added to Visual
Scripts to verify server response times, form elements, and the presence
or absence of specific text in a page.
certificates.
verifies all referenced Web resources that include links and images.
E Test Case Librarian allows you to create and store re-useable test cases
About e-Manager
e-Manager is a test management tool that lets you group and run multiple
e-Tester Visual Scripts in sequence as a single job. e-Manager jobs can be
scheduled to run automatically at specific times or be run manually at any
time.
Multiple Visual Scripts
Can be Played Back
Immediately or at a
Scheduled Time
Introduction
and times.
e-Manager Wizard guides you through creating jobs with Visual Scripts
back Visual Scripts. The HTML viewer shows page content and provides
visual indications of pages with failures.
Job Notification Messages specify customized error notification
HTML Format Job Results Reports playback results reports are saved to
About e-Load
e-Load provides an easy and accurate way to test the scalability of your
e-Business applications. e-Load emulates thousands of virtual users
accessing your site simultaneously, and measures the effect of the load on
application performance.
e-Load Emulates Multiple
Virtual Users and
User Profiles
e-TEST suite TrueLoad Technology ensures that your tests will closely
correlate with real user-load so you can confidently use e-Loads results to
help make key decisions about your systems architecture, tuning, and
hosting alternatives.
Hit 1...Response 1
Hit 2...Response 2
Hit 3...Response 3
3 Hits/Unit time
Hit 2...Response 2
Hit 3...Response 3
Time
Introduction
requests and automatically validates server responses for test results that
closely correlate with real user testing.
E Reusable Scripts uses the same Visual Scripts created for functional
E Interactive WhatWhat-If Analysis and Virtual User Display you can change
the number and type of user on-the-fly to try what-if scenarios as you
vary the loading conditions or application settings. You can even view
the actual pages seen by virtual users to aid in debugging.
E RealReal-Time Graphs and Reports you can view real-time reports and
graphs that include response time, error rates, number of users, and
statistics such as hits per second, pages per second, etc.
scenarios by simply pointing and clicking on the names of the prerecorded Visual Scripts and then specifying how many virtual users of
each type you wish to run, and how you would like them to ramp up.
About e-Monitor
e-Monitor monitors your application around the clock after it is released
to production to ensure that it remains fully functional and continues to
perform adequately under real user load. e-Monitor allows you to group
e-Tester Visual Scripts into jobs that can then be scheduled to provide
constant or scheduled monitoring.
Introduction
About e-Reporter
e-Reporter lets you generate a variety of reports based on performance
data and statistics from an e-Load Autopilot session or e-Monitor and
ServerStats monitoring sessions.
e-Reporter Provides
Post-Session Analysis
Capabilities for
a Variety of e-Load,
e-Monitor, and
ServerStats Runtime
Performance Data
e-Reporter charts show data points and trend lines and can be opened in
Microsoft] Excel for further customization.
selecting session data, time options, report options, and generating reports
from your data.
Multiple Report Types generate a variety of report types for analyzing Web
Introduction
About ServerStats
ServerStats lets you monitor a variety of server-side application, database,
system, and Web server statistics. You can configure ServerStats to
display real-time performance statistics for the various hosts and services
available from the server such as, percentage of CPU usage, memory
usage, Web server statistics, etc.
Specify ServerStats
Counters to Monitor
a Variety of Server
Statistics from
Multiple Data
Sources
Specify ServerStats
Monitoring Alarms
to Track and Alert
You of Server-Side
Performance Issues
monitor server and system statistics from multiple data sources including
BroadVision, ColdFusion, LINUX, Oracle, Solaris, SNMP, WebLogic,
Windows NT, and Microsoft ASP, SQL, and IIS servers.
Counter Graphs generate graphs to track performance statistics over
time. Any server statistics counter you configure in ServerStats can have a
corresponding graph.
11
Counter Alarms specify minimum and maximum ranges for data being
monitored and select the type of alarm to trigger if the statistics being
monitored are outside of the min/max range. Counter alarms can trigger
an audible beep, a log file entry, or execution of an error handler script.
Scripting for Alarm Handling Scripts are snippets of VBScript that
System Requirements
The e-TEST suite has the following system requirements:
E Operating System: Microsoft Windows NT 4.0, Windows 2000, or
recommended
12
Chapter 2
suite.
2.
4.
13
Results Pane
Status Line
The Title bar of the window shows the program name followed by the
current Workspace and Visual Script name.
The Address box directly above the Web browser pane is where you enter
the URL or file location of the Web page(s) to test. The bottom of the
main window includes a status line.
14
Page Hierarchy
Click
to expand a branch or
to collapse a branch.
The Visual Script tree will include any test cases you insert into the Visual
Script. Each item in the tree is identified by an icon and a text description.
You can toggle the Visual Script pane width using the Window Resize
Visual Script View option or by dragging the border between the Browser
pane and the Visual Script pane.
The Visual Script uses additional icons in the tree to represent the following:
- Yellow flag:
skip test.
- Red flag:
test case failure.
15
Browser Pane
The browser pane contains a seamlessly integrated Web browser that you
use to select the Web pages to test. It provides full navigation and Web
access.
Enter URL or File Location
Enter the full path and file name of the URL or local file, or drop down
the list to select from recently accessed Web pages.
16
You can adjust the widths of the individual columns by dragging the
dividers.
Icons in the Visual Script show the location of any specific failures of
default tests or test cases. Resource Validation test results are listed in a
separate window after playback of the script.
You can turn on and off the display of the Playback Results pane using
the Window Resize Output Log View option.
Job Tree
Visual Script
Job Pane
Playback
Results
17
Results Pane
The Results pane shows any log messages generated during playback of
the job.
18
e-Manager Wizard
The e-Manager Wizard provides a convenient way to build and schedule
e-Manager jobs. The e-Manager Wizard includes steps for selecting
Visual Scripts, setting notification options, and scheduling playback times.
The successive steps of the Wizard provide options for setting results
notifications. When the Wizard finishes, you can add the job to any
schedule.
e-Manager schedules can be used with the current job or other saved jobs.
19
Status Line
The Title bar of the window shows the program name followed by the
workspace name and the current scenario name.
20
Scenario Tab
The Scenario tab is where you specify information about the virtual users
to include in the load test and the attributes for each set of virtual users.
You can define user profiles that specify which visual scripts the users
playback to emulate real users and how many virtual users to emulate.
21
Autopilot Tab
The Autopilot tab is where you specify the information needed to control
how the scenario starts and runs. The Autopilot controls the starting and
stopping of the scenario, the rate at which new virtual users are started, and
shows the total number of virtual users and the number of running virtual
users.
You specify the session, start and stop times, and the virtual user rampup
specifications for the Submitted Scenario Profile. It also shows the list of
virtual user profiles submitted in the e-Load scenario.
22
Job Tree
Results
Pane
Script Pane
23
Job Pane
The Job pane lists the Visual Scripts and runtime results information for
each script.
Current Results
Visual Scripts
Results Pane
The Results pane shows any log messages generated during playback of
the Visual Scripts in the e-Monitor job.
You can customize log messages as required using the e-Monitor Wizard
or using your own VBA code.
24
e-Monitor Wizard
The e-Monitor Wizard provides a convenient way to build and schedule
e-Monitor jobs. The e-Monitor Wizard includes steps for selecting
Visual Scripts, setting notification options, and scheduling playback times.
The successive steps of the Wizard provide options for setting results
notifications. When the Wizard finishes, you can add the job to a
schedule.
e-Monitor schedules can be used with the current job or other saved jobs.
25
e-Load Statistics
Values on Left
Y-Axis
The reports pane lets you open multiple report queries and can generate
the following types of reports with a single click of a toolbar button:
E Latest Load Session, Performance vs. Time
E Latest Load Session, Performance vs. Users
E Latest Load Session, Statistics vs. Time
E Latest Monitor Job, Performance vs. Time
E Latest Monitor Job, Weekly Performance
E Latest Monitor Job, Performance Distribution
26
e-Reporter Wizard
The e-Reporter Wizards provides a convenient way to generate reports
from e-Load, ServerStats and e-Monitor sessions. The e-Reporter
Wizards lets you open multiple report queries and can generate the
following types of reports:
e-Load
e-Monitor
Schedule
27
The e-Reporter Wizard walks you through the steps required to generate
the reports.
The successive steps of the Wizard provide options for selecting session
data, time options, report options, and chart formats. The Wizard then
generates the report graph, which you can print from e-Reporter or open
in Microsoft Excel to further customize the graph.
28
Counter View
Log View
Status Line
You can customize the ServerStats main window to show only the
information you want to view.
29
Server
Windows NT
UNIX
E HP-UX System
E Oracle Database
Windows NT
UNIX
E Solaris System
E Windows NT or 2000 System
E Linux System
You can monitor specific counters in real time using the visual indicator
gauges or using graphs. In addition to performance monitoring,
ServerStats let you define scripts that can log warnings or alarms if a
servers counter performance goes outside a defined range.
Server statistics can be saved to the e-Reporter database for later analysis.
The counter view pane is also where any charts you create from a counter
will appear as a tab view.
30
Chart View
The chart views show the values and chart lines for selected counters in
real time. Each graph view can contain counters from one or more of the
data source machines being monitored. Each chart view contains a
counter list, real-time graph, and the toolbar.
Chart Graph
Counter List
Colors Match
Graph Trace
Lines
Gauge View
The gauge views show the current values for selected counters in real
time. Each graph view can contain counters from one or more of the data
source machines being monitored, as follows:
Counter List
and Current
Values
31
Script View
The Script view provides a mechanism for responding to alarms that
occur while monitoring a counter. An alarm is triggered whenever a
counter value being monitored is outside of a minimum-maximum range
that you specify.
Script View
with Alarm
Handler in
VBScript
Log Pane
The log pane is where any log messages, server connection errors, or
counter alarm messages appear.
32
e-Tester Tutorial
Chapter 3
e-Tester Tutorial
This tutorial walks you through the main features of the e-Tester. The
tutorial consists of the following examples:
E Recording a New Visual Script describes basic recording of Visual
Scripts.
E Playing Back a Visual Script explains the procedure for playing back
Visual Scripts and the option settings for playback and the results log.
E Adding Test Cases to the Visual Script explains how to add test cases
E Using the Data Bank Wizard on a Search Form introduces the Data
Bank Wizard and explains how to use the Data Bank Wizard to run
iterative tests on a search form using data from an external file.
E Using Custom Tests explains how to use the Custom Test Wizard to
add custom Visual Basic code to your Visual Scripts to extend your
testing capabilities.
33
34
1.
2.
e-Tester Tutorial
Example 1
Start e-Tester
1.
2.
the e-TEST suite. If you installed the e-TEST suite 5.1 over a
previous version, your default installation directory will still be
c:\RSW. If version 5.1 is the first time you installed the e-TEST suite,
the default installation directory is c:\Empirix\eTEST.
3.
e-Tester opens the Home Superstores tutorial Web page into the
Browser pane.
35
Start a Recording
4.
5.
Click on the Home Appliances link in the Browser pane. The Home
Appliances page appears in the Browser pane and the address should
show c:\Empirix\eTEST\rswdemo\kitchen.htm.
7.
Scroll to the bottom of this page in the Browser pane and click on the
Lighting link on this page. The Browser will now display the Lightings
page, the address should read c:\Empirix\eTEST\rswdemo\lighting.htm
and you should now see [3] Lightings - Home Superstores Inc. in the
Visual Script.
8.
Scroll to the bottom of this page in the Browser pane and click on the
Electronics link on this page. The Browser will now display the Home
Electronics page and you should now see [4] Electronics - Home
Superstores Inc. in the Visual Script.
Click the Stop button on the toolbar to stop the recording. The Visual
Script pane should list four pages in the script.
36
10.
Select File Save Script to save the script. The autonaming feature
initially defaults the name of a new script to Script1.
11.
Type in tutor1 for the name of the script in the Save As dialog box
and click Save.
e-Tester Tutorial
Example 2
Click the Resize Visual Script View button to expand the Visual
Script pane.
2.
Click the [1] Welcome - Home Superstores Inc. node in the Visual
Script and then click the icon next to the node. The script shows
the Address and Frame nodes to the page tree.
3.
Select Edit Expand Page to show the entire page tree, which should
look as shown below:
37
The [1] Welcome - Home Superstores Inc. page contains the following
nodes in the tree:
E An Address node that has the recorded URL for the page.
E A Duration node under the Address node that displays how long it
took to download the page and the playback delay associated with
the page. The playback delay is the actual amount of time (think
time) the user spent on the page before going to another page. For
additional information about playback delay, see the online help.
E A Frame node that is the main frame for the entire page. Below this
E An HTML node that has the HTML source for the page.
E An Images node that has all the images in the page under it.
E A Scripts node that has all the VBScripts and JavaScripts under it.
E A Links node that has all the links in the page under it.
NOTE: Web pages that include Frame Sets, Anchors, Forms,
38
4.
5.
Click the right mouse button and select Properties. The following
dialog box is displayed:
e-Tester Tutorial
You can get more information about any item in the Visual Script using
the Properties option. The properties for the different items vary.
6.
7.
Repeat steps 5 and 6 with any other items in the tree and view the
properties.
9.
Click the right mouse button and select Don't Test Frame. Notice a
small yellow flag appears next to the Frame node to indicate that the
automatic existence test for the frame is turned off, as shown below:
10.
Click the right mouse button and select Test Frame. The yellow flag
disappears to indicate that the automatic existence test is activated.
NOTE: e-Tester maximizes your productivity by virtually eliminating
Select the [1] Welcome - Home Superstores Inc. node in the Visual
Script.
39
12.
Click the right mouse button and select Modify Default Tests.
The Modify Default Tests dialog box opens.
This dialog box indicates that the selected page has default test cases
automatically added to detect the existence of Frames, HTML,
Images, Links and Scripts. The check boxes for Anchors, Elements
etc. are dimmed to indicate that there are no nodes of these types in
the selected page.
You can turn off testing of nodes of a particular type altogether by
clearing the appropriate check box and clicking the Apply or the OK
button.
13.
Clear the check box associated with Images and press the OK button.
A yellow flag appears next to the Images node in the Visual Script for
the image collection, as shown below:
40
e-Tester Tutorial
Example 3
Select Options
Options Results Log, make sure the Append to Log and All
Details radio buttons are selected, and then click OK.
2.
3.
Click the Resize Visual Script View button to expand the Browser pane.
4.
Click the Playback Script button to play back the recorded script. The
pages in the script will be played back in the order recorded. The
Browser navigates to each page, executes the default tests for each page,
and shows the results visually in the script. At the end of the play back,
e-Tester runs a Resource Validation test and shows the results.
The Resource Validation test checks the integrity of the referenced
resources (i.e. links, images, etc) in your pages.
5.
Notice that all tests passed. This is because you played back the script
using the same version of the Web pages that was used to record the
script. This establishes a baseline of tests for the Web application or
Web sites content and structure.
In the next example, youll see how playback and the results are
affected by Web page changes.
42
e-Tester Tutorial
Example 4
2.
If necessary, close the DOS window after the batch file finishes copying
the files.
3.
Click the Playback Script button to play back the recorded script
again. The pages are played back in the order recorded.
The resource validation test found one resource that failed. There is
one failed image called theatre.gif. The results of the resource
validation test are displayed in the output log window and the failure
will be displayed under the appropriate pages with red flags.
4.
5.
Notice the red flags next to the pages in the Visual Script, as shown
below:
43
6.
Select Results Find Next Failure, or press the F3 key to locate the
first failure in the Visual Script. The first page [1] Welcome - Home
Superstores Inc. indicates Different HTML and two new links. They are
admlist.htm and adminfo.htm.
Ignoring Failures
Occasionally, you may want to ignore a known problem or discrepancy
that does not affect the overall test being performed.
44
7.
Press the F3 key to locate the Master: Html node under the Different
Html node.
8.
Click on the Different Html node, and then click the right mouse
button and select Ignore This Failure. This adds a yellow flag to the
Different Html node to indicate that the failure caused by the HTML
change should be ignored, as follows:
9.
10.
Click on the New Links item, and then click the right mouse button
and select Ignore This Failure. This adds a yellow flag to the New
Links node to indicate that the failure caused by the presence of new
links should be ignored.
e-Tester Tutorial
The red flags change to a red flag with a yellow stripe to indicate that
the failure will be ignored, as follows:
Follow the red flags in the [2] Kitchens Home Superstores Inc. page.
The problems on this page are indicated by the presence of two nodes
called Different Html and Different Script. Below the Different Html
node are the recorded and tested versions of the HTML for the
current page. Below the Different Script node are the recorded and
tested versions of the JavaScript function that has changed for the
current page.
45
12.
Double click on the Different HTML node and a dialog box with the
differences for the HTML opens.
Notice that the changes are textual changes to the Web page content.
The Master text (baseline for testing) is shown in blue. The tested
text (new version) is shown in red.
13.
14.
15.
Select Results Accept Tested Page. The red flags in the Visual
Script for that page disappear. The accepted change becomes the new
baseline for future testing of this page.
Follow the red flags in the [4] Electronics Home Superstores Inc. page.
The problems on this page are indicated by the presence of two nodes
called Different Html and Different Image. Below the Different Html
node are the recorded and tested versions of the HTML for the
46
e-Tester Tutorial
current page. Below the Different Image node are the recorded and
tested versions of the image found on this page.
17.
The Master node has a red flag because playback revealed that the
link to the image is no longer in the HTML. The Tested node has a
red flag because the image failed the Resource Validation test.
18.
Double click on the Different HTML node and you will see the same
spelling change in the HTML source for the page.
20.
48
21.
Click the Playback toolbar button to play back the script again.
e-Tester still flags the Different HTML and the image name spelling
problem in the [4] Electronics Home Superstores Inc. page of the
Visual Script.
22.
23.
24.
25.
Select Edit Clear Output Window to clear the results log pane.
e-Tester Tutorial
Example 5
2.
3.
4.
5.
6.
Click on the Register link in the Browser pane. The Registration page
appears in the Browser pane and the address should show
c:\Empirix\eTEST\rswdemo\register.htm.
7.
Scroll the Browser pane, enter Admin as the first name, enter any
email address, and phone in the text area, and click the Register
button. The Browser returns a successful registration page
(regres.htm).
Click the Stop button on the toolbar to stop the recording. The Visual
Script pane should list three pages in the script.
49
2.
Click the right mouse button and select Goto Page to open the
Registered - Home Superstores, Inc page in the Browser.
3.
Scroll the Browser pane so that the text Database Authorization and
Administration is visible.
4.
5.
Click the Insert Text Matching Test Case button on the toolbar.
e-Tester captures the highlighted text and opens the Insert Text
Matching Test Case dialog box.
6.
50
e-Tester Tutorial
7.
Make sure the Pass when: option is set to Selected text is present.
8.
Click Accept and view the test case in the Visual Script. e-Tester adds
the test case to the Visual Script under the Frame node.
Select the [2] Registration - Home Superstores, Inc. item in the Visual
Script.
10.
Click the Insert Server Response test case button on the toolbar.
e-Tester opens the Insert Server Response Test Case dialog box.
11.
12.
Select the Time tab and set the Maximum Time Allowed for Playback
option to 5 seconds. Leave the Minimum Time at 0 seconds.
13.
Click OK and view the test case in the Visual Script. e-Tester adds the
test case to the Visual Script between the Address and Frame nodes.
51
52
14.
Select the [2] Registration - Home Superstores, Inc. item in the Visual
Script.
15.
Expand the page and select the TodaysDate element of the regres.htm
form.
16.
Select Tests Insert Form Element Test. e-Tester opens the Form
Element Test dialog box.
e-Tester Tutorial
17.
18.
19.
20.
21.
Click the Test button. e-Tester should return True in the Test Result
field.
22.
Click OK and view the test case in the Visual Script. e-Tester adds the
test case to the Visual Script under the Form Element node.
Select the [2] Registration - Home Superstores, Inc. item in the Visual
Script.
53
54
24.
Click the Insert External Callout Test button on the toolbar. e-Tester
opens the External Callout Test dialog box.
25.
26.
Click the Test Server button to make sure the external callout is
available. e-Tester should return Available in the Status field.
27.
Make sure the Before playback of page and After playback of page
check boxes are selected.
e-Tester Tutorial
28.
Click OK and view the test case in the Visual Script. e-Tester adds the
test case to the Visual Script between the Address and Frame nodes.
29.
Select File Save Script As and save the Visual Script as tutor2.
30.
Click the Playback button on the toolbar and watch as e-Tester plays
back the script with the added test cases. When playback reaches the
[[2] Registration - Home Superstores, Inc. page in the Visual Script, a
message dialog box appears indicating the External callout test
executed before play back of the page.
31.
Click OK to continue the test playback. e-Tester tests the page, and
then opens a message dialog box indicating the External Callout test
executed after play back of the page.
32.
33.
34.
Select the External Callout Test item under the [2] Registration - Home
Superstores, Inc. item in the Visual Script.
55
35.
Click the right mouse button and select Properties. e-Tester opens the
properties dialog box for the test case.
36.
Notice the External Callout test returned an error number and error
string. This is a sample error to show the capabilities of the Callout test.
NOTE: The e-Tester User Guide explains the requirements for
37.
56
e-Tester Tutorial
Example 6
Select File New Script to create a new Visual Script (save the
previous script if prompted).
2.
Recording a Search
3.
4.
5.
Enter Lamps in the Product Name field and click the Search button.
e-Tester records the search including the text you typed into the field.
6.
Expand the [3] Results - Home Superstore, Inc page in the Visual
Script. Notice the Search Parameter under the Address node of the
tree.
57
Search[3]
of the script
58
9.
Click the Add Variable button. The Data Bank Wizard opens a
dialog box for specifying a variable name.
10.
e-Tester Tutorial
The Data Bank Wizard adds the name to the Variables list.
11.
Select the Search[3] item in the Parameters list, and then click Add
Mapping. The Data Bank Wizard creates a mapping between the
Search[3] parameter and the SuperSearch variable. You now need to
bind the variable name to a field in a Data Bank file.
59
Click the Data Binding tab. The Data Bank Wizard opens the Data
Binding options with the variable name in the Variables list.
Now we want to select the Data Bank file that contains the values we
want to use for iterative testing.
13.
Click the Select button. The Data Bank Wizard opens a dialog box
for selecting the Data Bank file.
NOTE: The .csv file name extension may or may not be visible
e-Tester Tutorial
14.
Select search.csv, and then click Open. The Data Bank Wizard adds
the Field name from the Data Bank file.
NOTE: The Data Bank file is a comma-delimited ASCII file with the
field names as column headers on the first line of the file. Subsequent
lines of the file contain data. You can view the contents of any of the
sample files in the \Empirix\eTEST\DataBank directory using
Notepad or any other ASCII editor.
61
15.
Select the Search field in the Data Bank Fields list and then click the
Add Binding button. The Data Bank Wizard adds the variable name
to the Bindings list.
62
16.
Click Fetch Record to cycle through the records in the external data file.
17.
Continue clicking the Fetch Record button to cycle through all of the
records in the file. There are five records in the sample Data Bank
file.
18.
e-Tester Tutorial
Examine the Parameters node under the Address node of the Visual
Script tree.
The Visual Script now includes the variable names as part of the
Parameters. The check mark indicates that the parameter is mapped
to a variable and bound to a field in a Data Bank file.
21.
Click the Insert Text Matching test case button on the tool bar.
Notice the text you highlighted is automatically captured by e-Tester.
22.
Type VerifySearch as the case name, make sure Pass when: is set to
Selected text is present, and then click Accept.
23.
Select the HTML node in the Visual Script. Notice the yellow flag next
to the HTML node. e-Tester automatically turns off the HTML
comparison test when you insert a Text Matching test.
NOTE: Since the search criteria will be different for each search during
iterative play back, we know the HTML will be different from the
recorded master each time. Instead of testing the HTML, the Text
Matching test case will be used to verify a successful search.
24.
63
26.
27.
28.
Watch as e-Tester plays back the script several times using a different
data value for the search each time.
64
29.
30.
Click the Goto Record button. The Data Bank Wizard opens a dialog
box for entering the record number.
31.
e-Tester Tutorial
32.
33.
Click the Playback button on the toolbar to play back this one record.
Notice the Resource Validation test indicates all resources passed.
34.
35.
Scroll the Browser pane to view the Search Results page. Notice that
the page indicates there is no product information for Furniture.
e-Tester was able to find this problem because the Text Matching test
case you added to test for a successful search produced a failure.
36.
Make sure the [3] Results - Home Superstore, Inc page is still selected
in the Visual Script.
37.
Select Results Discard Tested Page. The red flags are removed from
the Visual Script. The Master version of the Visual Script is still the
baseline to use for testing of the Web page.
39.
40.
Select Edit Clear Output Window to clear the results log for the next
test.
65
Example 7
2.
66
3.
4.
Scroll the Browser pane and click the Register link. The Registration
page contains a form for entering Name, Email Address, and Phone
number information.
5.
Enter your own information into the form and click the Register
button. The Results page returns showing the information you
entered with a successful registration message.
e-Tester Tutorial
Highlight the text you have been successfully in the search results
page.
7.
Click the Insert Text Matching test case button on the tool bar.
Notice the text you highlighted is automatically captured by e-Tester.
8.
Type VerifyRegistration as the test case name, make sure Pass when: is
set to Selected text is present, and then click Accept.
9.
10.
67
Expand the [3] Registered - Home Superstore, Inc page in the Visual
Script. Notice the Parameters under the Address node of the tree.
12.
Make sure the [3] Registered - Home Superstore, Inc page is selected
in the Visual Script.
68
e-Tester Tutorial
14.
Click the Auto Map button. The Data Bank Wizard automatically creates
variable names and maps the variable names to the Parameter names.
You now need to bind the variable names to fields in a Data Bank file.
Click the Auto Bind button. The Data Bank Wizard opens the Data
Binding options with the variable names in the Variables list.
NOTE: Auto Bind automatically creates a Data Bank file with field
69
Now we want to select the data source that contains the values we
want to use for iterative testing.
70
16.
Click the Select button. The Data Bank Wizard opens a dialog box
for selecting the Data Bank file.
17.
e-Tester Tutorial
NOTE: The Data Bank file is a comma-delimited ASCII file with the
field names as column headers on the first line of the file. Subsequent
lines of the file contain data. You can view the contents of any of the
sample files in the \Empirix\eTEST\DataBank directory using
Notepad or any other ASCII editor. The following illustration shows
how Data Banks map to variables and Visual Scripts.
71
18.
Click the Fetch Record button to cycle through the records in the
Data Bank file.
19.
Continue clicking the Fetch Record button to cycle through all of the
records in the Data Bank file.
20.
Examine the Parameters node under the Address node of the Visual
Script tree.
The Visual Script now includes the variable names as part of the
Parameters. The check marks ( ) indicate the parameters that are
mapped to variables and bound to fields in a Data Bank file. The
triangles ( ) indicate variables that are mapped, but not bound to
fields in a Data Bank file.
22.
72
e-Tester Tutorial
Select Options Results Log, make sure the Failures Only radio
button in the Report section is selected, and then click OK.
24.
25.
26.
27.
Watch as e-Tester plays back the script several times using different
data values for the registration.
73
29.
Click the Goto Record button. The Data Bank Wizard opens a dialog
box for entering the record number.
30.
31.
32.
Click the Playback button on the toolbar to play back this one record.
Notice the Resource Validation test indicates all resources passed.
33.
option.
34.
Scroll the Browser pane to view the Registration Results page. Notice
that the page indicates a server error. e-Tester was able to find this
error because the Text Matching test case you added to test for
successful registration produced a failure.
35.
Make sure the [3] Results - Home Superstore, Inc page is still selected
in the Visual Script.
36.
Select Results Discard Tested Page. The red flags are removed from
the Visual Script. The Master version of the Visual Script is still the
baseline to use for testing of the Web page.
74
37.
38.
39.
Select Edit Clear Output Window to clear the results log for the next
test.
e-Tester Tutorial
Example 8
3.
4.
Select Tests Insert Custom Test. The e-Tester opens the Custom test
Wizard. The following illustration shows the Custom Test Wizard:
75
5.
Type CustomTest1 as the test name and click Next. e-Tester opens a
window over e-Tester that shows the Selected and Current Path
information.
The Current Path is the object model location of the Web page object
currently beneath the mouse cursor. The objects in the browser pane
change color to highlight the current Web page object. The Visual
Script pane shows the Web page hierarchy and highlights the current
object.
76
6.
Move the mouse cursor over the Web page to see how the Custom
Test Wizard highlights Web page objects both in the Browser pane
and the Visual Script pane.
7.
Click the mouse cursor on the home appliances link. The object
model path is added to the Select Object Model Element window as
the Selected path.
e-Tester Tutorial
8.
9.
Select the Properties option. The element properties are listed in the
wizard. The Custom Test Wizard lets you specify tests for specific
Web page element properties. For this tutorial, well create a test on
the text rather than a property.
10.
11.
Click Next. The Custom Test Wizard opens a panel for selecting the
type of test to perform.
77
12.
Leave the default values and click Finish. The Custom Test Wizard
opens the VBA development environment and generates the Visual
Basic project and code for the test.
You can customize the Visual Basic code as necessary for specific
testing purposes.
78
13.
14.
15.
Playback the Visual Script. The custom test verifies the text of the
home appliances link during playback of the Visual Script.
16.
e-Tester Tutorial
2.
Select the Custom Page Programmability node and click the right
mouse button.
3.
4.
If you have the e-TEST suite CD-ROM, open the Sample EPI
Scripts\VBA directory. Copy the Get All Links text from the Get All
Links subdirectory into the afterPlay event of the RSWVBAPage
object.
If you do not have the e-TEST suite CD-ROM, enter the following
code into the afterPlay event of the RSWVBAPage object:
Dim
Dim
Dim
Dim
Dim
topdoc As Object
numlinks As Long
hrefVal As String
linkIndex As Long
indexVal As String
79
6.
Playback the Visual Script and close the Resource Validation window.
The sample Test Scriptlet should display a list of all links in the Web
page with an index value, as follows:
The code for Custom tests can access the Document Object Model
of the Web page, evaluate and modify elements and properties, access
Data Bank values, and change Visual Script page navigation
programmatically based upon specific conditions.
e-Tester includes the e-Test Programming Interface (e-PI) that
provides several methods and properties that you can use when
developing custom tests. See the e-Tester User Guide for more
information about using custom tests to extend your Visual Script
testing capabilities.
80
7.
8.
e-Manager Tutorial
Chapter 4
e-Manager Tutorial
This tutorial walks you through the main features of e-Manager. e-Manager is
a separate product in the e-Test suite, which you may or may not have
purchased. If you have the e-Manager version of the e-Test suite, you can
follow the examples in this chapter to become familiar with the features and
use of e-Manager.
This tutorial consists of the following examples:
E Creating a job and schedule describes how to create a job using the
E Editing a Job explains how to edit a job after you have created it.
E Editing a Schedule explains how to edit a schedule after you have
created it.
E Adding Custom Code explains how to access the Visual Basic for
Applications (VBA) editor and add custom code for e-Manager events.
81
Example 1
Starting e-Manager
1.
2.
Select File New Job or click the e-Manager Wizard toolbar button.
e-Manager opens the Wizard Welcome screen. If you do not want
the Welcome screen to appear each time you run e-Manager, select
the Skip this screen in the future check box.
3.
Click the Next button to continue to the Workspace and Scripts [Step
1 of 2] screen.
82
4.
Select the RSWDemo workspace. Note that you can include scripts
from more than one workspace in a job.
5.
Select tutor3 and click on the Add button to add the script to the
Script Order list.
e-Manager Tutorial
6.
7.
The default log message writes the following information to the results log
if an error occurs during playback of a Visual Script:
E Time of the error
E Databank record
E An error number
E A description of the error
8.
83
84
9.
Select the Send HTML Summary check box to send the Job Report to
the recipients.
10.
Select the Send Text Log to send a text version of the log.
11.
12.
Click the Finish button. The Save Job As dialog box is displayed.
13.
14.
You are then asked if you want to schedule the job. Click Yes.
e-Manager Tutorial
15.
16.
Change the starting day in the From field to Sunday and the ending
day in the Through field to Thursday.
17.
85
19.
The file name is displayed in the title bar of the Current Schedule
window.
In the Job Editor window, click the Start button to play back the job.
2.
86
e-Manager Tutorial
2.
3.
87
Example 2
Editing a Job
This example illustrates how to edit a job using the Job Editor window
after the job has been created with the e-Manager Wizard. Note that you
can have more than one job open at any one time.
88
1.
Select File Open Job to open a job or make the Job Editor window
active by clicking on it to edit the currently open job.
2.
Click Scripts in the job tree to display the script selection options.
3.
Select the RSWDemo workspace and add the tutor2 script to the Script
Order list.
e-Manager Tutorial
4.
5.
6.
89
Example 3
Editing a Schedule
This example illustrates how to edit a schedule by adding and changing
playback times of jobs. This example uses only one job but you can
schedule more than one job.
90
1.
2.
e-Manager Tutorial
3.
Change the time to 11:00 am, the starting day to Monday and the
ending day to Friday.
4.
Click on tutorJob1 in the job tree and drag it to Sunday at 6:00 pm.
5.
91
Example 4
2.
Select Edit VBA from the Job Editor menu or click the toolbar button
to start the Visual Basic for Applications editor.
3.
Expand the project in the Project VBA Project dialog box and
double-click on the ThisJob object to display the code window.
4.
5.
6.
Enter the following code that will send a message to the log file and
stop the job if it fails.
Private Sub ThisJob_Failure()
'Send message to log and stop job
Notifier.Log "Job Failed. Stopping Job."
stopJob
End Sub
7.
8.
9.
Click on the Run Button in the Job Editor to test the script. The
failure message displays in the Results Pane of e-Manager.
Refer to the e-Manager User Guide or online help for details about
e-Manager objects and events.
92
e-Monitor Tutorial
Chapter 5
e-Monitor Tutorial
This tutorial walks you through the main features of e-Monitor.
e-Monitor is a separate product in the e-Test suite, which you may or may
not have purchased. If you have the e-Monitor, you can follow the
examples in this chapter to become familiar with the features and use of
e-Monitor.
The tutorial consists of the following examples:
E Creating a job and schedule describes how to create a job using the
E Editing a Job explains how to edit a job after you have created it.
E Editing a Schedule explains how to edit a schedule after you have
created it.
E Adding Custom Code explains how to access the Visual Basic for
Applications (VBA) editor and add custom code for e-Monitor events.
93
Example 1
Starting e-Monitor
1.
2.
3.
4.
94
Select the RSWDemo workspace. Note that you can include scripts
from more than one workspace in a job.
e-Monitor Tutorial
5.
Select tutor3 and click on the Add button to add the script to the
Script Order list.
6.
7.
9.
10.
11.
96
e-Monitor Tutorial
12.
Click the Finish button. The Save Job As dialog box is displayed.
13.
14.
e-Monitor displays the Job Editor Window and then asks if you want
to schedule the job. Click Yes.
15.
97
16.
98
17.
18.
e-Monitor Tutorial
The file name is displayed in the title bar of the Current Schedule
window.
In the Job Editor window, click the Start button to play back the job.
2.
Watch as e-Monitor processes the Visual Scripts. A yellow bar in the row
of the script indicates that the script is being processed. A red bar
indicates that the script failed; a green bar indicates that the script passed.
Upon completion an email will be sent to you with the job report and
text log if you used your email address when setting up the job
notifications.
99
2.
3.
100
e-Monitor Tutorial
Example 2
Editing a Job
This example illustrates how to edit a job using the Job Editor window
after the job has been created with the e-Monitor Wizard. Note that you
can have more than one job open at any one time.
1.
Select e-Monitor Open Open Job to open a job or make the Job
Editor window active by clicking on it to edit the currently open job.
2.
Click Scripts in the job tree to display the script selection options..
3.
Select the RSWDemo workspace and add the tutor2 script to the Script
Order list.
101
102
4.
Click Advanced in the job tree to display the advanced email options.
5.
6.
e-Monitor Tutorial
Example 3
Editing a Schedule
This example illustrates how to edit a schedule by adding and changing
job playback times. This example uses only one job but you can schedule
more than one job.
1.
2.
103
104
3.
Click Advanced
Advanced to display more options.
4.
5.
Select Every and change the interval to hours and click OK.
6.
7.
e-Monitor Tutorial
Example 4
2.
Select Edit VBA from the Job Editor menu or click the toolbar button
to start the Visual Basic for Applications editor.
3.
Expand the project in the Project VBA Project dialog box and
double-click on the ThisJob object to display the code window.
4.
5.
6.
Enter the following code that will send a message to the log file and
stop the job if it fails.
Private Sub ThisJob_Failure()
'Send message to log and stop job
Notifier.Log "Job Failed. Stopping Job."
stopJob
End Sub
7.
8.
105
9.
Click on the Run Button in the Job Editor to test the script. The
failure message displays in the Results Pane of e-Monitor.
Refer to the e-Monitor User Guide or online help for details about
e-Monitor objects and events.
106
ServerStats Tutorial
Chapter 6
ServerStats Tutorial
This tutorial walks you through the main features of ServerStats.
ServerStats is a companion product to e-Load in the e-TEST suite, which
you may or may not have purchased. If you have the e-Load version of the
e-TEST suite, you can follow the examples in this chapter to become
familiar with the features ServerStats.
The tutorial consists of the following examples:
E Adding Data Sources shows how to use the Data Source Wizard to
E Using the Chart View shows how to open the chart view and add
E Setting the Update Intervals shows how to set the update interval for
E Setting Counter Alarms shows how to enable and set alarms for
messages.
server types. This tutorial adds counters from your local Windows
NT/2000 system to demonstrate the features of ServerStats. If you are not
running the e-TEST suite on a Windows NT/2000 machine, you should
skip this chapter and continue the tutorial with Chapter 7.
107
Example 1
108
2.
3.
ServerStats Tutorial
4.
Select Windows NT or 2000 System as the data source and click Next.
The Data Source wizard opens the Connect screen for Windows NT
systems.
6.
7.
Click Next. The Data Source wizard opens the Select Data screen for
selecting the counter object, the specific counter, and the instance to
monitor. The available counters and instances are the same as are
available using the Windows NT Performance Monitor.
109
110
ServerStats Tutorial
Example 2
2.
Select View
View New View Chart View. The counter is added to a new
chart view in ServerStats.
3.
Select the Memory (---): Available Bytes counter name in the Counters
view.
4.
Drag the counter from the Counters view to the Chart view using the
mouse. A new trace line is added to the chart for the counter.
111
Example 3
Leave the e-Monitor Reporting and Data Source Message Log setting
as the default settings.
3.
4.
112
Click OK.
ServerStats Tutorial
Example 4
2.
The Alarm settings specify the type(s) of alarms to use and the values
that trigger an alarm.
The ee-Reporter setting specifies if the counter data is saved to the
e-Reporter database for later analysis.
3.
Select the Log and Script check boxes in the Alarm group.
4.
Set the Min value to 0. This specifies the minimum range value for
issuing an alarm for a counter.
5.
Set the Max value to 50. This specifies the maximum range value for
issuing an alarm for a counter. In this case, we want to set an alarm
that logs a message if the processor usage goes over 50%.
6.
Set the Points value to 2. This specifies the number of polling intervals that
the value must be outside of the Min/Max range before issuing an alarm.
7.
Click OK.
113
Example 5
Using Scripts
ServerStats scripts provide a mechanism for responding to alarms that
occur while monitoring a counter. The Script view is a VBScript control
that you can use to customize alarm notification. ServerStats includes a
specialized set of methods and properties that you can use to enhance your
own VBScript code. You can create a VBScript code snippet that logs
events, executes a program, or sends an email message.
This example shows how to use scripts to customize log notification
messages.
To use scripts to customize log messages, do the following:
1.
2.
dim MyAlarmTime
MyAlarmTime = vbCrLf & Date & " at " & Time & vbCrLf _
+ "Desc: " & AlarmCounter.DisplayString & vbCrLf _
+ "Value: " & AlarmCounter.CurrentValue.Value
monlog MyAlarmTime
114
3.
Click Update.
4.
ServerStats Tutorial
5.
6.
7.
8.
Drag the ServerStats main window around the screen for a few
seconds to intentionally trigger the processor alarm. The alarm bell in
the Counters view blinks and a message appears in the log pane of the
ServerStats window. The following is a sample of the message that
appears in the log for the above VBcript code:
3/28/2001 at 2:09:03 PM
Desc: Processor (_Total): % Processor Time
Value: 35.7664233576642
9.
10.
11.
115
116
e-Load Tutorial
Chapter 7
e-Load Tutorial
This tutorial walks you through the main features of e-Load, e-Reporter
and ServerStats. e-Load is a separate product in the e-Test suite, which
you may or may not have purchased. If you have the e-Load version of the
e-Test suite, you can follow the examples in this chapter to become
familiar with the features and use of e-Load, e-Reporter, and ServerStats.
The tutorial consists of the following examples:
E Performing a Simple Load Test shows how to use e-Load to run
record a new Visual Script and add the new Visual Script to the e-Load
Scenario. This example also shows how to set the Preferences and
Session Management options to save data for use in e-Reporter.
Example 1
2.
3.
118
4.
5.
Make sure that the Stop on last VU completion check box is selected.
6.
Make sure the Save data for reporting option is set to No.
7.
Click OK.
e-Load Tutorial
9.
Select tutor1 in the Default Profiles list. Default Profiles are the Visual
Scripts that you record using e-Tester.
10.
Click the right-arrow button to add tutor1 to the Scenario Profiles list.
You can also double-click the Default Profile name to add it to the
Scenario Profiles list.
Click the Submit Scenario button on the Scenario tab or the toolbar.
e-Load automatically opens the Autopilot tab with the tutor1 Scenario
Profile listed in Submitted Scenario Profiles list.
119
Select After Iteration Count from the Stop drop-down list of the Start
and Stop group of the Autopilot tab.
13.
14.
Select Specify Number from the How Many drop-down list of the
Rampup Specification group.
15.
Enter 1 in the edit box next to the How Many drop-down list.
16.
17.
18.
19.
Allow the virtual users to continue running until all of them indicate
Finished in the Status column of the virtual user grid.
Congratulations. You have just performed a simple load test on the
Demo Web application. e-Load performs the virtual user Web
interaction in the background. You can monitor the virtual users in
the grid as they are running. In the later examples of this tutorial,
youll see how to use e-Load to view statistical and performance
information, and how to view virtual user actions.
120
e-Load Tutorial
Example 2
2.
3.
Select tutor3 in the Scenario Profiles list to make it the selected profile.
4.
5.
Make sure the Virtual User Pacing is set to Recorded and the
Maximum value is set to 1 second.
6.
7.
8.
9.
Select tutor1 in the Scenario Profiles list to make it the selected profile.
10.
11.
121
122
12.
13.
14.
15.
16.
17.
18.
Click OK.
e-Load Tutorial
19.
20.
21.
Click OK.
23.
123
123
Example 3
124
1.
Make sure the Scenario from the previous example is still shown in
the Scenario tab.
2.
Click the Submit Scenario button on the Scenario tab or the toolbar.
3.
e-Load automatically opens the Autopilot tab with the tutor1 and
tutor3 Scenario Profiles listed in Submitted Scenario Profiles list.
4.
Select None from the Stop drop-down list of the Start and Stop group
of the Autopilot tab.
5.
Select Specify Number from the How Many drop-down list of the
Rampup Specification group of the Autopilot tab.
6.
Enter 3 in the edit box next to the How Many drop-down list.
7.
Select Iteration Count Of from the After drop-down list of the Rampup
Specification group of the Autopilot tab.
8.
e-Load Tutorial
9.
10.
11.
12.
125
Watch as the Autopilot starts running the tutor1 and tutor3 Visual
Scripts as virtual users. Notice also that tutor3 is playing back records
from the Data Bank.
Initially, the Autopilot starts only three virtual users. After the first
three have completed five iterations, the Autopilot starts another three
virtual users. Once the second three virtual users have completed five
iterations, the remaining three virtual users start. The Rampup
Specification options of the Autopilot let you control the rate at which
virtual users start running.
126
e-Load Tutorial
127
The statistics show the values for the following performance categories:
<Session Name> Current
E Active Virtual Users the number of virtual users currently running
in the Autopilot.
E Virtual Users with Errors the number of virtual users with errors.
E Transactions Per Second the number of times the virtual user
E Pages Per Second the number of pages returned by the server per
128
e-Load Tutorial
129
Viewing Graphs
13.
14.
Select the Performance Vs. Users option in the Load Graphs window
(scroll down in the e-TEST Console window if necessary to access the
graph selection list).
This graph shows the average run time for the number of running
virtual users in each profile. The bar chart represents the Autopilot
rampup of virtual users. In the above chart, the first bars for each
profile shows the average run time while three virtual users were
running. Once the Autopilot ramps up to run six virtual users, the
bars for three virtual users are longer updated.
The second set of bars show the average run time while six virtual
users were running. Once the Autopilot ramps up to run nine virtual
users, the bars for six virtual users are no longer updated.
The third set of bars show the average run time while nine virtual users
are running. In this example, nine virtual users is the total number of
virtual users the Autopilot ramps up to run. The third set of bars will be
updated continuously while the nine virtual users are running.
130
e-Load Tutorial
15.
Select the Users Vs. Time option in the Load Graphs window.
Select the Performance Vs. Time option in the Load Graphs window.
131
This graph shows the average run time for the active virtual users
running each profile over time.
17.
Select the Statistics Vs. Time option in the Load Graphs window.
This graph shows averages for virtual user hits, pages, transactions,
and Kilobytes per second over time.
The error graphs show percentages of errors vs. virtual users over time.
132
e-Load Tutorial
Example 5
Make sure the virtual users from the Example 3 are still running.
3.
4.
Select Modify Run Attributes. e-Load opens a dialog box for changing
the run attributes for the selected virtual user.
133
Select Run Selected Virtual User Start Viewing or click the toolbar
button (you can also use the right-click popup menu from the virtual
user grid). e-Load opens a browser window in which you can view
the actions of the virtual user.
7.
8.
Click the Navigate to Next Page toolbar button. The viewer shows
only the next page.
9.
Click the Auto Mode toolbar button. The view shows new pages
accessed by the virtual user as they arrive to the viewer.
10.
Click the Stop Accepting New Pages toolbar button. The viewer
stops accepting pages from the virtual user.
Note: Because of the speed at which new pages arrive in the viewer, it
may take a few moments for cached pages to stop appearing in the
viewer.
11.
134
e-Load Tutorial
13.
14.
Select Stop. e-Load stops running the selected virtual user. The virtual
user will complete the current Visual Script iteration and then stop.
15.
17.
18.
Select Abort. e-Load aborts running the selected virtual user without
completing the current visual script iteration.
Select Run All Virtual Users Stop or click the toolbar button to
stop all virtual users. The virtual users will complete the current
visual script iteration and then stop.
20.
Select Run All Virtual Users Abort or click the toolbar button to
abort all virtual users. The virtual users will abort the virtual user
without completing the current visual script iteration.
135
Example 6
Generating Reports
This example explains the automatic report generation features of e-Load
and e-Reporter. The data collected by e-Load and ServerStats while the
Autopilot is running virtual users is saved to a database when the Save
Data for Reporting option in e-Load Session Management is set to Yes or
Ask. You can use e-Reporter to analyze the data and generate a variety of
graphs and reports. e-Load provides the ability to automatically start
e-Reporter and generate a default report.
136
e-Load Tutorial
e-Load Statistics
Values on Left
Y-Axis
Virtual UserProfiles
in Legend
The graph shows the average performance over time for each page in
the tutor1 and tutor3 profiles that were run in e-Load. Each profile,
page and counter graph is shown as data points and a trend line using
different colors.
The left-side y-axis represents the values for e-Load statistics. The
legends show which color line represents which virtual user profile,
Visual Script page, and ServerStats counter.
137
138
1.
2.
3.
4.
Select Statistics vs. Time under Select Query and click Next to
advance to the Time options section of the Wizard.
5.
Click Next to use the default time options. The wizard advances to
the Chart Format section of the wizard.
e-Load Tutorial
6.
7.
e-Load Statistics
Values on Left
Y-Axis
Statistics and
ServerStats
Counter Names
in Legend
ServerStats Counter
Values on Right Y-Axis
8.
The legends show which color line represents which virtual user
profile, Visual Script page, and ServerStats counter. The legends for
e-Load data show the session, the virtual user profile, and the Visual
Scripts page in the form session.profile.page[#]. The legends for
ServerStats data show the machine name, counter object, counter
instance and counter in the form machine.object.instance.counter.
You can export the data to an HTML file, a comma separated value
file, or a Microsoft Excel Workbook file. You can also generate
additional reports from the session data using the e-Reporter Wizard.
140
e-Load Tutorial
on your system.
15.
16.
The workbook contains a chart sheet and a worksheet. You can use
the features and capabilities of Microsoft Excel to change the chart
format. The filename of the workbook is the current date and time
with a .xls extension.
141
17.
Click the Data Table tab to view the actual data values.
18.
The A1 cell contains the session information. Rows two and three
contain the profile, timer, and counter headings and the report type.
Subsequent rows contain the actual data values for the chart.
19.
142
20.
21.
e-Load Tutorial
22.
You can print the report by clicking the right mouse button and
selecting Print from the popup menu.
23.
143
Example 7
144
1.
Select File New Profile. e-Load opens a dialog for specifying the
new profile. The dialog box shows the section tree, the available
Visual Scripts, and the default synchronization points.
2.
3.
The profile sections tree allows you to specify which Visual Scripts and
synchronization points to include in the Sections tree of the profile.
e-Load Tutorial
Prolog the Visual Scripts in this section play back only once at the
end of the Scenario run. An example of what you add to this section is
a logoff script.
Errors the Visual Scripts in this section play back only if an error
occurs during the Scenario run. An example of what you may add to
this section is a visual script that resets your application on an error.
Select the section in the tree where you want to add a Visual Script.
5.
Double-click the Visual Script to add to the section or select the script
and click the left-arrow button.
The Visual Script appears as a node of the tree.
6.
Repeat steps 4 and 5 to add additional Visual Scripts to the Sections tree.
145
actions and interactions with the application under test. Sync points
provide the ability to create realistic multi-user situations that may
expose resource conflicts such as deadlocks. When you specify a sync
point, multiple virtual users executing the script will reach this sync
point at various times depending on a number of factors (for
example, the speed of the machine).
Sync points cause each virtual user to wait until all virtual users have
reached that sync point. Each of the virtual users notifies the master
upon reaching the sync point. The master waits for all of the virtual
users to notify it and then issues the go-ahead for all the virtual users
to continue past that sync point.
7.
Select the section in the tree where you want to add a Sync point.
8.
Double-click the Sync point to add to the section or select the Sync
point and click the left arrow button.
The Sync point appears as a node of the tree.
9.
146
Repeat steps 7 and 8 to add additional Sync points to the Sections tree.
e-Load Tutorial
11.
12.
13.
Select Edit Edit Profile. e-Load opens a dialog for editing the
sections tree of the profile. The dialog box shows the current sections
tree and the available Visual Scripts and the default synchronization
points.
15.
Click the
16.
17.
18.
19.
20.
This completes the e-Load tutorial. See the e-Load User Guide for
additional information about load testing and using the e-Load,
e-Reporter, and ServerStats options.
148
Index
Index
Accept a new baseline script, 45
Activating Schedules, 87, 100
Add
Sync point to profile, 146
Visual Scripts to profile, 145
Add binding, 62
Add mapping, 59
Add variable, 58
Adding Test Cases to the Visual Script, 49
Analyzing Test Failures, 43
Append to log, 41
Automatic testing node, 39
Automatically run resource validation, 41
Autopilot
Tab options, 22
Browser pane, 14, 16
Chart
View Window, 31
Custom Code, 92, 105
Data Bank
Add binding, 62
Add mapping, 59
Add variable, 58
Auto bind, 69
Auto map, 69
Data Bank fields, 62
Fetch record, 62, 72
file format, 61, 71
Goto record, 64, 74
Mapping variables, 58, 68
Parameters in script, 63, 72
Parameters list, 58, 68
Select external file, 60, 70
Variables list, 59, 69
Data Sources
Adding, 108
Setting Counter alarms, 113
Setting update intervals, 112
Using scripts, 114
Job pane, 18
Jobs
Creating, 82
Editing, 88, 101
Playing Back, 86, 99
Saving, 86, 98
Load Testing
Aborting Virtual Users, 135
Adding a Virtual User Profile, 121
Adding Synchronization Points, 146
Controlling Virtual Users, 133
Creating User-Defined Profiles, 144
e-Reporter Wizard, 138
Generating Reports, 136
Modifying Run Attributes, 133
Multiple Profiles, 121
Performance Vs. Time graph, 131
Performance Vs. Users graph, 130
Performing, 118
Reports in Microsoft Excel, 141
Running Multiple Profiles, 124
Running the Scenario Profile, 120
Saving the Scenario, 123
Scenario Reports, 142
Session Management, 118
Session Reports, 142
Specifying a Scenario Profile, 119
Statistics Vs. Time graph, 132
Stopping Virtual Users, 135
Users Vs. Time graph, 131
Using Autopilot, 120, 124
Viewing Graphs, 130
Viewing Performance Statistics, 127
Viewing Virtual User Actions, 134
Log pane, 32
Main window, 20
Autopilot tab, 22
e-Load, 20
e-Monitor, 23
e-Reporter, 26
e-TEST Console, 23
e-Tester, 14
Features, 14
Scenario tab, 21
ServerStats, 29
Title bar, 20
URL drop down, 14
Index
Run
Section tree node, 145
Save output log, 48
Save visual script, 36
Saving Jobs and Schedules, 86, 98
Scenarios
Tab options, 21
Schedules
Activating, 87, 100
Creating, 82, 85, 97
Editing, 90, 103
Saving, 86, 98
Script pane, 24
Script View, 32
Sections tree
Adding sync points, 146
Adding Visual Scripts, 145
Moving items, 147
Server response test case, 51
ServerStats
Adding data sources, 108
Chart View, 31
Features, 11
Gauge View, 31
Log Files, 32
Log pane, 32
Main window features, 29
Script View, 32
Setting counter alarms, 113
Setting update intervals, 112
Using scripts, 114
Using the chart view, 111
Start Recording, 36
Status pane, 20
Stop recording, 36, 49
Sync points
Adding to profiles, 146
System Requirements, 12
Tabs
Autopilot, 22
Scenario, 21
Virtual User Gird, 22
Test cases
Custom tests, 75
External callout, 53
Form element, 52
Selected text is present, 63
151
152