Sie sind auf Seite 1von 129

TEMS Monitor Master v9.2.

1
Screening Room
User Guide

Document:
Created by:
Status:

MM-0016-D
EWJP
Released

Ascom Network Testing Ltd, 2000-2013


All rights reserved

Ascom Network Testing Ltd., 2000-2013

Page 1 of 129

03 June 2013

Copyright
Ascom Network Testing Ltd, 2000-2013. All rights reserved
Unauthorized copying, distribution and use of the document or its content is strictly prohibited.
Note: In this guide the term "Monitor Master" refers to the Ascom product "TEMS Monitor Master".
All registered trademarks, quotes, products or service names are acknowledged.
Ascom Network Testing Ltd
Ash House, Shackleford Road
Elstead, Surrey GU8 6LB
United Kingdom
Ascom Network Testing Ltd is an Ascom company, part of the Network Testing division.

www.ascom.com

Version Overview
Version

Date

Author

Modification

1.0

25/04/2013

EWJP

Initial release for Monitor Master v9.2.1

1.1

03/06/2013

EWJP

Minor updates

Information in this document is subject to change without notice. For the latest version, please visit
www.ascom.com/temsmonitormaster/support

Document Management
File name:

screening_room.pdf

Pages:

129

Released on:

03/06/2013

Approved by:

AC

Ascom Network Testing Ltd., 2000-2013

Page 2 of 129

03 June 2013

Table of Contents
CHAPTER 1 - INTRODUCTION .................................................................................................................................... 5
SCREENING ROOM OVERVIEW .......................................................................................................................................... 5
LOCAL MODE AND CENTRAL MODE ................................................................................................................................. 6
MAIN MENU OPTIONS ........................................................................................................................................................ 6
OTHER SCHEDULING FACILITIES ........................................................................................................................................ 7
OTHER REPORTING FACILITIES .......................................................................................................................................... 7
THIS GUIDE ....................................................................................................................................................................... 7
RELATED GUIDES .............................................................................................................................................................. 8
CHAPTER 2 - USING SCREENING ROOM ................................................................................................................. 9
LAUNCHING SCREENING ROOM ........................................................................................................................................ 9
USING SCREENING ROOM ............................................................................................................................................... 11
CHAPTER 3 - THE SCREENING ROOM OPTION .................................................................................................. 16
SCREENING ROOM FUNCTIONAL VIEW ........................................................................................................................... 17
SCREENING ROOM MONITORING VIEW ........................................................................................................................... 33
SCREENING ROOM REGRESSION VIEW ............................................................................................................................ 36
CHAPTER 4 - THE PLAN DASHBOARD OPTION ................................................................................................... 41
CREATING THE PLAN DASHBOARD ................................................................................................................................. 41
INTERPRETING THE PLAN DASHBOARD ........................................................................................................................... 44
CUSTOMISING THE PLAN DASHBOARD ............................................................................................................................ 45
MANIPULATING THE PLAN DASHBOARD ......................................................................................................................... 47
COMPARING PLAN DASHBOARD GRAPHS ........................................................................................................................ 47
CUMULATIVE PLAN DASHBOARD GRAPHS ...................................................................................................................... 50
WATCHING PLAN DASHBOARD DATA ............................................................................................................................. 51
CHAPTER 5 - RECENT TESTS & AVAILABILITY ................................................................................................. 53
USING THE RECENT SUCCESS FACTS SCREEN.................................................................................................................. 53
THE RECENT SUCCESS FACTS DISPLAY OPTIONS ............................................................................................................ 53
THE RECENT SUCCESS FACTS FILTERS ........................................................................................................................... 55
THE RECENT SUCCESS FACTS LINKS............................................................................................................................... 55
THE RECENT SUCCESS FACTS REPORT ............................................................................................................................ 55
CHAPTER 6 - METRICS, MESSAGES & TIMINGS ................................................................................................. 57
USING THE RECENT METRICS, MESSAGES OR TIMING FACTS SCREEN ............................................................................ 57
THE RECENT METRIC/TIMING/MESSAGE FACTS DISPLAY OPTIONS ................................................................................ 58
THE RECENT METRIC FACTS SCREEN .............................................................................................................................. 59
THE RECENT TIMING FACTS SCREEN .............................................................................................................................. 61
THE RECENT MESSAGE FACTS SCREEN ........................................................................................................................... 63
CHAPTER 7 - DIMENSIONS ........................................................................................................................................ 67
PLANS ............................................................................................................................................................................. 67
TESTS .............................................................................................................................................................................. 67
TRANSACTIONS ............................................................................................................................................................... 68
METRICS ......................................................................................................................................................................... 68
TIMINGS .......................................................................................................................................................................... 69
MESSAGE TYPES.............................................................................................................................................................. 69
CHAPTER 8 - LOCAL SCHEDULES ........................................................................................................................... 70
LOCAL SCHEDULES ......................................................................................................................................................... 70
ADDING A LOCAL SCHEDULE .......................................................................................................................................... 72
EDITING A LOCAL SCHEDULE.......................................................................................................................................... 75
DELETING A LOCAL SCHEDULE....................................................................................................................................... 76
CHAPTER 9 - DEVICE UPDATE ................................................................................................................................. 77
WHY USE DEVICE UPDATE? ............................................................................................................................................ 77
USING THE DEVICE UPDATE OPTION ................................................................................................................................ 77

Ascom Network Testing Ltd., 2000-2013

Page 3 of 129

03 June 2013

CHAPTER 10 - AGENT RESOURCE MANAGEMENT ............................................................................................ 80


MANAGEMENT OPTIONS .................................................................................................................................................. 80
RESOURCE MANAGEMENT SCRIPTS .................................................................................................................................. 80
RESOURCE MANAGEMENT CONCEPTS .............................................................................................................................. 81
RESOURCE ITEMS ............................................................................................................................................................ 81
RESOURCE USERS............................................................................................................................................................ 85
RESOURCE ALLOCATIONS ............................................................................................................................................... 88
RESOURCE USAGE ........................................................................................................................................................... 92
RESOURCE GRAPHING...................................................................................................................................................... 93
APPENDIX A - RESPONSE CODES............................................................................................................................. 98
HTTP V1.X STATUS CODES .............................................................................................................................................. 98
APPENDIX B - TESTRUN REPORTS ........................................................................................................................ 100
THE HIGH DETAIL CONTENT LISTING ............................................................................................................................. 101
THE MEDIUM DETAIL CONTENT LISTING........................................................................................................................ 102
THE LOW DETAIL CONTENT LISTING .............................................................................................................................. 103
THE COMPLIANCE ERRORS AND BROKEN LINKS REPORT................................................................................................ 104
THE ALL DEVICE ERRORS AND USABILITY REPORT ........................................................................................................ 106
THE COSMETIC DEVICE ERRORS REPORT ....................................................................................................................... 107
THE FUNCTIONAL DEVICE ERRORS REPORT ................................................................................................................... 108
THE OTHER DEVICE ERRORS REPORT ............................................................................................................................. 109
THE USABILITY ERRORS REPORT ................................................................................................................................... 110
THE LOADING REPORT................................................................................................................................................... 111
THE MESSAGES REPORT ................................................................................................................................................ 112
THE USER EVENTS REPORT ............................................................................................................................................ 114
THE METRICS REPORT ................................................................................................................................................... 116
THE RESPONSE DELAY REPORT...................................................................................................................................... 117
THE DELTA TIMINGS REPORT ........................................................................................................................................ 119
THE GRAPHICAL TIMING REPORT................................................................................................................................... 120
THE TEST AND TEST RUN PERFORMANCE REPORT.......................................................................................................... 121
THE TRANSACTION TIMINGS REPORT............................................................................................................................. 123
THE SCRIPT REPORT ...................................................................................................................................................... 124
THE SITE MAP REPORT................................................................................................................................................... 124
THE APPLIED DEVICE TEST CASES REPORT .................................................................................................................... 125
INDEX ............................................................................................................................................................................. 127

Ascom Network Testing Ltd., 2000-2013

Page 4 of 129

03 June 2013

Chapter 1 - Introduction
Note: Screening Room is a legacy tool, retained mainly to support users running scripts in legacy (local) mode;
most Monitor Master QM users should not need to use Screening Room - or read this guide!
In this Chapter:
Screening Room
Local Mode and Central Mode
Main menu options
Other reporting facilities
Other scheduling facilities
This guide
Related guides

Screening Room Overview


Monitor Master Screening Room (also known as the Agent Menu) provides a reporting and management
interface for Monitor Master Agents. It consists of a browser-based menu system that provides convenient access
to the following, for the selected Agent:

Test run results and other data stored on this Agent. The wide range of facilities allows users to view,
explore and produce reports on data to whatever level of detail they wish. Data can also be exported in a
variety of formats for use in other applications.

Scheduling of Local Mode scripts on this Agent.

Device profile updates for this Agent, to keep the device details up to date with the Device Master Live
Server or other trusted authority

Resource management for this Agent, to help avoid conflicts between Local Mode test runs

Ascom Network Testing Ltd., 2000-2013

Page 5 of 129

03 June 2013

Screening Room User Guide

Chapter 1 - Introduction

The Screening Room Home screen


Notice that each Agent has its own separate Screening Room.
Note: Throughout this guide we will use the term Agent rather than "Probe", "Agent Appliance" or" Software
Agent".

Local Mode and Central Mode


In a Monitor Master QM system, scripts are usually saved in Central Mode (to the QM Server) but can also be
saved in Local Mode (to an Agent):

Screening Room provides reports, resource management and scheduling for the Agent's Local Mode
scripts. (The reports can also be used for Central Mode resuilts.)

Quality Manager (QM) provides superior central reports, resource management and scheduling for all
Central Mode scripts. (The reports can also use Local Mode results.)

In a Monitor Master QM system, we strongly recommend the use of Central Mode for all scripts. You should only
use Local Mode (and Screening Room) if QM is not available.
WARNING: Do not schedule both Local Mode and Central Mode tests on the same Agent; the resource
management strategies used are incompatible.

Main menu options


The Screening Room main screen (above) is a menu that provides these main options:

Screening Room - review summaries and details of recent test runs, with drilldown to transaction and
content level. Also provides access to Scheduling facilities for local mode scripts

Plan dashboard - summarise results for specific plans or tests

Ascom Network Testing Ltd., 2000-2013

Page 6 of 129

03 June 2013

Screening Room User Guide

Chapter 1 - Introduction

Recent tests & availability - a tabular summary of recent tests indicating any problems

Metrics, messages and timings - detailed results from multiple tests

Dimensions - view your test data along different dimensions: by plan, test, transaction, metric, timing, or
message type

Device update - download the latest device profiles from the Device Master Live Server

Agent resource management - managing the resources on this Agent to avoid conflicts

Each of these main options has its own chapter later in this guide.

Other scheduling facilities


Monitor Master provides two ways to schedule test runs:

Quality Manager schedules Central Mode scripts to run on single or multiple Agents. These Central
Schedules support both single-party and multi-party scripts

Screening Room schedules Local Mode scripts to run on a single Agent. These Local Schedules do not
support mutli-party Scripts

Other reporting facilities


Monitor Master provides four main reporting interfaces: Box Office, Screening Room, Story Boarder and Projection
Room:

Box Office provides a range of standard Dashboards (reports) for both Agent and Projector results, as well
as development and integration facilities for custom Dashboards. Dashboards can be accessed via the Box
Office GUI, or from the Quality Manager Reporting menu.

Screening Room provides access to all recent test run results (and other data) stored on an Agent.

Story Boarder provides access to summary results for the current test run only. This is mainly intended for
test script developers to test their scripts, but can also be used for ad hoc testing and monitoring in small
installations.

Projection Room provides access to test run results collected from multiple Agents by a Projector, usually
over a much long time period than Screening Room.

Box Office is the recommended reporting interface for all Monitor Master installations.
Note that the results from Local Mode and Central Mode test runs are stored in the same way (on the Agent that
ran the test, and associated Projector).

This guide
This guide consists of the following chapters:

Chapter 1 - Introduction

Chapter 2 - Using Screening Room

Chapter 3 - The Screening Room option

Chapter 4 - The Plan Dashboard option

Chapter 5 - The Recent Tests & Availability option

Chapter 6 - The Metrics, Messages & Timings option

Chapter 7 - The Dimensions option

Ascom Network Testing Ltd., 2000-2013

Page 7 of 129

03 June 2013

Screening Room User Guide

Chapter 1 - Introduction

Chapter 8 - Local Schedules

Chapter 9 - The Device Update option

Chapter 10 - The Agent Resource Management option

It concludes with an Appendix on HTTP return codes and testrun reports.

Related guides
Read the QM User Guide for information on using Central Mode resource management, scheduling and reporting.
Read the Story Boarder User Guide for information on creating and running test scripts, including how to view and
interpret test results.
Read the Projection Room User Guide for information on using legacy enterprise-wide reporting.

Ascom Network Testing Ltd., 2000-2013

Page 8 of 129

03 June 2013

Chapter 2 - Using Screening Room


This chapter describes:

How to launch Screening Room

How to use Screening Room - the general principles

The Home screen menu

Subsequent chapters describe each of the Home screen (main menu) options in turn.

Note: While a standard Monitor Master installation allows all Users to access all the reports and all the data on an
Agent, your system administrator may implement measures to control access to certain types of report and test
data.

Launching Screening Room


You can launch Screening Room:

From Story Boarder

From Internet Explorer

From a Shortcut

From an Agent

Ascom Network Testing Ltd., 2000-2013

Page 9 of 129

03 June 2013

Screening Room User Guide

Chapter 2 - Using Screening Room

Launching Screening Room from Story Boarder


If you are developing Test Scripts, it can be convenient to launch Screening Room from within Story Boarder.
To launch Screening Room from Story Boarder:

Select the View Agent option from the Story Boarder Tools menu or click the View Agent button, to launch
Screening Room for your most recently-used Agent.
Or:

Choose the Select Agent option/button to list the known Agents:

Select the Agent and click OK to launch the Screening Room for that Agent.
(If the Agent is not listed, click Add, type its network address or (routable) name and click OK to add it to
the list.)

Now use View Agent to launch Screening Room for the selected Agent.

Launching Screening Room from Internet Explorer


You can launch Screening Room on any machine on your network (even one without Monitor Master installed) by
typing the appropriate URL in your web browser.
To launch Screening Room from Internet Explorer:

Launch your web browser

In the address bar, type the URL of the Agent you want to connect to, or its (routable) name, followed by
:9090 and press Enter

This will display Screening Room for that Agent

For example, to use an Agent whose address is 10.1.1.85 and URL is agent3.xyz.com, you could type:
http://10.1.1.85:9090/
or
http://agent3.xyz.com:9090/
Or, if the name agent3 is a routable name resolving to this address, you could simply type:
http://agent3:9090/

Launching Screening Room from a Shortcut


Once you have connected to Screening Room (by typing the URL in Internet Explorer), you can create a Shortcut to
make connecting easier in the future.
To create a Screening Room Shortcut:

Connect to Screening Room on the Agent you want to use by typing its URL (example)

Ascom Network Testing Ltd., 2000-2013

Page 10 of 129

03 June 2013

Screening Room User Guide

Chapter 2 - Using Screening Room

Once the Screening Room Home page is displayed, select the Add to Favorites option from your Browser's
Favorites menu.

Edit the name if you wish, then click OK to add it your main Favorites menu. (Refer to your Browser Help
for the other options.)

You can now launch the Screening Room for this Agent by selecting this option from the Favorites menu.
To add the Shortcut to your desktop:

Select the option from the Browser's Favorites menu and drag it to the desktop.

You can now launch the Screening Room for that Agent by double-clicking the desktop shortcut.

Launching Screening Room from an Agent


If you are logged in on an Agent, you can use an installed Shortcut to launch its Screening Room.
To launch Screening Room from the Agent:

Click the Start button and select the option Ascom/TEMS Products / TEMS Monitor Master Servers /
Server Reports / Script Server Database Reports

This will launch the Screening Room for that Agent

Using Screening Room


Once you have launched an Agent's Screening Room , you can use it to produce a wide range of reports, schedule
tests, update device profiles, and manage resources for this Agent. These functions are described in detail in
subsequent chapters; this section describes the basic concepts and facilities you'll need to use Screening Room:
Controls
Printing
Data export
Refresh control
The Home screen

Screening Room Controls


Screening Room is a web-based interface, so many of the facilities and controls should be very familiar already, as
they are provided by your Web Browser.
For example:

Underlined text signifies a hyperlink - click it to follow the link

To return to a previous screen, use the Browser's Back button

To print the current screen, use the Browser's Print button or Print command (in the File menu) - see
Printing

Ascom Network Testing Ltd., 2000-2013

Page 11 of 129

03 June 2013

Screening Room User Guide

Chapter 2 - Using Screening Room

To use more of your screen for results, you can hide toolbars by selecting options from the View menu

If a panel has scrollbars, use them to scroll the content in that panel

And so on.
Screening Room uses a few controls that you might not know:

Many report windows have a refresh control in the top right corner. You can use this to choose how often
the displayed results will be updated (by fetching new data from the Agent) - see Refresh control

The refresh control

A button means there's more information hidden below this item; click the button to reveal it; a
means you can hide the information below this item; click the button to hide it.

Many window elements are "hot" i.e. hyperlinked. If the mouse pointer changes from an arrow to a hand
while over an element, you can click it to link to related information.

Column header buttons are displayed along the top of most tables, like this:

button

These have two main functions: to show what data is in that column, and to control how the table is sorted.
Click a button to sort the table on that column; click it again to reverse the sort order. A triangle shows the
sort column and sort direction

Windows are divided up into panels by narrow borders. You can drag these borders to change the panel's
size.

Each panel has its own right-click (popup) menu, providing access to a range of useful facilities for that
panel and its contents.

When you select an option from a dropdown list, its name is also displayed on the Browser status bar - to
help you choose names that are too long to fit in the list.

Printing Screening Room Reports


Printing uses the standard Browser facilities:

Use File/Page Setup to configure the printer and paper

Use File/Print Preview to preview (check) the output

Use File/Print to choose print options and begin printing

Each Screening Room screen is implemented as a frameset i.e. a group of frames (which we call panels here), so the
print options tab provides useful options to:

Print as laid out on screen

Print the selected frame only

Print all the frames, individually

To print the contents of a single panel:

Right-click in the panel to display a popup menu like this:

(Some menus have additional options, but they all have this row of buttons along the bottom.)

Click the Print panel button,

Ascom Network Testing Ltd., 2000-2013

Page 12 of 129

03 June 2013

Screening Room User Guide

Chapter 2 - Using Screening Room

(This facility is provided by the Screening Room screens: Functional, Regression, and Monitoring views.)

Exporting Screening Room Reports


Screening Room provides a range of facilities to export the current report (as shown on-screen), in different data
formats, for input to other applications.
The Screening Room screens (Functional, Regression, and Monitoring views) display multiple related data streams
in separate panels. To output the contents of a panel:

Right-click within the panel to display a popup menu ending with these buttons:

Click the Open in Excel button,


to output the data in Excel (spreadsheet) format. You can choose
whether to Open or Save the data. Open will display it as an embedded spreadsheet, in the same panel;
Save will output the data to the Excel format file you specify.

Click the Open as XML button,


to output the data in XML format, in another Browser window for you
to view, print, save etc using the standard Browser facilities.

The other screens (Recent facts, Dimensions, Dashboard and Metrics/ Messages/ Timings) present a single data
stream, so you can output the whole screen. In the top right corner of the screen is a menu of output formats.
Choose the format you want:

Raw XML will output simple XML to the Browser window

Rich XML will output semantically richer XML to the Browser window

CSV will output comma separated values to the Browser window

Excel will output an Excel format spreadsheet. You will be asked whether to Open or Save the data. Open
will display it as an embedded spreadsheet, in the current screen; Save will output the data to the Excel
format file you specify.

Table will output the data to a specified Table.

Refresh control
Most reporting screens have a Refresh control in the top right corner:

Ascom Network Testing Ltd., 2000-2013

Page 13 of 129

03 June 2013

Screening Room User Guide

Chapter 2 - Using Screening Room

You can use this to choose how often to update the screen, to reflect new results logged by the Agent. The options
are:

Never refresh - the default


Refresh now
Refresh every 3 seconds - see warning below
Refresh every 15 seconds
Refresh every 1 minute
Refresh every 5 minutes
Refresh every 15 minutes
Refresh every hour

Warning: The shorter refresh times should only be used for short periods, when you really them, as each refresh
requires significant additional processing by the Agent. Refreshing every 3 seconds may disrupt the Agent's main
task of running Tests and collecting Testrun data.
However, note that certain reports specify a fixed time period to report on. Once you're past the period end, the
report on the screen will no longer change when refreshed, because there will be no more new data for the selected
period! To avoid this problem, either choose an end period in the future, edit the end date at regular intervals, or
use a report with a moving time window such as the Watch facility or Recent test & availability report.

Using the Screening Room Home screen


The Home screen is displayed when you launch Screening Room:

It offers your main menu, with seven main options:

Screening Room - use to review details of previous test runs, see Chapter 3, Screening Room option. Also
provides access to the test scheduling facilities - see Chapter 8, Local Schedules

Plan dashboard - use to summarize results for specific plans or tests. Also provides direct links to recentlyadded plans. See Chapter 4, Plan Dashboard option

Ascom Network Testing Ltd., 2000-2013

Page 14 of 129

03 June 2013

Screening Room User Guide

Chapter 2 - Using Screening Room

Recent tests & availability - a tabular summary of recent tests. Also provides direct links to recent failed
tests. See Chapter 5, Recent Tests & Availability option

Metrics, messages and timings - detailed results from multiple tests. See Chapter 6, Metrics, Messages and
Timings option

Dimensions - view your test data along different dimensions: by plan, test, transaction, metric, timing, or
message type. See Chapter 7, Dimensions options

Device update - download the latest device profiles from the main Device Master Live Server. See Chapter
9, Device Update option

Agent resource management - managing the resources on this Agent to avoid conflicts. See Chapter 10,
Agent Resource Management option

You can return to the Home screen from most other Screening Room screens by clicking the Home link, in the top
right corner of the screen.

Ascom Network Testing Ltd., 2000-2013

Page 15 of 129

03 June 2013

Chapter 3 - The Screening Room option


You can launch any of the three Screening Room reports by clicking their links on the Screening Room Home
Screen:

They provide detailed information on individual test runs:

Click Functional to review results from functional testing

Click Monitoring to review results from service monitoring

Click Regression to compare results from regression testing

Once you've selected a view, you can switch easily to another view:

Right-click anywhere in the Monitor Master banner near the top of the window:

Ascom Network Testing Ltd., 2000-2013

Page 16 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

This will display a popup menu:

Choose the view you want (Functional, Monitoring, or Regression), or click Agent home to return to the
Home (main menu) screen.

Each view will now be described in detail in its own section. They have a lot in common so to avoid repetition, we
will describe Functional View in detail, then describe how Monitoring View and Regression View differ.

Screening Room Functional View


Functional View is designed to help you review results from functional testing, allowing you to summarize results
across all plans, focus on particular plans or tests, and drill right down into the details of an individual test run.
To launch Functional View:

Select the Functional link from the Screening Room Home screen
Or

To switch from Regression View or Monitoring View: right-click near the top of the Screening Room
window (on the Monitor Master banner) to display a popup menu and select the Functional view option

In Functional View, results are displayed in seven separate panels:

Ascom Network Testing Ltd., 2000-2013

Page 17 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

The panels are:


1.
2.
3.
4.
5.
6.
7.

Plans and Tests


Test Runs
Testrun Summary
Content
Content Summary
Content Detail
Preview

Panels 3-7 are empty initially. They display details of a testrun once you've selected one in the Test Runs panel.

Plans and Tests panel (1)


The top left panel in Screening Room's Functional View is Plans and Tests, a hierarchical view of the Plans and
Test Scripts on this Agent:

You can use this view to list and manage the Plans, Tests and Schedules on this Agent. You can also use it to help
select testruns to report on.
To list the Test Scripts within a Plan:

Click the Plan's

button. (To hide them again, click its

button.)

To list the scheduled Test Runs within a Plan:

Click the

button on its Schedules folder. (If there is no Schedules folder, the Plan has no schedules.)

To list all schedules on this Agent:

Ascom Network Testing Ltd., 2000-2013

Page 18 of 129

03 June 2013

Screening Room User Guide

Click the

Chapter 3 - The Screening Room option

button on the Agent schedules folder (this folder is listed after all the Plan folders).

To select all Test Runs on this Agent:

Click the This agent folder. Details will be displayed in the Test Runs panel.

To select Test Runs for a specific Plan, Test, or Schedule:

Click its name. Details will be displayed in the Test Runs panel.

In a Plan folder, scheduled Tests are indicated by a small clock in the icon:
- Test is not scheduled (no clock)
- Test is scheduled but schedule is disabled
- Test is scheduled and schedule is enabled
In the Plans' Schedules folders and Agent schedules folder Schedule status is shown by icon color:
- Schedule is enabled
- Schedule is disabled
For information on creating and maintaining Schedules, see Chapter 8, Local Schedules.
Popup menus
If you right-click anything within this panel you will see a popup menu with four buttons along the bottom:
Refresh panel - fetch new data from the Agent and redisplay the panel using it
Print panel - print the panel as a report. Displays the standard Print options dialog
Open as Excel - output the data in Excel (spreadsheet) format. You can choose to Open the data
(display it as an embedded spreadsheet, in the same panel) or Save the data (output to a Excel format file
you specify)
Open as XML - output the data in XML format, in another Browser window. You can then view, print,
or save it using the standard Browser facilities
The other options, at the start of the menu, are used to manipulate the selected item, as follows.
Agent popup menu
If you right-click This agent, the popup menu also offers:

Agent home - move to the Home screen (main menu)

Agent reports - displays the Report on Agent dialog. Select the type of report required, then click Launch:

Plan and resource usage - show resource usage by all schedules on this Agent, useful for seeing
detecting conflicts

Available devices - list of devices in the Agent's device database

Applied compliance test cases - lists the compliance tests applied to devices in the Agent's device
database

Current licence violations - lists any attempted violations of your Monitor Master license

Projector outbox - lists the contents of the Projector outbox

Recent logs - display a log for this Agent, showing all recent requests (from clients) and responses (from the
Agent). This log is mainly intended for diagnostic purposes

Ascom Network Testing Ltd., 2000-2013

Page 19 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

Plan popup menu


If you right-click a Plan, the popup menu also offers:

Plan dashboard - display the Dashboard for this Plan (see Using Plan Dashboard)

Delete this plan - from this Agent. Use with caution! Deleting a Plan will remove all its Test Scripts and
Testrun results from the Agent!

Test popup menu


If you right-click a Test, the popup menu also offers:

Test dashboard - display the Dashboard for this Test (this is the same as the Plan Dashboard, but with the
Plan and Test pre-selected - see Plan Dashboard reports).

Run test - displays the Run Test dialog for you to confirm (or change) the test selected, supply runtime
parameters, and enable or disable routing of results to Projector. Click OK to run the Test Script - results will
be displayed in the Testrun pane.

Edit test - displays the Edit Test dialog for you to confirm (or change) the test selected. Click OK to edit the
Test Script.

Move test - displays the Move Test dialog for you to confirm (or change) the test selected and choose the
Plan to move it to. Click OK to move the Test Script and associated results.

Delete test - from this Plan. Use with caution! Deleting a Test will delete its script and all its testrun results
from this Agent.

Schedules folder popup menu


If you right-click the Schedules folder (within a Plan) or the Agent schedules folder, the popup menu also offers:

Add schedule - see Chapter 8, Local Schedules for details

Schedule popup menu


If you right-click a schedule, the popup menu also offers:

Edit schedule - see Chapter 8, Local Schedules for details

Delete schedule - see Chapter 8, Local Schedules for details

Test Runs panel (2)


The top right panel in Screening Room's Functional View is Test Runs. Across the top of the panel are three
dropdown lists and a
(Go) button, which are used to select the information to display in the remainder of the
panel:

Use the first dropdown list to chose how to view your results:

Tabular summary of - view a tabular summary of all results from the selected tests, and grand totals.
Provides a detailed numerical summary of results in table form - see The tabular summary view

Ascom Network Testing Ltd., 2000-2013

Page 20 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

Extended summary of - view a graphical summary of all results from the selected tests, and grand totals.
Provides an "at a glance" summary of results in pie chart form - see The extended summary view

Each testrun from - (default) view a list of individual testruns, showing detailed results for each. Allows
you to quickly select a testrun of interest and drill down into its results, content, metrics, diagnostics, etc. see The each testrun view

Use the second dropdown list to select the results (testruns) to view. The options are:

No plan - don't display anything

All tests and plans on this agent - (default) all runs of all Tests on this Agent

Plan names - all runs of Tests in this Plan

Test names - all runs of this Test

(You can also select the results to view by selecting a Plan or Test from the Plans and Tests panel.)
Use the third dropdown list to select the time period to report on. The options, which are self-explanatory, are:

without time filter


for the last 1 hour (default)
for the last 24 hours
for the last 7 days
for the last 31 days
for the last 365 days

Click the

button to create a new report with your currently selected options.

The "tabular summary" view


The tabular summary view provides a numerical summary of all results for the selected tests, like this:

The table starts with grand totals (for all selected tests), followed by a row for each selected test, displaying:

Plan - the Plan name


Test - the Test name
Completion - percent of testruns completed
Service - percent of testruns with 100% service availability
System - percentage of testruns with 100% system availability
First - the date of the first testrun
Last - the date of the last testrun
Fastest - the shortest run time (seconds)
Slowest - the longest run time (seconds)
Average - the average run time (seconds)
Runs - the number of testruns of this test

To sort by a column:

Click the column heading

Click the column headings again to reverse the sort direction.

Ascom Network Testing Ltd., 2000-2013

Page 21 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

To display a test's test runs in the "each testrun" view:

Click that row

Right-click anywhere in the panel to display a popup menu with these options:
Tear-off - view the panel in another browser window
Refresh panel - fetch new data from the Agent and redisplay the panel using it
Print panel - print the panel as a report. Displays the standard Print options dialog
Open as Excel - output the data in Excel (spreadsheet) format. You can choose to Open the data
(display it as an embedded spreadsheet, in the same panel) or Save the data (output to a Excel format file
you specify)
Open as XML - output the data in XML format, in another Browser window. You can then view, print,
or save it using the standard Browser facilities
The "extended summary" view
The extended summary view provides a graphical summary of results for the selected tests, like this:

The first row is a grand total for all the selected testruns. Each subsequent row summarises results for a different
selected test.
The information shown is:

Plan - the Plan name


Test - the Test name
A description of the test
Completion - pie chart showing percentage of testruns completed
Service - pie chart showing percentage of testruns with 100% service availability
System - pie chart showing percentage of testruns with 100% system availability
First - the date of the first testrun
Last - the date of the last testrun
Fastest - the shortest run time (seconds)
Slowest - the longest run time (seconds)
Average - the average run time (seconds)
Runs - the number of testruns of this test

Click a row to display that test's runs in the "each testrun" view.
Right-click anywhere in the panel to display a popup menu with these options:
Tear-off - view the panel in another browser window

Ascom Network Testing Ltd., 2000-2013

Page 22 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

Refresh panel - fetch new data from the Agent and redisplay the panel using it
Print panel - print the panel as a report. Displays the standard Print options dialog
Open as Excel - output the data in Excel (spreadsheet) format. You can choose to Open the data
(display it as an embedded spreadsheet, in the same panel) or Save the data (output to a Excel format file
you specify)
Open as XML - output the data in XML format, in another Browser window. You can then view, print,
or save it using the standard Browser facilities
The "each testrun" view
The each testrun view lists individual testruns in the selected sort order and provides facilities to drill down to
content, metrics, etc. for a selected testrun:

To change the sort order, simply click the column button to sort by.
To drill down, select a testrun by clicking it - this will display details about the run in the Testrun Summary and
Contents panels, described below.
The data shown is as follows:

100 rows - the run ID

Plan - the name of the Plan this Script was run from

Test - the name of the Script

Device - the device profile used

Cmp - (completion) an icon indicating whether the run completed (green) or failed (red). A red icon
suggests a problem with the test script

Srv - (service) an icon indicating whether the service was available for the entire run (green) or not (red) or
unknown (grey). A red icon suggests a problem with the service under test

Sys - (system) an icon indicating whether the test system was available for the complete run (green) or not
(red) or unknown (grey). A red icon suggests a problem with the test system

Start - the date and time the run started

End - the time the run ended

Duration - how long the test ran for. A red background indicates a long run, while a green background
indicates a short run

State - whether the run succeeded, failed, was canceled or terminated due to a scripting error

Status - indicates if the test is still running

Content - how many content items were downloaded

Owner - the user ID and IP address of whoever ran the test. Tests that were run manually (from Story
Boarder) or by a Local Schedule will be listed as owned by SYSTEM (the IP address should help identify the
owner)

Location - if specified, a description of the location of the test run (Agent)

GPS - if available (via a GPS system), the co-ordinates where the test was run. This information is mainly
used by mobile test systems

Ascom Network Testing Ltd., 2000-2013

Page 23 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

Entrypoint - where the test started

The panel will normally display up to 100 test runs (rows). To change the number:

Click the 100 rows link

Type the number of rows to display, then click OK.

Popup menu
Right-click any testrun in the Test Runs Panel to display this popup menu:

Use the first three options (Mark all, Mark incompletes, and Unmark all) to mark testruns. You can also
mark or unmark runs by clicking the checkbox at the start of each line

Use Report marked to create a report combining the marked runs. This displays the Report Testrun dialog,
for you to select the report type, from:

High detail content listing


Medium detail content listing
Low detail content listing
Compliance errors and broken links
All device errors and usability
Cosmetic device errors
Functional device errors
Other device errors
Usability errors
Loading
Messages
User events
Metrics
Response delay
Delta timings
Graphical timing
Test and test run performance
Transaction timings
Script
Site map
Applied device test cases

Note: To see an example of each of the above reports, see Appendix B: Testrun Reports.

Ascom Network Testing Ltd., 2000-2013

Page 24 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

Use Stop marked to stop the marked testruns.

Use Delete marked to delete the marked testruns.

The small buttons along the bottom of the menu are as follows:
View detail - view testrun details in the Testrun Summary and Content panels
View detail tear-off - view testrun details in another browser window
Refresh panel - fetch new data from the Agent and redisplay the panel using it
Print panel - print the panel as a report. Displays the standard Print options dialog
Open as Excel - output the data in Excel (spreadsheet) format. You can choose to Open the data
(display it as an embedded spreadsheet, in the same panel) or Save the data (output to a Excel format file
you specify)
Open as XML - output the data in XML format, in another Browser window. You can then view, print,
or save it using the standard Browser facilities

You can also display details of a testrun (in the Testrun Summary panel and Content panel) by double-clicking it.

Testrun Summary panel (3)


The bottom left panel in Screening Room's Functional View is Testrun Summary. This shows the following for the
Test Run that you've selected in the Test Runs panel::

A Testrun summary for this run:

The Completion/service/system icons indicate whether the run completed and whether the service and
system were available for the entire run. Red icons indicate possible problems with the script, service, and
test system.

A Meta tags table, listing the meta tags for the testrun (information about the testrun rather than the results
it produced):

Ascom Network Testing Ltd., 2000-2013

Page 25 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

A Transactions Graph, showing the time taken by each Transaction (e.g. Scene) in the script. Green bars are
successful Transactions, red bars are failed Transactions.

A Transactions Table, showing data for the Transaction selected in the graph. Initially, the main
Transaction (the entire testrun) is selected; to choose another, click its bar on the graph

A Content timings graph, showing the time taken to transfer each content item.

Ascom Network Testing Ltd., 2000-2013

Page 26 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

Popup menu
Right-click anywhere in the Testrun Summary panel to display a popup menu with these buttons:
Report testrun - display a menu of all the other reports available for this testrun. Select the report you
want and click Launch to run it.
New Screening Room - open the current report on another Screening Room window
Tear-off - view panel in another browser window
Refresh panel - fetch new data from the Agent and redisplay the panel using it
Print panel - print the panel as a report. Displays the standard Print options dialog
Open as Excel - output the data in Excel (spreadsheet) format. You can choose to Open the data
(display it as an embedded spreadsheet, in the same panel) or Save the data (output to a Excel format file
you specify)
Open as XML - output the data in XML format, in another Browser window. You can then view, print,
or save it using the standard Browser facilities

Content panel (4)


The top right panel in Screening Room's Functional View is Content.

The Content panel lists the content items downloaded for the selected Test Run, showing the following for each
item:

ID: Its ID

Ascom Network Testing Ltd., 2000-2013

Page 27 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

If the content has been analysed by using the Basic Content Tests Scene or MobileOK Scene, you'll see 5
additional columns:

OK: content analysis overview:


red means the item has failed (includes errors or failures);
green means it has passed (includes passes but no failures or errors);
yellow means the contents passed but there were device/compliance errors, OR there were content
analysis warnings but no errors or passes;
white means it has not been analysed (does not include any passes or failures) - typically because
there was no content to analyse

CAP: the number of Content Analysis Passes for this item

CAF: the number of Content Analysis Failures for this item

DE: the number of Device Errors for this item

CE: the number of Content Errors for this item

Content: A description e.g. its URL

Time: The time the download started

Device: The name of the device profile being tested

MIME: The content MIME type

Charset: Its character set

Delay: the time it took to download

Indicative Size: its approximate size

Indicative Rate: its approximate download rate

Note: If any content pages includes a redirection command, Monitor Master turns it off (by replacing the command
with a null command), so you stay on the intended page when you view it. You can turn redirection for the entire
web site on or off by right-clicking any content from it and selecting the appropriate option from the popup menu.
Popup menu
Right-click a content item to display a popup menu with these buttons:
Launch raw content - view content in the appropriate viewer, if there is one installed on this computer
Start replay - view details of each content item in turn (as if you had clicked each one in turn)
View detail - view details of this item in the Content Summary, Content Detail and Preview panels
View detail tear-off - view details of this item in another browser window
Refresh panel - fetch new data from the Agent and redisplay the panel using it
Print panel - print the panel as a report. Displays the standard Print options dialog
Open in Excel - output the data in Excel (spreadsheet) format. You can choose to Open the data
(display it as an embedded spreadsheet, in the same panel) or Save the data (output to a Excel format file
you specify)
Open as XML - output the data in XML format, in another Browser window. You can then view, print,
or save it using the standard Browser facilities

Ascom Network Testing Ltd., 2000-2013

Page 28 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

You can also view details of a content item (in the Content Summary, Content Detail and Preview panels) by
clicking it.

Content summary panel (5)


The Screening Room's Functional View Content summary panel displays a summary of the content item you've
selected in the Content panel, under these headings:

Content Summary - time sent, character set, delay (time taken), size and rate

Timings - times (clock times) and delays (time taken) for the associated transaction(s)

Metrics - bytes sent/received, service and system availability, etc. for the associated transaction(s)

Messages - messages from the associated transaction(s), if any were issued

Compliance Errors - any compliance errors reported for this content

For example:

Ascom Network Testing Ltd., 2000-2013

Page 29 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

Popup menu
Right-click anywhere in the pane to display a popup menu with these buttons:
Tear-off - view panel in another browser window
Refresh panel - fetch new data from the Agent and redisplay the panel using it
Print panel - print the panel as a report. Displays the standard Print options dialog
Open in Excel - output the data in Excel (spreadsheet) format. You can choose to Open the data
(display it as an embedded spreadsheet, in the same panel) or Save the data (output to a Excel format file
you specify)
Open as XML - output the data in XML format, in another Browser window. You can then view, print,
or save it using the standard Browser facilities

Ascom Network Testing Ltd., 2000-2013

Page 30 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

Content detail panel (6)


The Screening Room's Functional View Content detail panel displays the data in the content item you've selected
in the Content panel, under these headings:

Request headers - the headers used to request this content

Response headers - the headers used to deliver this content

Response binary - the content as hexadecimal bytes

Response XML - the content as XML

For example:

Ascom Network Testing Ltd., 2000-2013

Page 31 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

Popup menu
Right-click anywhere in the panel to display a popup menu with these buttons:
Tear-off - view panel in another browser window
Refresh panel - fetch new data from the Agent and redisplay the panel using it
Print panel - print the panel as a report. Displays the standard Print options dialog
Open in Excel - output the data in Excel (spreadsheet) format. You can choose to Open the data
(display it as an embedded spreadsheet, in the same panel) or Save the data (output to a Excel format file
you specify)
Open as XML - output the data in XML format, in another Browser window. You can then view, print,
or save it using the standard Browser facilities

Preview panel (7)


The Screening Room's Functional View Preview panel renders the content item you've selected in the Content
panel as it would be shown on the device. For example:

Ascom Network Testing Ltd., 2000-2013

Page 32 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

Popup menu
This panel does not have its own popup menu. If you right-click it you will see the standard Browser popup menu.

Screening Room Monitoring View


Monitoring View is designed to help you monitor services.
To launch Monitoring View:

Select the Monitoring link from the Screening Room Home screen
Or

To switch from Regression View or Functional View: right-click near the top of the Screening Room window
(on the Monitor Master banner) to display a popup menu and select the Monitoring view option

In Monitoring View, the results are displayed in three separate panels:

Ascom Network Testing Ltd., 2000-2013

Page 33 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

The panels are:


1.
2.
3.

Plans and Tests


Test Runs
Testrun Summary

Plans and Tests panel (1)


The top left panel in Screening Room's Monitoring View is Plans and Tests, a hierarchical view of the Plans and
Test Scripts on this Agent which you can use to list and manage the Plans, Tests and Schedules on this Agent. You
can also use it to help select the testruns to monitor:

To list the Test Scripts within a Plan:

Click the Plan's

button. To hide them again, click its

button

To list the scheduled Test Runs within a Plan:

Click the

button on its Schedules folder. (If there is no Schedules folder, the Plan has no schedules.)

To list all Schedules on this Agent:

Click the

button on the Agent schedules folder. (This folder is listed after all the Plan folders).

To select all Test Runs on this Agent:

Click the This agent folder. Details will be displayed in the Test Runs panel.

To select Test Runs for a specific Plan, Test, or Schedule:

Click its name. Details will be displayed in the Test Runs panel.

Ascom Network Testing Ltd., 2000-2013

Page 34 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

For details of the Plans and Tests panel, refer to its description in Functional View.

Test Runs panel (2)


The top right panel in Screening Room's Monitoring View is Test Runs.

Across the top of the panel are three dropdown lists and a button, which are used to select the information to
display in the remainder of the panel:
Use the first dropdown list to chose how to view your results:

Tabular summary of - view a tabular summary of all results from the selected tests, and grand totals.
Provides a detailed numerical summary of results in table form

Extended summary of - view a graphical summary of all results from the selected tests, and grand totals.
Provides an "at a glance" summary of results in pie chart form

Each testrun from - view a list of individual testruns, showing detailed results for each. Allows you to
quickly select a testrun of interest and drill down into its results, content, metrics, diagnostics, etc.

The each testrun view is most often used for monitoring.


Use the second dropdown list to select the results (testruns) to view. The options are:

No plan - don't display anything

All tests and plans on this agent - all runs of all Tests on this Agent

Plan names - all runs of Tests in this Plan

Test names - all runs of this Test

(You can also select the results to view by selecting a Plan or Test from the Plans and Tests panel.)
Use the third dropdown list to select the time period to report on. The options, which are self-explanatory, are:

without time filter


for the last 1 hour
for the last 24 hours
for the last 7 days
for the last 31 days
for the last 365 days

Click the

button to create a new report with your currently selected options.

Key facilities

Use the three dropdown lists across the top of the pane to select the view type (numerical summary,
graphical summary, or each testrun), the tests to view results for, and the period to view results for - then
click the
button. The each testrun view is best for monitoring.

Sort on any column by clicking the column heading

Click any testrun (in "each testrun" view) to display details in the Testrun Summary panel - described next.

Ascom Network Testing Ltd., 2000-2013

Page 35 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

For details of the Test Runs panel, refer to its description in Functional View.

Testrun Summary panel (3)


The bottom left panel in Screening Room's Monitoring View is Testrun Summary, which shows the following for
the selected Test Run:

A Testrun summary for this run. The Completion/service/system icons indicate whether the run completed
and whether the service and system were available for the entire run. Red icons indicate possible problems
with the script, service, or test system.

A Meta tags table, listing the meta tags for the testrun (information about the testrun rather than the results
it produced).

A Transactions graph showing the time taken by each transaction (e.g. Scene) in the script.

A Transactions table showing metrics and messages for the selected transaction (e.g. Scene). (Click a
transaction's bar in the Transactions graph to select it.)

A Content timings graph, showing the time taken to transfer each content item.

For details of the Testrun Summary panel, refer to its description in Functional View.

Screening Room Regression View


Regression View is designed to help users with regression testing, by making it easy to compare results from two
separate test runs (e.g. before and after the change you're testing).
To launch Regression View:

Select the Regression link from the Screening Room Home screen
Or

To switch from Monitoring View or Functional View: right-click near the top of the Screening Room
window (on the Monitor Master banner) to display a popup menu and select the Regression view option

In Regression View, the results are displayed in six separate panels:

The panels are:


1.

Plans and Tests

Ascom Network Testing Ltd., 2000-2013

Page 36 of 129

03 June 2013

Screening Room User Guide

2.
3.
4.
5.
6.

Chapter 3 - The Screening Room option

Test Runs
Testrun Summary (lhs)
Content (lhs)
Testrun Summary (rhs)
Content (rhs)

Plans and Tests panel (1)


The top left panel in Screening Room's Regression View is Plans and Tests, a hierarchical view of the Plans and
Test Scripts on this Agent which you can use to list and manage the Plans, Tests and Schedules on this Agent. You
can also use it to help select the testruns to compare:

To list the Test Scripts within a Plan:

Click the Plan's

button. To hide them again, click its

button

To list the scheduled Test Runs within a Plan:

Click the

button on its Schedules folder. (If there is no Schedules folder, the Plan has no schedules.)

To list all Schedules on this Agent:

Click the

button on the Agent schedules folder (this folder is listed after all the Plan folders).

To select all Test Runs on this Agent:

Click the This agent folder. Details will be displayed in the Test Runs panel.

To select Test Runs for a specific Plan, Test, or Schedule:

Click its name. Details will be displayed in the Test Runs panel.

For details of the Plans and Tests panel, refer to its description in Functional View.

Test Runs panel (2)


The top right panel in Screening Room's Regression View is Test Runs.

Across the top are three dropdown lists and a button, used to select the information to display in the remainder of
the panel:
Use the first dropdown list to choose how to view your results:

Ascom Network Testing Ltd., 2000-2013

Page 37 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

Tabular summary of - view a tabular summary of all results from the selected tests, and grand totals.
Provides a detailed numerical summary of results in table form

Extended summary of - view a graphical summary of all results from the selected tests, and grand totals.
Provides an "at a glance" summary of results in pie chart form

Each testrun from - view a list of individual testruns, showing detailed results for each. Allows you to
quickly select a testrun of interest and drill down into its results, content, metrics, diagnostics, etc.

The each testrun view is the one most often used for regression testing.
Use the second dropdown list to select the results (testruns) to view. The options are:

No plan - don't display anything

All tests and plans on this agent - all runs of all Tests on this Agent

Plan names - all runs of Tests in this Plan

Test names - all runs of this Test

(You can also select the results to view by selecting a Plan or Test from the Plans and Tests panel.)
Use the third dropdown list to select the time period to report on. The options, which are self-explanatory, are:

without time filter


for the last 1 hour
for the last 24 hours
for the last 7 days
for the last 31 days
for the last 365 days

Click the

button to apply your currently-selected options. For example:

Key facilities

Use the three dropdown lists across the top of the pane to select the view type (numerical summary,
graphical summary, or each testrun), the tests to view results for, and the period to view results for - then
click the
button. The each testrun view is best for regression testing.

Sort on any column by clicking the column heading

Click any testrun (in the each testrun view) OR right-click it and click the
View detail (LHS) button in
the popup menu to display the results and content from a Test Run in the Testrun Summary and Content
panels on the left-hand side

Right-click any testrun (in the each testrun view) and click the
View detail (RHS) button in the popup
menu to display the results and content for another Test Run in the Testrun Summary and Content panels
on the right-hand side - producing a display like this

Ascom Network Testing Ltd., 2000-2013

Page 38 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

For details of the Test Runs panel, refer to its description in Functional View.
Popup menu
Right-click a testrun to display this popup menu for it:

Use the first three options (Mark all, Mark incompletes, and Unmark all) to mark testruns. You can also
mark or unmark a testrun by clicking the checkbox at the start of its row

Use Report marked to create a report combining the marked runs. This displays the Report Testrun dialog,
for you to select the report type.

Use Stop marked to stop the marked testruns.

Use Delete marked to delete the marked testruns.

The small buttons along the bottom of the menu are as follows:
View details (LHS) - view the testrun details in the left-hand Testrun Summary and Content panels
View detail (RHS) - view the testrun details in the left-hand Testrun Summary and Content panels
Refresh panel - fetch new data from the Agent and redisplay the panel using it
Print panel - print the panel as a report. Displays the standard Print options dialog
Open as Excel - output the data in Excel (spreadsheet) format. You can choose to Open the data
(display it as an embedded spreadsheet, in the same panel) or Save the data (output to a Excel format file
you specify)

Ascom Network Testing Ltd., 2000-2013

Page 39 of 129

03 June 2013

Screening Room User Guide

Chapter 3 - The Screening Room option

Open as XML - output the data in XML format, in another Browser window. You can then view, print,
or save it using the standard Browser facilities
You can also view details of a testrun (in the left-hand Testrun Summary and Content panel) by double-clicking it.

Testrun Summary panels (3, 5)


Screening Room's Regression View Testrun Summary panels show the following for the selected Test Runs:

A Testrun summary for this run. The Completion/service/system icons indicate whether the run completed
and whether the service and system were available for the entire run. Red icons indicate possible problems
with the script, service, or test system.

A Meta tags table, listing the meta tags for the testrun (information about the testrun rather than the results
it produced)

A Transactions graph showing the time taken by each transaction (e.g. Scene) in the script.

A Transactions table showing metrics and messages for the selected transaction (e.g. Scene). (Click a
transaction's bar in the Transactions graph to select it.)

A Content timings graph, showing the time taken to transfer each content item.

For details of the Testrun Summary panel, refer to its description in Functional View.

Content panels (4, 6)


Screening Room's Regression View Content panels list the content items downloaded for the selected Test Runs,
showing the following for each item:

ID: Its ID

Content: A description e.g. its URL

Time: The time the download started

MIME: The content MIME type

Charset: Its character set

Delay: the time it took to download

Indicative Size: its approximate size

Indicative Rate: its approximate download rate

For details of the Content panel, refer to its description in Functional View.

Ascom Network Testing Ltd., 2000-2013

Page 40 of 129

03 June 2013

Chapter 4 - The Plan Dashboard option


The Screening Room Plan dashboard option creates a visual dashboard consisting of graphs that summarise
results from multiple testruns from a Plan, making it easy for you get a broad view.

Creating the Plan Dashboard

Interpreting the Plan Dashboard

Customising the Plan Dashboard

Manipulating the Plan Dashboard

Comparing graphs

Cumulative graphs

Watching data

Creating the Plan Dashboard


To create the Plan Dashboard:

Click the Plan dashboard option on the Screening Room Home screen:

You will now be taken through a sequence of steps to select the Plan and information you're interested in.
Hint: If you want to go back to change your mind, use your Browser's Back button or click the underlined
link for the step to return to - for example, click the Select run link to return to Step 2 from a later step.

Step 1: Choose the Plan containing the results to review from the list (e.g. Standard Scripts). Click Next>

Step 2: Choose External Script. Click Next>

Ascom Network Testing Ltd., 2000-2013

Page 41 of 129

03 June 2013

Screening Room User Guide

Chapter 4 - The Plan Dashboard option

Step 3: Choose this agent. Click Next>

Step 4: Choose up to five Tests to plot on the dashboard. Click Next>

Ascom Network Testing Ltd., 2000-2013

Page 42 of 129

03 June 2013

Screening Room User Guide

Chapter 4 - The Plan Dashboard option

Step 5: Choose the time period to graph, by choosing the start and end dates and times from the lists. The
dates offered correspond to test run dates for the selected tests.

Step 6: Choose up to 5 metrics to graph, from the lists. You can choose any of the metrics recorded for these
test runs in this time period.

Step 7: Customise the graph appearance. This step is optional, as the defaults are appropriate for most users
and you can quickly adjust any that aren't, once you've seen the default graphs. (See Customising graph
appearance, for details.)

Click Next> to create and display a dashboard view of the selected results:

Ascom Network Testing Ltd., 2000-2013

Page 43 of 129

03 June 2013

Screening Room User Guide

Chapter 4 - The Plan Dashboard option

Interpreting the Plan Dashboard


Once you have created the Plan Dashboard (previous section), you will see it consists of:

A separate tab for each Agent (the Agents selected in step 3)

A column of graphs for each test script (the graphs selected in step 4)

A row of graphs for each metric (the metrics selected in step 6)

Labels and other data in the row and column borders

Ascom Network Testing Ltd., 2000-2013

Page 44 of 129

03 June 2013

Screening Room User Guide

Chapter 4 - The Plan Dashboard option

The horizontal axis of each graph shows the entire time period selected in step 5, so all graphs have the same X
axis. The vertical axis of each graph shows the values of the chosen metric.
But you can do a lot more, including:
Customising the appearance
Manipulating the graphs
Comparing graphs
Cumulative graphs
Watching data

Customising the Plan Dashboard


To change the look of your Plan Dashboard:

Select different options from the Step 7 controls:

Ascom Network Testing Ltd., 2000-2013

Page 45 of 129

03 June 2013

Screening Room User Guide

Chapter 4 - The Plan Dashboard option

Click Next> to redraw the graphs.

The default options are:

Success: choose Not smoothed to plot each success result for each run as a separate point, or Averaged per
minute/hour/day/year to plot averages over time. Averaging makes it easier to spot trends, but might hide
fluctuations or patterns that are important to you

Metrics: choose Not smoothed to plot each metric for each run as a separate point, or Averaged per
minute/hour/day/year to plot averages over time. Averaging makes it easier to spot trends, but might hide
fluctuations or patterns that are important to you

Metric range: if using smoothed results, choose one of these options to add or remove curves showing the
upper and/or lower values:

Maximum & minimum limits


Maximum limit
Minimum limit
Neither limit

not smoothed

smoothed, neither limit

smoothed, both limits

Size: Choose the graph width (Narrow/Normal/Wide) from the first control, and graph height
(Short/Normal/Tall) from the second

Style: Choose the line style (Thin line or Thick line) from the first control, and the point style (No points,
Small points or Large points,) from the second

Override Y-max: The Y-axis of each graph is chosen automatically so that the highest value for each metric
plotted just fits. If you wish, you can override this process by typing a maximum Y axis value in this box.
You might use this, for example, to normalize all graphs so they are directly comparable, or to remove
spurious data from a graph.
For example, if plotting timings that are all in the range 15-20 seconds, with just one rogue value of 200
seconds, the default Y axis will be 0-200 seconds, compressing the details in the rest of the graph. Type 20 in
the Override Y-max box to ignore the rogue value and reveal the variations in the other values, if they are of
more interest:

Ascom Network Testing Ltd., 2000-2013

Page 46 of 129

03 June 2013

Screening Room User Guide

Chapter 4 - The Plan Dashboard option

default graph
showing rogue data

Override Y-Max = 20
hiding rogue data

Any data points that are not plotted because they don't fit are indicated by an upwards arrow (as shown in
the right-hand example, above).

Manipulating the Plan Dashboard


You can change the Plan Dashboard display options (set in steps 5-7) at any time to change the look:

Simply make the change(s) to the options

Click Next> to redraw the dashboard with the new display options.

You can also:

Double-click any graph to display the testrun results in another Browser window.

Select an cell, cells, graph or graphs by clicking them. Select an entire row by clicking the Select link in its
left-hand border. You can then analyse the selected metric graphs by using the three buttons in the top left
of the dashboard. to:

Compare the results

Cumulate the results

Watch the results

Comparing Plan Dashboard graphs


Once you've created a Plan Dashboard (details), you can overlay 2 or more its graphs to help you compare their
results. This only makes sense if the graphs use the same or similar metrics.
To overlay graphs:

Select the graphs to compare (overlay) by clicking them.

Click the Compare button.

The graphs will be combined and displayed as a single graph in another browser window, like this:

Ascom Network Testing Ltd., 2000-2013

Page 47 of 129

03 June 2013

Screening Room User Guide

Chapter 4 - The Plan Dashboard option

This new window has its own set of configuration options:

Use the Time period options to change the period to graph, as described above.

Use the Thresholding options to display a visual warning if the data falls outside the thresholds you
specify, as described below.

Use the Customise graph appearance options to change the graph appearance, as described above.

After making any changes, click Next to apply the revised options to the graph, and re-plot it.

Using Thresholds
You can define Thresholds to help you quickly recognise when results fall outside the expected range. They are
normally used in combination with a regular refresh rate (see Refresh control), to monitor key metrics.
To display a visual warning if the most recent data point is above a threshold value:

Select the graph or graphs to check, from the Plan Dashboard screen.

Click the Compare button.

When the comparison graph is displayed, change the thresholding type from None to Upward and two
additional Level controls are displayed:

Type the upper (error) threshold level in the first box, and the lower (warning) threshold level in the second
box.

Click Next to apply the revised options to the graph.

Now, if the most recent data point (on all the curves) is below both thresholds, the graph will have a green
background:

Ascom Network Testing Ltd., 2000-2013

Page 48 of 129

03 June 2013

Screening Room User Guide

Chapter 4 - The Plan Dashboard option

If the most recent data point (on one or more curves) is above the lower threshold but below the upper threshold,
the graph will have a yellow (warning) background:

And if the most recent data point (on one or more curves) is above the upper threshold, the graph will have a red
(error) background:

Ascom Network Testing Ltd., 2000-2013

Page 49 of 129

03 June 2013

Screening Room User Guide

Chapter 4 - The Plan Dashboard option

To display a visual warning if the most recent data point is below a threshold value:

Select the graph or graphs to check, from the dashboard screen.

Click the Compare button.

When the comparison graph is displayed, select a thresholding type of Downward and two additional
Level controls are displayed:

Type the upper threshold level (warning) in the first box, and the lower threshold level (error) in the second
box.

Click Next to apply the revised options to the graph.

Now, if the most recent data point is above both thresholds, the graph will have a green background; if the most
recent data point is below the upper threshold, the graph will have a yellow (warning) background; and if the most
recent data point is below the lower threshold, the graph will have a red (error) background.

Cumulative Plan Dashboard graphs


You can use Cumulative Plan Dashboard graphs to show the progress of an accumulating metric over time, with
the metric value on the X-axis and the percentage of samples meeting that metric on the Y-axis. Cumulative graphs
provide a good way to monitor targets such as "80% of SMS messages must be delivered with 10 seconds" and to
spot patterns and clustering of results which may warrant investigation.
To produce a cumulative Plan Dashboard graph:

Select the metric graph(s) to cumulate by clicking them on the Plan Dashboard. (It only makes sense to
cumulate graphs for the same or similar metrics.)

Click the Cumulate button.

The selected graphs will be combined and displayed together in another browser window, like this:

Ascom Network Testing Ltd., 2000-2013

Page 50 of 129

03 June 2013

Screening Room User Guide

Chapter 4 - The Plan Dashboard option

This new window has its own options for configuring the graph:

Use Time period to choose the period to graph, as described above.

Use Thresholding to display a visual warning if the data falls outside the thresholds you specify. See Using
Thresholding, above.

Use Cumulative range to change the range plotted along the X-axis.

Use Customise graph appearance to change the graph appearance, as described above.

Click Next to apply the revised options to the graph.

Watching Plan Dashboard data


You can use a Watch graph to display a continuously moving time window on the selected data on a Plan
Dashboard, e.g. to always display results for just the last hour.
To produce a Watch graph:

Select the graph(s) to watch by clicking them on the Plan Dashboard. (It only makes sense to watch graphs
together if they are for the same or similar metrics.)

Click the Watch button.

The graphs will be combined and displayed as a single graph in another Browser window, like this:

Ascom Network Testing Ltd., 2000-2013

Page 51 of 129

03 June 2013

Screening Room User Guide

Chapter 4 - The Plan Dashboard option

This new window has its own options for configuring the Watch graph:

Use the Time period controls to change the period to graph. Notice that this is defined as a period relative
to now. You can choose to graph the previous:

1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 20 or 30 minutes

1, 2, 3, 4, 5 or 6 hours

Use the Thresholding controls to display a visual warning if the data falls outside the thresholds you
specify. See Using Thresholding, above.

Use the Customise graph appearance controls to change the graph appearance, as described above.

Click Next to apply the revised options to the graph.

Note: Remember to set a suitable refresh period, using the Refresh control, in the top right of the window. The
default (Never refresh) is not suitable.

Ascom Network Testing Ltd., 2000-2013

Page 52 of 129

03 June 2013

Chapter 5 - Recent Tests & Availability


The Screening Room Recent tests & availability option displays the Recent Success Facts screen, which lists the
most recent testruns and whether they succeeded or failed - providing a quick indication of service availability.

Using the Recent Facts screen

The Display options

The Filter options

Other links

The Recent Success Facts report

Note: This screen includes options to report on other recent facts (metrics, messages and timings). These reports
can also be accessed directly from the Screening Room Home screen and are described fully in Chapter 6, Metrics,
Messages and Timings.

Using the Recent Success Facts screen


When you select the Recent Tests & Availability option from the Screening Room Home screen, it displays the
Recent Success Facts screen, which looks like this:

This screen initially displays the ten most recent success facts for this Agent, but is highly configurable. You can
select two different layouts (tabular and block), report on different facts (success, metrics, timings or messages),
and choose different information sources (plans or tests) to report on.
This chapter describes the Recent Success Facts screen. The other three fact types are described in the next chapter:
Recent Metric Facts
Recent Timing Facts
Recent Message Facts

The Recent Success Facts Display options


The first group of options on the Recent Success Facts screen is the Display options:

Note: The Display options are the same for all fact types.

Ascom Network Testing Ltd., 2000-2013

Page 53 of 129

03 June 2013

Screening Room User Guide

Chapter 5 - Recent Tests & Availability

To change the number of facts displayed:

Edit the figure (10) in the first box.

To change the facts displayed, choose from the first dropdown list:

Success facts - whether the run succeeded or failed. (See The Recent Success Facts report, below.)

Metrics - recent Metrics. (See Recent metrics in Chapter 6.)

Timings - recent Timings. (See Recent timings in Chapter 6.)

Messages - recent Messages. (See Recent messages in Chapter 6.)

To change the report layout, select the layout from the second dropdown list:

Select In rows to produce a wide tabular report, with one row per fact, like this:

Select In blocks to produce a longer, narrower, report, with one block per fact, like this:

The block report is best for printing reports; the tabular report is best for comparing results on the screen.
However, the two formats present exactly the same information and provide exactly the same facilities.

After changing any of the display options, click the

(Go) button to apply them.

Throughout the rest of this chapter we will use the block report format, as it's more compact.

Ascom Network Testing Ltd., 2000-2013

Page 54 of 129

03 June 2013

Screening Room User Guide

Chapter 5 - Recent Tests & Availability

The Recent Success Facts Filters


The second group of options on the Recent Success Facts screen is the Filter options, used to select the results to
list:

Note: The Filter options are different for each fact type.
To report on a single Plan:

Select its name from the below Plan dropdown list. Choose All again to report on all Plans running on this
Agent.

To report on a single Test

Select its name from the Test dropdown list. Choose All again to report on all Tests.

To report on a single Testrun:

Type its id (number) in the Testrun box. Delete the contents of this box to report on all Testruns.

To just list successful runs:

Select Yes from the Success filter; to just list failed runs, select No from the Success filter. To list all results,
select All.

After making any changes to a filter, click its


button.

(Filter) button to apply it to the results - or click the

(Go)

The Recent Success Facts Links


Notice there are also a number of links (underlined blue text) on the Recent Success Facts screen:

Click Plan to switch to a Dimensions report on the Plans on this Agent (described in Chapter 7).

Click Test to switch to a Dimensions report on the Tests on this Agent (described in Chapter 7).

Click a testrun ID in the Testrun column to view its summary results (described in Chapter 3).

Finally, you can use the Refresh control to keep the results up-to-date (see Refresh control in Chapter 2).

The Recent Success Facts report


The Recent Success Facts report displays success/failure facts for the most recent testruns on this Agent that match
your filtering criteria.
A successful run looks like this (in block format):

Ascom Network Testing Ltd., 2000-2013

Page 55 of 129

03 June 2013

Screening Room User Guide

Chapter 5 - Recent Tests & Availability

Notice that a successful run is indicated by a green highlight.


An unsuccessful run looks like this, with a red highlight:

To display a detailed report for any testrun, click its ID in the Testrun field.

Ascom Network Testing Ltd., 2000-2013

Page 56 of 129

03 June 2013

Chapter 6 - Metrics, Messages & Timings


The Screening Room Metrics, messages and timings option consists of three separate links:

Metrics - data measurements for each Scene and the entire test run, such as system availability, total bytes
received, and payload tx/rx rates. May include metrics for Custom Transactions

Messages - messages output during the run, including outcomes (the route taken through the test), error
messages and diagnostic messages (more detailed explanations for errors)

Timings - times for each Scene and the entire test run, including start and end times (clock times) and
interval times (durations); may include Custom Timings

All three options display the Recent Facts screen, but with a different fact type displayed. To avoid repetition, we'll
start with the general principles of how to use the Recent Facts screen, and then describe each of the screens in
turn.
This screen can also display a fourth fact type: recent success facts. This report can be directly accessed from the
Screening Room Home screen (via the Recent tests & availability option) and will not be described in detail here.
For details, see Chapter 5, Recent tests & availability.

Using the Recent Metrics, Messages or Timing Facts


screen
When you select the Metrics, messages or timings option from the Screening Room Home screen, it displays the
appropriate Recent Facts screen. For example, if you click the Metrics link, you will see the Recent Metric Facts
screen, which looks like this:

This screen initially displays the ten most recent facts of the type you clicked, but is highly configurable. You can
select two different layouts (tabular and block), report on different facts (success, metrics, timings or messages),
and choose different information sources (plans or tests) to report on.
Recent Success Facts are described in Chapter 5.
The screen layout, filters and links for each fact type are described separately after a description of the Display
options, which are the same for all types:
Display options
Recent Metrics Facts
Recent Timing Facts
Recent Message Facts

Ascom Network Testing Ltd., 2000-2013

Page 57 of 129

03 June 2013

Screening Room User Guide

Chapter 6 - Metrics, Messages & Timings

The Recent Metric/Timing/Message Facts Display options


The first group of options on the Recent Metric/Timing/Message Facts screen is the Display options:

Note: The Display options are the same for all fact types.
To change the number of facts displayed:

Edit the figure (10) in the first box.

To change the facts displayed, choose from the first dropdown list:

Success facts - whether the run succeeded or failed. (See Chapter 5.)

Metrics - recent Metrics. (See Recent metrics.)

Timings - recent Timings. (See Recent timings.)

Messages - recent Messages. (See Recent messages.)

To change the report layout, select the layout from the second dropdown list:

Select In rows to produce a wide tabular report, with one row per fact, like this:

Select In blocks to produce a longer, narrower, report, with one block per fact, like this:

***

Ascom Network Testing Ltd., 2000-2013

Page 58 of 129

03 June 2013

Screening Room User Guide

Chapter 6 - Metrics, Messages & Timings

The block report is best for printing reports; the tabular report is best for comparing results on the screen.
However, the two formats present exactly the same information and provide exactly the same facilities.

After changing any of the display options, click the

(Go) button to apply them.

Throughout the rest of this chapter we will use the block report format, as it's more compact.

The Recent Metric Facts screen


To display recent metrics:

Click the Metrics option on the Screening Room Home screen, or select the Metrics option from the Display
options on any other Recent Facts screen.

This displays the ten most recent metric facts for this Agent, like this:

Where:

Time is the time when the metric was reported

Plan is the name of the Plan reporting it

Test is the name of the Test reporting it

Testrun is the id of the testrun reporting it

Transaction is the name of the transaction reporting it

Metric is the name of the metric

Value is the metric's value

Unit is the metric value's units, e.g. s for seconds.

(Not all columns are shown in the example above, as row format is rather wide.)

Use the Display options to change the display layout (details)

Use the Filters to change the data displayed (details)

Use the Links to switch to another (related) report (details)

The Recent Metric Facts Filters


The Recent Metric Facts screen Filter options (shown here in block format) are used to select the results to list:

Ascom Network Testing Ltd., 2000-2013

Page 59 of 129

03 June 2013

Screening Room User Guide

Chapter 6 - Metrics, Messages & Timings

To report on a single Plan:

Select its name from the below Plan dropdown list. Choose All again to report on all Plans running on this
Agent.

To report on a single Test

Select its name from the Test dropdown list. Choose All again to report on all Tests.

To report on a single Testrun:

Type its id (number) in the Testrun box. Delete the contents of this box to report on all Testruns.

To report on a single Transaction (or Scene):

Select its name from the Transaction dropdown list. Choose All again to report all Transactions.

To report on a single Metric:

Select its name from the Metric dropdown list. Choose All again to report all Metrics.

After making any changes to a filter, click its


button.

(Filter) button to apply it to the results - or click the

(Go)

Note: Additional filtering options are available for certain fact types, and are described below.
For example:

To report on a particular metric, select its name from the Metric filter and click its

button.

The Recent Metric Facts Links


The Recent Metric Facts screen has a number of links (underlined blue text) that you can use to switch to another,
related, report. For example, in block format:

Ascom Network Testing Ltd., 2000-2013

Page 60 of 129

03 June 2013

Screening Room User Guide

Chapter 6 - Metrics, Messages & Timings

Click Plan to switch to a Dimensions report on the Plans on this Agent (described in Chapter 7).

Click Test to switch to a Dimensions report on the Tests on this Agent (described in Chapter 7).

Click a testrun ID (e.g. 248375) to view its summary results (described in Chapter 3).

Click Transaction to switch to a Dimensions report on the Transactions on this Agent (described in Chapter
7)

Click Metric to switch to a Dimensions report on the Metrics on this Agent (described in Chapter 7)

You can also use the Refresh control to keep the results up-to-date (see Refresh control in Chapter 2).

The Recent Timing Facts screen


To display recent timings:

Click the Timings option on the Screening Room Home screen, or select the Timings option from the
Display options on any other Recent Facts screen.

This displays the ten most recent timing facts for this Agent, like this:

Where:

Ascom Network Testing Ltd., 2000-2013

Page 61 of 129

03 June 2013

Screening Room User Guide

Chapter 6 - Metrics, Messages & Timings

Time is the time when the metric was reported

Plan is the name of the Plan reporting it

Test is the name of the Test reporting it

Testrun is the id of the testrun reporting it

Transaction is the name of the transaction (Scene or Custom Transaction) reporting it

Timing is the name of the timing

Value is the timing's value

Unit is the timing value's units, e.g. ms for milliseconds.

(Not all columns are shown in the example above, as row format is rather wide.)

Use the Display options to change the display layout (details)

Use the Filters to change the data displayed (details)

Use the Links to switch to another (related) report (details)

The Recent Timing Facts Filters


The Recent Timing Facts screen Filter options (shown here in block format) are used to select the results to list:

To report on a single Plan:

Select its name from the below Plan dropdown list. Choose All again to report on all Plans running on this
Agent.

To report on a single Test

Select its name from the Test dropdown list. Choose All again to report on all Tests.

To report on a single Testrun:

Type its id (number) in the Testrun box. Delete the contents of this box to report on all Testruns.

To report on a single Transaction (or Scene):

Select its name from the Transaction dropdown list. Choose All again to report all Transactions.

To report on a single Timing:

Select its name from the Timing dropdown list. Choose All again to report all Timings.

After making any changes to a filter, click its


button.

(Filter) button to apply it to the results - or click the

(Go)

Note: Additional filtering options are available for certain fact types, and are described below.
For example:

To report on a particular timing, select its name from the Timing filter and click its

Ascom Network Testing Ltd., 2000-2013

Page 62 of 129

button.

03 June 2013

Screening Room User Guide

Chapter 6 - Metrics, Messages & Timings

The Recent Timing Facts Links


The Recent Timing Facts screen has a number of links (underlined blue text) that you can use to switch to another,
related, report. For example, in block format:

Click Plan to switch to a Dimensions report on the Plans on this Agent (described in Chapter 7).

Click Test to switch to a Dimensions report on the Tests on this Agent (described in Chapter 7).

Click a testrun ID (e.g. 1117) to view its summary results (described in Chapter 3).

Click Transaction to switch to a Dimensions report on the Transactions on this Agent (described in Chapter
7)

Click Timing to switch to a Dimensions report on the Timings on this Agent (described in Chapter 7)

You can also use the Refresh control to keep the results up-to-date (see Refresh control in Chapter 2).

The Recent Message Facts screen


To display recent messages:

Click the Messages option on the Screening Room Home screen, or select the Messages option from the
Display options on any other Recent Facts screen.

This displays the ten most recent message facts for this Agent, like this:

Ascom Network Testing Ltd., 2000-2013

Page 63 of 129

03 June 2013

Screening Room User Guide

Chapter 6 - Metrics, Messages & Timings

Where:

Time is the time when the metric was reported

Plan is the name of the Plan reporting it

Test is the name of the Test reporting it

Testrun is the id of the testrun reporting it

Transaction is the name of the transaction reporting it

Type is the message type; there are many different types, including error, warning, and outcome

Message is the message text

(Not all columns are shown in the example above, as row format is rather wide.)

Use the Display options to change the display layout (details)

Use the Filters to change the data displayed (details)

Use the Links to switch to another (related) report (details)

The Recent Message Facts Filters


The Recent Timing Facts screen Filter options (shown here in block format) are used to select the results to list:

To report on a single Plan:

Select its name from the below Plan dropdown list. Choose All again to report on all Plans running on this
Agent.

To report on a single Test

Select its name from the Test dropdown list. Choose All again to report on all Tests.

To report on a single Testrun:

Type its id (number) in the Testrun box. Delete the contents of this box to report on all Testruns.

To report on a single Transaction (or Scene):

Ascom Network Testing Ltd., 2000-2013

Page 64 of 129

03 June 2013

Screening Room User Guide

Chapter 6 - Metrics, Messages & Timings

Select its name from the Transaction dropdown list. Choose All again to report all Transactions.

To report on a single Message Type (such as Warning or Error):

Select its name from the Type dropdown list. Choose All again to report all Timings.

To report on messages that include or do not include specific text, use the Message controls. Each line allows you
to specify a separate condition, which you can then combine with an AND or an OR operation:

Select has or hasn't from the first element

Type the text to match in the second element

Select anywhere or at start from the third element, to produce the first condition.

Select and or or from the fourth element to specify how to combine the two conditions to create the filter..

Select has or hasn't from the fifth element

Type the text to match in the sixth element

Select anywhere or at start from the seventh element, to produce the second condition.

For example, to choose messages which start with the text "Service Failure" or include the text "Failed" anywhere
within the message, make the following selections:

After making any changes to a filter, click its


button.

(Filter) button to apply it to the results - or click the

(Go)

The Recent Message Facts Links


The Recent Message Facts screen includes a number of links (underlined blue text) that you can use to switch to
another, related, report. For example, in block format:

Ascom Network Testing Ltd., 2000-2013

Page 65 of 129

03 June 2013

Screening Room User Guide

Chapter 6 - Metrics, Messages & Timings

Click Plan to switch to a Dimensions report on the Plans on this Agent (described in Chapter 7).

Click Test to switch to a Dimensions report on the Tests on this Agent (described in Chapter 7).

Click a testrun ID (e.g. 1130) to view its summary results (described in Chapter 3).

Click Transaction to switch to a Dimensions report on the Transactions on this Agent (described in Chapter
7)

Click Type to switch to a Dimensions report on the Message Types on this Agent (described in Chapter 7)

You can also use the Refresh control to keep the results up-to-date (see Refresh control in Chapter 2).

Ascom Network Testing Ltd., 2000-2013

Page 66 of 129

03 June 2013

Chapter 7 - Dimensions
The Screening Room Home screen Dimensions option provides six different links:

Plans

Tests

Transactions

Metrics

Timings

Message types

Each option displays a different screen listing all the objects of that type known to the Agent, providing links to
recent results for each object.

Plans
The Screening Room's Dimensions/Plans option lists all the Plans stored on this Agent, in a table like this:

Click a Plan's Dashboard link to display the Dashboard for that Plan. See Chapter 4, Plan Dashboard for
details of this report.

Click a Plan's Successes, Failures, Metrics or Messages link to display the 30 most recent facts of that type
for that Plan. See Chapter 5, Recent tests & availability and Chapter 6, Metrics, messages and timings, for details
of these reports.

Tests
The Screening Room's Dimensions/Tests option lists all the Tests stored on this Agent, in a table like this:

Ascom Network Testing Ltd., 2000-2013

Page 67 of 129

03 June 2013

Screening Room User Guide

Chapter 7 - Dimensions

Click a Test's Successes, Failures, Metrics or Messages link to display the 30 most recent facts of that type
for that Test. See Chapter 5, Recent tests & availability and Chapter 6, Metrics, messages and timings, for details
of these reports.

Transactions
The Screening Room's Dimensions/Transaction option lists all the Transactions (Scenes and Custom Transactions)
reported in the results stored on this Agent, in a table like this:

Click a Transaction's Metrics or Messages link to display the 30 most recent facts of that type for that
Transaction. See Chapter 6, Metrics, messages and timings, for details of these reports.

Metrics
The Screening Room's Dimensions/Metrics option lists all the Metrics reported in the results stored on this Agent,
in a table like this:

Ascom Network Testing Ltd., 2000-2013

Page 68 of 129

03 June 2013

Screening Room User Guide

Chapter 7 - Dimensions

Click a Metric's Metrics link to display the 30 most recent values for that Metric. See The Recent Metric Facts
screen in Chapter 6 for details of this report.

Timings
The Screening Room's Dimensions/Timings option lists all the Timing types reported in the results stored on this
Agent, in a table like this:

Click a Timing's Timings link to display the 30 most recent values for that Timing. See The Recent Timing
Facts screen in Chapter 6 for details of this report.

Message types
The Screening Room's Dimensions/Types option lists all the Message types reported in the results stored on this
Agent, in a table like this:

Click a Message type's Messages link to display the 30 most recent Messages of that type. See The Recent
Message Facts screen in Chapter 6 for details of these reports.

Ascom Network Testing Ltd., 2000-2013

Page 69 of 129

03 June 2013

Chapter 8 - Local Schedules


On a Monitor Master QM system, scripts should be saved in Central Mode and scheduled using Quality Manager
Central Schedules; only read this chapter if you need to schedule Local Mode scripts, using Local Schedules.
The Screening Room options (Functional View, Regression View and Monitoring View) all allow you to manage
Local Schedules.
A Local Schedule (or Agent Schedule) specifies when and how to run a Local Mode script on an Agent, on a
regular basis. By defining schedules to run your Tests, you can automate the monitoring of services, leaving you
more time to concentrate on the results of the monitoring. This chapter describes how to create and manage Local
Schedules.
Local Schedules must be stored on the Agent that runs them.

Local Schedules

Adding a Local Schedule

Editing a Local Schedule

Deleting a Local Schedule

Local Schedules
An Agent's Local Schedules are managed from within Screening Room. To get started:

Run Screening Room for the Agent to manage. (For example, select the View Agent option from the Story
Boarder Tools menu and choose the Agent.)

This will display the Screening Room Home screen:

Choose any of the Screening Room options from the Home screen - Monitoring is probably the most
convenient:

Ascom Network Testing Ltd., 2000-2013

Page 70 of 129

03 June 2013

Screening Room User Guide

Chapter 8 - Local Schedules

You use the Tests and Plans panel, top left, to manage Local Schedules. You can enlarge the panel by
dragging its lower and right-hand borders if it's too small.

Plans, Tests and Schedules


The Tests and Plans panel lists your Plans (AgentStatus, BBDemo, etc) as folders:

Open a Plan folder to see the Tests within that Plan:

Open a Plan's Schedules folder to see the Local Schedules for that Plan:

Ascom Network Testing Ltd., 2000-2013

Page 71 of 129

03 June 2013

Screening Room User Guide

Chapter 8 - Local Schedules

There is also a Schedules folder (in the This agent folder) that lists all the Schedules on this Agent.

Schedule icons
To help you quickly recognise which Tests are Scheduled and which Schedules are active, Monitor Master uses the
following conventions in this panel:
In lists of Tests (within the Plan folders):

A Scheduled Test has a small clock added to its icon, like this:

If the Schedule is disabled, the description has a grey background, like this:

In lists of Schedules (e.g. within the Agent schedules folder):

An enabled Schedule looks like this:

A disabled Schedule looks like this:

To display information about a Schedule, hover over it (move the mouse pointer to it and wait). A popup box will
be displayed like this:

We'll now describe in detail how to manage Local Schedules i.e. how to:

Add a Local Schedule

Edit a Local Schedule

Delete a Local Schedule

Adding a Local Schedule


To add a Local Schedule to an Agent:

Run Screening Room for the Agent and choose one of three Screening Room options (e.g. monitoring) from
the Screening Room Home page.

Right-click the Schedules folder in the Plans and Tests panel, to display this popup menu:

Note: To schedule a Test from a Plan, right-click the Plan's Schedules folder; to schedule any Test on this
Agent, right-click the Schedules folder in the This agent folder.

Select the Add Schedule option to display the Edit Schedule dialog:

Ascom Network Testing Ltd., 2000-2013

Page 72 of 129

03 June 2013

Screening Room User Guide

Chapter 8 - Local Schedules

Type a name for the new schedule in the Name box, such as Hourly SMS check.

Select the Test to schedule from the Test list. (See Note above.)

To enable the Schedule (so it will run once saved) leave Status set to Enabled; to disable the Schedule (so it
won't run until enabled), change Status to Disabled.

To limit the time the Test will be allowed to run for, type a time limit (in minutes) in the Duration/mins box.
If you do not want to enforce a time limit, leave this set to 0.
This feature can be used to stop multiple scheduled tests from interfering with each other. This can become
important when sharing resources such as a dial up modem, to avoid conflicts

Choose how often you want to run the test from the Strategy dropdown list. The standard options are:

[Custom] (see Custom Schedules, below)

Every minute

Every 5 / 10 / 15 / 30 minutes

Every hour (on the hour)

Every odd hour (on the hour)

Every even hour (on the hour)

Every 6 hours (on the hour)

Every day (at midnight)

Every weekday (Monday - Friday, at midnight)

Every Sunday/Monday/Tuesday/Wednesday/Thursday/Friday or Saturday (at midnight)

First day of the month (at midnight)

First day of the year (at midnight)

Note: If you want a different strategy, see Custom Schedules, below.

Click Add to add the new Schedule to the Agent Schedules folder in the Plans and Tests panel.
Note: To pass parameters to the Test Run, see Test Parameters, below.

Ascom Network Testing Ltd., 2000-2013

Page 73 of 129

03 June 2013

Screening Room User Guide

Chapter 8 - Local Schedules

The new entry in the Agent schedules folder will show the following information:

A clock icon - blue if enabled, grey if disabled

The Test Script name

A hyphen and the Schedule name

A list of the times (minutes past the hour) the Test will run

Custom Schedules
If none of the standard scheduling strategies fits your needs:

Select [Custom] as the Strategy then click the More button to expand the Edit Schedule dialog:

You can now specify a wider variety of scheduling patterns by typing in the Minutes, Hours, Days, Months and
Weekdays fields:

Minutes: type the time(s) past the hour to test (0-59).

Hours: type the hour(s) to test (0-23). 0 is midnight.

Days: type the day(s) of the month to test (1-31).

Months: type the month(s) of the year to test (1-12). 1 is January, 2 is February, etc.

Weekdays: type the day(s) of the week to test (1-6). 0 is Sunday, 1 is Monday, etc.

What do you type? You can:

Type the * wildcard to test at every matching period. For example, type * in the Hours field to schedule a
test for every hour; type * in the Days field to test every day - provided the other settings match.

Type a numeric value in a field to test only when that value is matched. For example, type 15 in the Hour
field to test at 3 pm - provided the other settings match.

Type the - symbol to specify a range. For example, type 8-12 in the Hour field to test at 8, 9, 10, 11 and 12 provided the other settings match.

Use the , symbol to separate values in a list. For example, type 1,15 in the Days field to test on the 1st and
15th days of the month - provided the other settings match.

Ascom Network Testing Ltd., 2000-2013

Page 74 of 129

03 June 2013

Screening Room User Guide

Chapter 8 - Local Schedules

For example, to run the test at 15:10 and 15:40 on Monday-Friday:

Type 10, 40 in Minutes

Type 15 in Hours

Type 1-5 in Weekdays

Leave the other fields set to *

Test parameters
To pass parameters to the test run:

Click the More button to expand the dialog:

Type the parameters to pass in the Test parameters field, separated by commas.

Click Add to add the Schedule.

Editing a Local Schedule


To edit a Local Schedule on an Agent:

Run Screening Room for the Agent and choose one of three Screening Room options (e.g. monitoring) from
the Screening Room Home page.

Open the Schedules folder in the Plans and Tests panel, top left.
Note: To edit a Schedule from a Plan, right-click the Plan's Schedules folder; to edit any schedule on this
Agent, right-click the Schedules folder in the This agent folder.

Right-click the Schedule to edit. This will display this popup menu:

Select the Edit schedule option to display this dialog:

Ascom Network Testing Ltd., 2000-2013

Page 75 of 129

03 June 2013

Screening Room User Guide

Chapter 8 - Local Schedules

This operates just like when adding a schedule. See Adding Schedules (above) for details.

Make any changes you require and click Apply to save them.

The changes you make will take effect immediately. However, if a scheduled test run has already started, it will be
unaffected.

Deleting a Local Schedule


To delete a Local Schedule from an Agent:

Run Screening Room for the Agent and choose one of three Screening Room options (e.g. monitoring) from
the Screening Room Home page.

Open the Schedules folder in the Plans and Tests panel, top left
Note: To edit a Schedule from a Plan, right-click the Plan's Schedules folder; to edit any schedule on this
Agent, right-click the Schedules folder in the This agent folder.

Right-click the Schedule to delete. This will display this popup menu:

Select the Delete schedule option.

Select the OK button in the confirmation dialog.

The deletion will take effect immediately, cancelling any test runs that were scheduled but have not yet started.
However, if a scheduled test run has already started, it will be unaffected.
Hint: If you just want to stop a scheduled test for a while e.g. while on holiday, instead of deleting it you can edit it
to change its status to Disabled.

Ascom Network Testing Ltd., 2000-2013

Page 76 of 129

03 June 2013

Chapter 9 - Device Update


The Screening Room Device update option can be used to manually update the device profiles stored on an Agent,
from trusted sources (profile authorities), usually the Device Master Live Server or your organization's own Device
Master Server.
However, this facility is not relevant to most Monitor Master QM user. When it schedules a testrun on an Agent,
QM automatically copies any device profiles it needs from the Vault to the Agent . The Vault's device profiles are
updated using QM Server's System / Devices / Administer devices menu option - see the Quality Manager User
Guide for details.
Direct updating of Agent device profiles (as described in this chapter) is usually only necessary for Agents that are
used in Local Mode.
Before you can use Device Update you must configure the profile authority for updating Legacy Profiles and
usernames and passwords used to access your profile authorities, using the Agent mmsw settings
NGPLegacyAuthority and DeviceMasterCredentials. See Chapter 15 of the Installing & Managing Monitor Master
guide for details.

Why use Device update?

Using the Device update option

Why use Device update?


A baseline set of device profiles is installed on each Agent during the Monitor Master Installation process. This
may include Legacy Profiles, which can be updated to Next Generation Profiles (NGPs) to provide additional
functionality, including the ability to search and filter the lists of devices when creating tests. This happens
automatically - the first time you use a Legacy Profile in Story Boarder, Monitor Master will fetch the
corresponding NGP from your NGP Legacy Authority (typically the Live Server) and store it for future use.
Device and feature profiling is an ongoing part of our business activities, producing an ever-growing database of
device and feature knowledge, stored on the main Device Master Live Server. Again, Monitor Master downloads
updates automatically, to keep you up-to-date.
The main reason for using the Device update facility is to load device profiles from files, e.g. to update a system
that has no Internet access, or load profiles sent to you by email or on disk. If you have a local Device Master v3.3
Server and private profiles created with an earlier version, you can use Device update to convert these Legacy
profiles to NG profiles.

Using the Device update option


To update an Agent's device profiles:

Run Screening Room for the Agent. (For example, select the View Agent option from the Story Boarder
Tools menu and choose the Agent.)

This will display the Screening Room Home screen:

Ascom Network Testing Ltd., 2000-2013

Page 77 of 129

03 June 2013

Screening Room User Guide

Chapter 9 - Device Update

Click the Device update option on the Home screen

This will display the Device Management screen, which looks like this:

This screen provides two main facilities:

Ascom Network Testing Ltd., 2000-2013

Page 78 of 129

03 June 2013

Screening Room User Guide

Chapter 9 - Device Update

Add/update from file - used to take updates provided as individual files. Typically used for small
updates or where network access is not available. Supports .dmdp, .dmda, and .zip files.

Update from authority - used to update by comparing your current data against a trusted source.
Typically used to update automatically from the Device Master Live Server on a regular basis

To add a new device profile or update an existing device profile from a local file:

Click the Choose files button

Either type the file pathname or click the Browse button and browse to it

Click the Upload button

To update the Agent's profiles from its trusted authorities:

Scroll down to the Update from authority section

Select the devices to update:

Check or uncheck individual devices by clicking their checkboxes

Check all devices from an authority by clicking the Mark all devices button at the top of their table

Check all devices from all authorities by clicking the Mark all authorities button at the top of the
section

WARNING: Updating large numbers of profiles can take a long time! Updating 500 profiles over a typical
internet connection might take 5-6 hours.

Either click the Check for device updates of marked authorities button at the top of the section, to perform
a device update

Or click the Update analysis data of marked authorities button at the top of the section, to update analysis
data

Select OK from the confirmation dialog to begin

When the update has finished, a summary dialog will be displayed - click OK to close it.

Updating a Legacy Profile converts it to a Next Generation Profile; updating a Next Generation Profile downloads
the latest newer version.

Ascom Network Testing Ltd., 2000-2013

Page 79 of 129

03 June 2013

Chapter 10 - Agent Resource Management


Note: On a Monitor Master QM system, QM's central resource management facility should be used instead of the
Agent resource management described in this chapter!
To use agent resource management:

Display Screening Room for the Agent

Select the Agent Resource Management option from the Screening Room Home screen (main menu) to
display the Agent Resource Management screen:

This provides access to resource management setup and reporting facilities for the Agent's resources. Setting up
Resource Management also allows you to use the Resource Management functions in test scripts so they can share
resources without conflict.

Management options
The Agent Resource Management screen provides five main options:

Resource items - define the resources on this Agent that you want to manage

Resource users - define the users of this Agent that you want to manage

Resource allocations - allocate (reserve) resources for specific users (or the system), for a specific time

Resource usage - display a report that shows when each resource was actually in use (booked by a script)

Resource graphing - create a graph of resource allocations and usage to help planning

Resource management scripts


Test scripts can use Agent Resource Management by calling functions to book (use) and release resources, once
Resource Management has been set up using the facilities described in this chapter.

Ascom Network Testing Ltd., 2000-2013

Page 80 of 129

03 June 2013

Screening Room User Guide

Chapter 10 - Agent Resource Management

For details, see the ResourceAcquire and ResourceRelease functions in Chapter 3 of the Advanced Scripting Guide
and Resource Management in Chapter 4 of the Advanced Scripting Guide.

Resource management concepts


The reason for resource management is that certain resources cannot be shared. If two tests attempt to use such a
resource at the same time, one or both will fail.
To avoid this problem, you can manage the resources - specify which resources can be used at which time, by
whom. Then you can use the resource management functions in a test script to acquire and release the resources it
needs. When the script runs, it will be able to detect whether the resources they need are available, and act
accordingly (e.g. wait and try again, try another resource, or quit).
When a script runs and attempts to acquire (book) a resource, this will succeed if the resource is free at that time. A
resource is free if:

it is not already acquired by another test run (using the ResourceAcquire function)

it is not already allocated to another user at this time (using the Screening Room resource management
options)

If resource acquisition fails, the code in the Advanced Script Scene might attempt to acquire a different resource, or
try to acquire the same resource again after a delay, or exit with a System error which subsequent Scenes should
handle accordingly. (For details, see Resource Management in the Advanced Scripting Guide.)
Key concepts:

resource item (resource) - any item that you want to manage, but specifically an item that's needed for a test
run but can only be used by one run at a time

resource user (user) - a user whose access you want to manage

resource allocation - requesting exclusive use of a resource for a specific user, for a specific period

resource management functions - script functions that can be used to acquire (claim) a free resource before
using it, then release it again once no longer needed

dynamic booking - claiming a free resource "now" from a running script by using the ResourceAcquire
resource management function (described in the Advanced Scripting Guide)

static booking - claiming a resource for a specific time period by using the Screening Room resource
allocation facility (described in this section)

allocation vs booking - you allocate a resource from Screening Room, for future use by a user; a script books
a resource for its own use when it runs by using the ResourceAcquire function. A script can book a free
resource even if that resource is not allocated to the user running it - allocating simply helps make sure the
resource is free for that user (and their scripts) to use

Notice that you don't have to define resource users or allocate resources to use Resource Management - once you
have defined the resources you want to manage by creating resource items for them (as described below), your test
scripts can use the resource management functions to book and release resources, to share them. However, the
other resource management facilities described below will allow you to set up a more efficient system of resource
sharing. For example, by manually allocating resources you can taken control of which scripts can use which
resources, when, so users know when they can run their scripts without resourcing problems.

Resource items
To define the resources on an Agent so you can manage their use, you must first add them as Resource Items:

Click the Resource items option on the main Resources screen:

Ascom Network Testing Ltd., 2000-2013

Page 81 of 129

03 June 2013

Screening Room User Guide

Chapter 10 - Agent Resource Management

This will list the current resources on this Agent (initially none), on the Resource items screen:

To add Resource Items, click the

Once you have added some items, additional options are displayed for each:

Ascom Network Testing Ltd., 2000-2013

button or the Add new item link - see Adding a resource item.

Page 82 of 129

03 June 2013

Screening Room User Guide

To edit a Resource Item, click its

To delete a Resource Item, clicks its

Chapter 10 - Agent Resource Management

button or Edit item link - see Editing a resource item


button or Delete item link - see Deleting a resource item

Once you have defined resources as Resource Items, you can:


Allocate them to a particular user to use for a specified time (pre-book them), by using the Screening Room
Resource allocations option. See Resource allocations for details.
Acquire them from within a script for it to use (book it), by using the ResourceAcquire function within the
script. See the Advanced Scripting Guide for details.
Note that Resource Item definitions are local to the Agent.

Adding a Resource Item


To add a new Resource Item to an Agent:

Click the Add new item link or click the

Type a short, unique name for the item in the Name field. This can include spaces and punctuation, for
example Modem on COM3. Use consistent meaningful names, as they will be used by the resource
management options and functions to refer to this resource.

Ascom Network Testing Ltd., 2000-2013

button on the Resource items screen:

Page 83 of 129

03 June 2013

Screening Room User Guide

Chapter 10 - Agent Resource Management

Type any notes for this item in the Notes field. This information is optional, and can include spaces and
punctuation, for example MC35 modem with SIM #3333333333

Click the Add button to add the new resource item and return to the Resource items screen:

Repeat to add further resource items

Editing a Resource Item


To edit a Resource Item on an Agent:

Click its Edit item link or

This displays the current definition in the Edit Item dialog:

Edit the Name or Notes fields as appropriate

Click Apply to make the changes and return to the list

button, on the Resource Items screen

If you edit a Resource Item which is already allocated, all its allocations will be updated accordingly.

Deleting a Resource Item


To delete a Resource Item from an Agent::

Ascom Network Testing Ltd., 2000-2013

Page 84 of 129

03 June 2013

Screening Room User Guide

Click its Delete item link or

Click OK to delete it

Chapter 10 - Agent Resource Management

button on the Resource Items screen

If you delete a Resource Item which is already allocated, all those allocations will be deleted, too.

Resource Users
To define the users on an Agent so you can allocate resources to them, you must first add them as Resource Users:

Click the Resource users option on the main Resources screen:

This will list the current Resource Users of this Agent (initially just SYSTEM), on the Resource users screen:

Ascom Network Testing Ltd., 2000-2013

Page 85 of 129

03 June 2013

Screening Room User Guide

Chapter 10 - Agent Resource Management

To add Resource Users, click the

Once you have added some users, additional options are displayed for each:

To edit a Resource User, click its

To delete a Resource User, clicks its

button or the Add new user link - see Adding a Resource User

button or Edit user link - see Editing a Resource User


button or Delete user link - see Deleting a Resource User

Once you have defined users as Resource Users, you can:


Allocate Resource Items to them to use for a specified time (pre-book resources), by using the Screening
Room Resource allocations option. See Resource allocations for details.
Note that Resource User definitions are local to the Agent.
If someone who is not a Resource User runs a script that uses the ResourceAcquire function, they will be added
automatically. Their Resource User name and username will both be set to their Windows login name, and their
notes will indicate that they were added automatically.

Ascom Network Testing Ltd., 2000-2013

Page 86 of 129

03 June 2013

Screening Room User Guide

Chapter 10 - Agent Resource Management

Adding a Resource User


To add a new Resource User to an Agent:

Click the Add new item link or click the

Name: Type the name to use for this user throughout resource management. This can include spaces and
punctuation and will typically be the user's full name

(Domain) username: Type the user's Windows login name i.e. the username that they type to login. (Check
with the user or system administrator if unsure.)

Notes: Optionally type any notes about this user.

Click the Add button to add the new user and return to the Resource Users screen:

Repeat to add further Resource Users

button on the Resource users screen:

Editing a Resource User


To edit a Resource User on an Agent:

Click its Edit item link or

Ascom Network Testing Ltd., 2000-2013

button, on the Resource Users screen

Page 87 of 129

03 June 2013

Screening Room User Guide

Chapter 10 - Agent Resource Management

This displays the current definition in the Edit User dialog:

Edit the Name, (Domain) username and Notes fields as appropriate

Click Apply to make the changes and return to the Resource Users screen

If you edit a user who is already allocated resources, all their allocations will be updated accordingly.

Deleting a Resource User


To delete a Resource User from an Agent::

Click its Delete user link or

Click OK to delete it

button on the Resource Users screen

If you delete a Resource User who is already allocated resources, all their allocations will be deleted too.

Resource Allocations
Hint: Remember that scripts can also be designed to claim resources dynamically, by using the ResourceAcquire
and ResourceRelease functions - see the Advanced Scripting Guide for details.
To book (allocate) resources for specific users (or the system) for a specific time, you must first define them as
Resource Items and Resource Users, then:

Click the Resource allocations option on the main Resources screen:

Ascom Network Testing Ltd., 2000-2013

Page 88 of 129

03 June 2013

Screening Room User Guide

Chapter 10 - Agent Resource Management

This will list the current allocations on this Agent (initially none), on the Resource allocations screen:

To add a Resource Allocation, click the

Once you have added some allocations, additional options are displayed for each:

To edit a Resource Allocation, click its

To delete a Resource Allocation, clicks its

button - see Adding a Resource Allocation.

button - see Editing a Resource Allocation


button - see Deleting a Resource Allocation

Adding a Resource Allocation


To book a resource for a specific user and time period, add a Resource Allocation:

Click the

button on the Resource Allocations screen:

Ascom Network Testing Ltd., 2000-2013

Page 89 of 129

03 June 2013

Screening Room User Guide

Chapter 10 - Agent Resource Management

Item: Select the resource to allocate. (If you can't see the resource, you need to add a new Resource Item)

User: Select the user to allocate the resource to. Use SYSTEM to allocate resources for system use. (If you
can't see the user, you need to add a new Resource User)

Start time:

Click the

Select the start month and year from the dropdown lists at the top.

Click the start day to choose it and return to the main dialog.

Select the start hour and minute from the lists on the right-hand side of the main dialog

(Calendar) button to display the calendar:

Note that you cannot select a start day or time that's in the past!
Hint: Screening Room will warn that the start time is after the end time, but set it as requested. To
avoid this warning, set the end time first, then the start time.

End time: select the end date and time in the same way as the start date and time.

Duration: This changes to show how long you are allocating the resource for. You cannot edit it directly.

Click the Add button to add the Resource Allocation. The system will check that the resource you've
requested is free for the requested period and:

If the resource isn't free, the request will be refused with this error message:

Ascom Network Testing Ltd., 2000-2013

Page 90 of 129

03 June 2013

Screening Room User Guide

Chapter 10 - Agent Resource Management

Click OK to acknowledge the message and return to the main window.

If the resource is free for the requested period, you will return to the Resource allocations screen
with the new allocation listed like this:

Repeat the process to add further resource allocations as required.

Notice the Granted column on the Resource Allocations screen.. Yes with a green background means the Resource
Allocation was granted (the requested allocation has been made). No with a red background, means the allocation
was not granted, because it clashes with a dynamic allocation. (Failed allocations occur when a script attempts to
acquire a resource dynamically i.e. without a previous allocation to the script's owner.)

Editing a Resource Allocation


Note: You can edit current and future allocations that were made manually with Screening Room, as follows. You
cannot edit allocations that are in the past, or dynamic allocations that were made by scripts requesting resources.
To edit a Resource Allocation:

Click the

This displays the current definition in the Edit allocation dialog:

button to the left of the allocation, on the Resource allocations screen

Ascom Network Testing Ltd., 2000-2013

Page 91 of 129

03 June 2013

Screening Room User Guide

Chapter 10 - Agent Resource Management

Edit the Item, User, Start time and End time fields as required (for details see Adding a Resource Allocation)

Click Apply to make the changes and the system will check that the resource is free for the revised period:

If the resource isn't free, an error message will be displayed as described above. Click OK to return to
the main window - the change will be rejected.

If the resource is free, the change will be made and you will return direct to the main window.

Deleting a Resource Allocation


You can delete current and future Resource Allocations that were made manually with Screening Room, as
follows. You cannot delete allocations that are in the past, allocations that are in use, or dynamic allocations that
were made by scripts requesting resources.
To delete a Resource Allocation:

Click the

Click OK to delete it

button to the left of the allocation on the Resource allocations screen.

Deleting a Resource Allocation will free that resource for the previously allocated time.

Resource Usage
To check resource usage - which resources were acquired (booked), when, by which testruns:

Choose the Resource usage option on the main Resources screen

Ascom Network Testing Ltd., 2000-2013

Page 92 of 129

03 June 2013

Screening Room User Guide

Chapter 10 - Agent Resource Management

This will list current and past resource usage on the Resource usage screen:

Notice the Granted column. This shows which resource usage attempts succeeded (Yes with a green
background) and which failed (No with a red background), typically because of clashes with previous
allocations or bookings. Use the Resource graphing option to check which (its block graph is easier to
interpret).

You can change the report format (number of usages shown, block or row format) and filter by item, user,
testrun, status, or grant by using the controls in the table header.

Note: This is a read-only report of historical (past) and current information - you cannot edit any of the information
shown.
Hint: Use the Resource graphing option to compare resource allocations with resource usage.

Resource graphing
Note: The resource graphs plot times using GMT (Greenwich Mean Time), but when you create resource
allocations you specify the start times using local (system) time.
To display resource allocations and resource bookings over time, in graph form:

Chouse the Resource graphing option on the main Resources screen:

Ascom Network Testing Ltd., 2000-2013

Page 93 of 129

03 June 2013

Screening Room User Guide

Chapter 10 - Agent Resource Management

This will display the Resource graph screen:

Use 1. Time period to set the period to plot usage for:

Period starts: select the start date and time from the three dropdown lists. The earlier start you can
select is for the start of the earliest resource allocation or booking

Period ends: select the end date and time from the three dropdown lists. The latest end you can select
is for the end of the latest resource allocation or booking

Use 2. Filter on resource item to choose the Resource Item to plot usage for:

Item: to plot bookings for a particular resource item, select its name from the dropdown list. To plot
bookings for all items, leave set to All

Use 3. Filter on resource user to choose the Resource User to plot usage for:

Ascom Network Testing Ltd., 2000-2013

Page 94 of 129

03 June 2013

Screening Room User Guide

Chapter 10 - Agent Resource Management

User: to plot allocations and bookings for a particular user, select their name from the dropdown list.
To plot bookings for all users, leave set to All

Use 4. Customise graph appearance to change how the graph looks:

Allocation: choose Not smoothed to plot each booking length as a separate point, or Averaged per
minute/hour/day/year to plot averages over time. Averaging makes it easier to spot trends, but might
hide fluctuations or patterns that are important to you

Usage: choose Not smoothed to plot each usage period as a separate point, or Averaged per
minute/hour/day/year to plot averages over time. Averaging makes it easier to spot trends, but might
hide fluctuations or patterns that are important to you

Metric range: if using smoothed results, choose one of these options to add or remove curves
showing the upper and/or lower values:

Maximum & minimum limits

Maximum limit

Minimum limit

Neither limit

Size: Choose the graph width (Narrow/Normal/Wide) from the first control, and graph height
(Short/Normal/Tall) from the second

Style: Choose the line style (Thin line or Thick line) from the first control, and the point style (No
points, Small points or Large points) from the second

Override Y-max: The Y-axes are chosen automatically so that the longest allocated and booked
periods plotted just fit. If you wish, you can override this process by typing a maximum Y axis value
in this box. You might use this, for example, to normalize the two curves so they are directly
comparable, or to remove spurious data from the graph.
For example, if periods are mostly in the range 150-200 seconds, with just one rogue value of 2000
seconds, the default Y axis will be 0-2000 seconds, compressing the details in the rest of the graph.
Type 200 in the Override Y-max box to ignore the rogue value and reveal the variations in the other
values, if they are of more interest.
If you set the maximum, any data points which go off the top of the graph will be shown by vertical
arrowheads.

Once the options are set as you wish, click Next to plot the graphs. You can choose a line graph, a block
graphs, or both:

Ascom Network Testing Ltd., 2000-2013

Page 95 of 129

03 June 2013

Screening Room User Guide

Chapter 10 - Agent Resource Management

You can use the graphs to check whether resources are being allocated for longer than needed, or to spot
idle times.

Hover over any data point on a graph to display a description of that data.

Ascom Network Testing Ltd., 2000-2013

Page 96 of 129

03 June 2013

Screening Room User Guide

Chapter 10 - Agent Resource Management

The Usage and allocation line graph

The Usage and allocation block graph

Ascom Network Testing Ltd., 2000-2013

Page 97 of 129

03 June 2013

Appendix A - Response Codes


HTTP v1.x status codes
Application servers may return the following HTTP-defined status codes to Monitor Master.
100 Continue
101 Switching Protocols
200 OK
201 Created
202 Accepted
203 Non-Authoritative Information
204 No Content
205 Reset Content
206 Partial Content
300 Multiple Choices
301 Moved Permanently
302 Moved Temporarily
303 See Other
304 Not Modified
305 Use Proxy
400 Bad Request
401 Unauthorized
402 Payment Required
403 Forbidden
404 Not Found
405 Method Not Allowed
406 Not Acceptable
407 Proxy Authentication Required
408 Request Timeout
409 Conflict
410 Gone
411 Length Required
412 Precondition Failed
413 Request Entity Too Large
414 Request-URI Too Long

Ascom Network Testing Ltd., 2000-2013

Page 98 of 129

03 June 2013

Screening Room User Guide

Appendix A - Response Codes

415 Unsupported Media Type


500 Internal Server Error
501 Not Implemented
502 Bad Gateway
503 Service Unavailable
504 Gateway Timeout
505 HTTP Version Not Supported

Ascom Network Testing Ltd., 2000-2013

Page 99 of 129

03 June 2013

Appendix B - Testrun Reports


This Appendix describes the additional (legacy) reports that are accessible from the Screening Room's Functional
View, Regression View or Monitoring View.
To produce one of these reports:

Display one of the Screening Room views (e.g. select the functional link from the Screening Room Home
screen):

Mark the testruns to include in the report, by ticking their checkboxes in the Test Runs pane:

Right-click the pane and select Report marked from the popup menu

Ascom Network Testing Ltd., 2000-2013

Page 100 of 129

03 June 2013

Screening Room User Guide

Select the report type you want from the dropdown list:

Appendix B - Testrun Reports

High detail content listing


Medium detail content listing
Low detail content listing
Compliance errors and broken links
All device errors and usability
Cosmetic device errors
Functional device errors
Other device errors
Usability errors
Loading
Messages
User events
Metrics
Response delay
Delta timings
Graphical timing
Test and test run performance
Transaction timings
Script
Site map
Applied device test cases

Click Launch

An example of each report type is provided over the next few pages, for the same two testruns in each case.

The High detail content listing


The Screening Room's High detail content listing report (launched from the Test Runs panel) looks like this:

Ascom Network Testing Ltd., 2000-2013

Page 101 of 129

03 June 2013

Screening Room User Guide

Appendix B - Testrun Reports

The Medium detail content listing


The Screening Room's Medium detail content listing report (launched from the Test Runs panel) looks like this:

Ascom Network Testing Ltd., 2000-2013

Page 102 of 129

03 June 2013

Screening Room User Guide

Appendix B - Testrun Reports

The Low detail content listing


The Screening Room's Low detail content listing report (launched from the Test Runs panel) looks like this:

Ascom Network Testing Ltd., 2000-2013

Page 103 of 129

03 June 2013

Screening Room User Guide

Appendix B - Testrun Reports

The Compliance errors and broken links report


The Screening Room's Compliance errors and broken links report (launched from the Test Runs panel) looks like
this:

Ascom Network Testing Ltd., 2000-2013

Page 104 of 129

03 June 2013

Screening Room User Guide

Click a section's

Appendix B - Testrun Reports

button to expand it, to show more details. For example:

Ascom Network Testing Ltd., 2000-2013

Page 105 of 129

03 June 2013

Screening Room User Guide

Appendix B - Testrun Reports

The All device errors and usability report


The Screening Room's All device errors and usability report (launched from the Test Runs panel) looks like this:

Ascom Network Testing Ltd., 2000-2013

Page 106 of 129

03 June 2013

Screening Room User Guide

Click a section's

Appendix B - Testrun Reports

button to expand it, to show more details. For example:

The Cosmetic device errors report


The Screening Room's Cosmetic device errors report (launched from the Test Runs panel) looks like this:

Ascom Network Testing Ltd., 2000-2013

Page 107 of 129

03 June 2013

Screening Room User Guide

Click a section's

Appendix B - Testrun Reports

button to expand it, to show more details. For example:

The Functional device errors report


The Screening Room's Functional device errors report (launched from the Test Runs panel) looks like this:

Ascom Network Testing Ltd., 2000-2013

Page 108 of 129

03 June 2013

Screening Room User Guide

Click a section's

Appendix B - Testrun Reports

button to expand it, to show more details. For example:

The Other device errors report


The Screening Room's Other device errors report (launched from the Test Runs panel) looks like this:

Ascom Network Testing Ltd., 2000-2013

Page 109 of 129

03 June 2013

Screening Room User Guide

Click a section's

Appendix B - Testrun Reports

button to expand it, to show more details. For example:

The Usability errors report


The Screening Room's Usability errors report (launched from the Test Runs panel) looks like this:

Ascom Network Testing Ltd., 2000-2013

Page 110 of 129

03 June 2013

Screening Room User Guide

Click a section's

Appendix B - Testrun Reports

button to expand it, to show more details. For example:

The Loading report


The Screening Room's Loading report (launched from the Test Runs panel) looks like this:

Ascom Network Testing Ltd., 2000-2013

Page 111 of 129

03 June 2013

Screening Room User Guide

Appendix B - Testrun Reports

The Messages report


The Screening Room's Messages report (launched from the Test Runs panel) looks like this:

Ascom Network Testing Ltd., 2000-2013

Page 112 of 129

03 June 2013

Screening Room User Guide

Click a section's

Appendix B - Testrun Reports

button to expand it, to show more details. For example:

Ascom Network Testing Ltd., 2000-2013

Page 113 of 129

03 June 2013

Screening Room User Guide

Appendix B - Testrun Reports

The User events report


The Screening Room's User events report (launched from the Test Runs panel) looks like this:

Ascom Network Testing Ltd., 2000-2013

Page 114 of 129

03 June 2013

Screening Room User Guide

Click a section's

Appendix B - Testrun Reports

button to expand it, to show more details. For example:

Ascom Network Testing Ltd., 2000-2013

Page 115 of 129

03 June 2013

Screening Room User Guide

Appendix B - Testrun Reports

The Metrics report


The Screening Room's Metrics report (launched from the Test Runs panel) looks like this:

Click a section's

button to expand it, to show more details. For example:

Ascom Network Testing Ltd., 2000-2013

Page 116 of 129

03 June 2013

Screening Room User Guide

Appendix B - Testrun Reports

The Response delay report


The Screening Room's Response delay report (launched from the Test Runs panel) looks like this:

Ascom Network Testing Ltd., 2000-2013

Page 117 of 129

03 June 2013

Screening Room User Guide

Click a section's

Appendix B - Testrun Reports

button to expand it, to show more details. For example:

Ascom Network Testing Ltd., 2000-2013

Page 118 of 129

03 June 2013

Screening Room User Guide

Appendix B - Testrun Reports

The Delta timings report


The Screening Room's Delta timings report (launched from the Test Runs panel) looks like this:

Click a section's

button to expand it, to show more details. For example:

Ascom Network Testing Ltd., 2000-2013

Page 119 of 129

03 June 2013

Screening Room User Guide

Appendix B - Testrun Reports

The Graphical timing report


Note: This report requires you to select 3 or more scripts.
The Screening Room's Graphical timing report (launched from the Test Runs panel) looks like this:

Ascom Network Testing Ltd., 2000-2013

Page 120 of 129

03 June 2013

Screening Room User Guide

Appendix B - Testrun Reports

The Test and test run performance report


The Screening Room's Test and test run performance report (launched from the Test Runs panel) looks like this:

Ascom Network Testing Ltd., 2000-2013

Page 121 of 129

03 June 2013

Screening Room User Guide

Click a section's

Appendix B - Testrun Reports

button to expand it, to show more details. For example:

Ascom Network Testing Ltd., 2000-2013

Page 122 of 129

03 June 2013

Screening Room User Guide

Appendix B - Testrun Reports

The Transaction timings report


The Screening Room's Transaction timings report (launched from the Test Runs panel) looks like this:

Click a section's

button to expand it, to show more details. For example:

Ascom Network Testing Ltd., 2000-2013

Page 123 of 129

03 June 2013

Screening Room User Guide

Appendix B - Testrun Reports

The Script report


This report is no longer supported.

The Site map report


Note: This report is only suitable for a Web or WAP script. You must select a single script.
The Screening Room's Site map report (launched from the Test Runs panel) looks like this:

Ascom Network Testing Ltd., 2000-2013

Page 124 of 129

03 June 2013

Screening Room User Guide

Appendix B - Testrun Reports

The Applied device test cases report


The Screening Room's Applied device test cases report (launched from the Test Runs panel) looks like this:

Ascom Network Testing Ltd., 2000-2013

Page 125 of 129

03 June 2013

Screening Room User Guide

Click a section's

Appendix B - Testrun Reports

button to expand it, to show more details. For example:

Ascom Network Testing Ltd., 2000-2013

Page 126 of 129

03 June 2013

Screening Room User Guide

Index

Index
A

resource users, 85

Adding

Delta timings report, 119

Agent resource allocations, 88

Device update, 77

Agent resource items, 81

Dimensions option

Agent resource users, 85

Message types, 69

local schedules, 72

Metrics, 68

Agent

Overview, 67

schedules, 70

Plans, 67

Agent resource management

Tests, 67

overview, 81

Timings, 69

screen, 80

Transactions, 68

scripts, 80

All device errors and usability report, 106

Each Testrun view, 21, 35, 37

Applied device test cases report, 125

Editing

Local Schedules, 75

Broken links report, 104

Resource Allocations, 88

Resource Items, 81

Central Mode and Local Mode, 6

Resource Users, 85

Central Schedules, 70

Exporting Data from Screening Room, 13

Comparing graphs, 47

Extended Summary view, 21, 35, 37

Compliance errors report, 104

Content detail panel, 31

Functional device errors report, 108

Content panel, 27, 40

Functional view, 17

Content summary panel, 29

Cosmetic device errors report, 107

Graphical timing report, 120

Creating the Plan Dashboard, 41

Cumulative Plan Dashboard graphs, 50

High detail content listing report, 101

Customising the Plan Dashboard, 45

Interpreting the Plan Dashboard, 44

Deleting

Introducing Screening Room, 5

local schedules, 76

resource allocations, 88

Launching Screening Room, 9, 10, 11

Resource Items, 81

Loading report, 111

Ascom Network Testing Ltd., 2000-2013

Page 127 of 129

03 June 2013

Screening Room User Guide

Index

Local Mode and Central Mode, 6

Local Schedules

Recent Message Facts option

Adding, 72

Display options, 58

Custom, 73

Filters, 64

Deleting, 76

Links, 65

Editing, 75

Screen layout, 63

Overview, 70

Using, 57

Passing parameters, 72

Recent Metric Facts option

Low detail content listing report, 103

Display options, 58

Filters, 59

Main menu options, 6

Links, 60

Manipulating Plan Dashboard graphs, 47

Screen layout, 59

Medium detail content listing report, 102

Using, 57

Message Facts Display options, 58

Recent Success Facts screen

Message types option, 69

Recent Success Facts Display options, 53

Messages report, 112

Recent Success Facts Filters, 55

Metrics option, 68

Recent Success Facts Links, 55

Metrics report, 116

Recent Success Facts report, 55

Metrics, Messages and Timings option, 57

Screen layout, 53

Monitoring view, 33

Using, 53

Recent Tests and Availability option, 53

Other device errors report, 109

Recent Timing Facts option

Other reporting facilities, 7

Display options, 58

Other scheduling facilities, 7

Recent Timing Facts Filters, 62

Recent Timing Facts Links, 63

Plan Dashboard

Screen layout, 61

Creating, 41

Using, 57

Customising, 45

Refresh control, 13

Interpreting, 44

Regression view, 36

Plan Dashboard option, 41

Reports

Plans and Tests panel, 18, 34, 37

Examples, 100

Plans option, 67

Exporting, 13

Popup_menu, 20

Printing, 12

Preview panel, 32

Resource allocations option, 88

Printing

Resource graphing option, 93

Reports from Screening Room, 12

Resource items option, 81


Resource Management

Ascom Network Testing Ltd., 2000-2013

Page 128 of 129

03 June 2013

Screening Room User Guide

Index

agent resource management, 81

Script report, 124

agent resource management screen, 80

agent resource management scripts, 80

Tabular Summary view, 20, 35, 37

Resource management option, 80, 81

Test run performance report, 121

Resource usage option, 92

Test Runs panel, 20, 35, 37

Resource users option, 85

Testrun Reports, 100

Response Codes, 98

Testrun Summary panels, 25, 36, 40

Response delay report, 117

Tests panel, 18, 34, 37

Thresholds, 48

Schedules

Timings option, 69

adding local schedules, 72

Transaction timings report, 123

Agent schedules, 70

Transactions Report, 68

central schedules, 70

deleting local schedules, 76

Usability errors report, 110

editing local schedules, 75

User events report, 114

local schedules, 70

Using

passing parameters to local schedules, 72

Agent Resource Management option, 80

types of, 70

Device update option, 77


Dimensions option, 67

Screening Room
Controls, 11

Local Schedules, 70

Exporting reports, 13

Plan Dashboard option, 41

Home screen, 14

Recent Metric/Message/Timing Facts option, 57

Launching, 9

Recent Success Facts option, 53

Overview, 5

Recent Tests & Availability option, 53

Printing reports, 12

Screening Room, 11

Reports, 12, 13

Screening Room option, 16

Screening Room option, 16

Using, 5, 9, 11

Watching Plan Dashboard data, 51

Views, 17, 33, 36

Ascom Network Testing Ltd., 2000-2013

Page 129 of 129

03 June 2013

Das könnte Ihnen auch gefallen