NQDI

Training
By Alessandro Esposito

20 January
SwissQual 2000-2010
CONFIDENTIAL MATERIALS

Table of Contents

Platform Overview
Database Management
Data Management
Data Analysis
Reports, Queries, KPI and Maps
System Operation Practice Session

Confidential

CONFIDENTIAL MATERIALS

Platform Overview
Agenda ->

Confidential

CONFIDENTIAL MATERIALS

Post Processing Complete

Solution

Confidential

CONFIDENTIAL MATERIALS

NQDI Highlights

NQDI means NetQual Database Interface

Post-processing application based on SQL Server database
Client / Server Architecture for Standalone as well as Enterprise
configuration options
Import and handling of data from all SwissQual platforms
Filtering and data mining
Intelligent drill down analysis
Map analysis and export
KPI Statistics
Historical trending
Reporting
Database querying / mining
New external OPT Optimization
module

Confidential

CONFIDENTIAL MATERIALS

Architecture
Layered structure
Different possible deployments
Standalone
(Multi) Client Server

Standalone

Client Server
CONFIDENTIAL MATERIALS
Confidential

External tools
SQL Enterprise Manager (MS SQL 2008)
Managing databases
Databases backup

SQL Query Analyzer (MS SQL 2008)

View tables, functions, views, procedures
Workspace for creating queries

SQL Server Management Studio (MS SQL 2008)

MapInfo
Google Earth
Confidential

CONFIDENTIAL MATERIALS

Enhanced Post Processing

Horizontal or Vertical approach
Horizontal

Call analysis (statistics) and trending analysis available

Rich and powerful report generation tools
Map plots and grid plots generation
Integration with Google Earth

Vertical
Call quality
Detailed (layers 1, 2 and 3) analysis of calls or data sessions
Analysis of speech quality
Analysis of video quality (for video calls, video streaming and
DVB-H)
Analysis of data tests
Analysis of messaging tests
Confidential

CONFIDENTIAL MATERIALS

Database Management
Agenda ->

Confidential

CONFIDENTIAL MATERIALS

Open Database Structure

The structure of the entire NQDI
database is described in the Manual NQDI - Database structure.pdf document
Description of all the tables
Description of the relations
Descriptions of views
Description of stored procedures

Confidential

CONFIDENTIAL MATERIALS

NQDI Database Structure

0..n

NQDI Tables

Configuration Tables
System Tables
Measurement Result
Tables
Position Tables
Network Information
Table
Audio Recordings
Table
Other Tables

Confidential

PosId

0..n

PosId
1
NetworkInfo

MNC,
MCC,
CId,
LAC

NetworkI
d

Position

FileId

0..1

SessionId

0..1

DataSessio
n

PosId

SessionId

NetworkI
d

SessionId

0..n
0..n

SessionId

BTSList

TestInfo

0..1
Msg
Msg
Msg
Msg

CallSession

SessionId
1..n
0..n
Sessions

NetworkI
d 0..n

0..n

FileList

TestId
1..n

CONFIDENTIAL MATERIALS

SampleSampleId 0..1 SettingsInf

o

1
TestId
1..n
Result..

Basic Database Management

sa user must be used
Startup Auto Log In
Within NQDI
Database creation
Database deletion
Database update

With the external tools

Database copy
Database backup
Database migration

CONFIDENTIAL MATERIALS
Confidential

Exporting Databases

Database export is also possible from within NQDI

Creation of historical databases
Possibility to save up to 95% disk space

CONFIDENTIAL MATERIALS
Confidential

Data Management
Agenda ->

Confidential

CONFIDENTIAL MATERIALS

Data Management
Import Data
Manually or automatically defining collection names
Automatically evaluate KPI and other parameters (through SQL
scripts)
Possibility to define Event queries and have them run at import time

Remove Data
Can delete data according to given collection, campaign,
file or data scope
Can remove data at
different levels

Maintain data
(collection names)

Confidential

CONFIDENTIAL MATERIALS

Sessions I
One session: from CONNECT command
until the DISCONNECT/RELEASE
Each measurement file from QualiPoc or Diversity can
contain multiple sessions
In QualiPoc there is one measurement file for each Job
In Diversity there is one measurement file for each Task
Sessions can be of different type
CALL - Voice and Video calls
DATA - GPRS, SMS, broadcast
(e.g. DVB-H)
IDLE
Time between CALL or DATA sessions
Idle or Scanner Only tests
Confidential

CONFIDENTIAL MATERIALS

Sessions II
Tests in multi transfer mode (e.g. Multi-RAB or DTM)
involve multiple IDLE and DATA sessions
Sessions are separate but are grouped together
Can be filtered according to the transfer mode

Sessions can contain one or more Tests

Test can be of different type
Speech, ping, FTP, video streaming, SMS send, DVB-H, etc.

Confidential

CONFIDENTIAL MATERIALS

Choosing the Data to Analyse

Data filtering / selection

Save current selection

Load saved selection
Manage selections

Store Data Selection

Query in DB

Used for NQWeb

Polygon filtering

Session not considered if not

entirely within the polygon

CONFIDENTIAL MATERIALS

Available Selection Criteria

Campaign name
Test description = Job name
Task Name
Session type
Transfer mode
Date and time

Test
Type of test
Test results

Confidential

Home or serving operator

Cell
Location Area
Technology

Layer
GSM, GPRS or UMTS L3
messages

Map
Polygon regions

User
User comments
Alarms
Any SQL script

KPI
Predefined KPI
Custom KPI
Custom events

Operator

Call
Call status
Call type

Device
Measurement device type
IMEI
Firmware

General

AND MUCH MORE!

CONFIDENTIAL MATERIALS

Cockpit View
Summary of current selection (Customize Thresholds)

CONFIDENTIAL MATERIALS
Confidential

Data Analysis
Agenda ->

Confidential

CONFIDENTIAL MATERIALS

Rich Session Specific Data

Display
Vertical approach
For each different type of test all and only the
appropriate or relevant tabs are displayed
Different types of calls/sessions Test information

Data sessions
Messaging sessions
Voice or Video calls
Video streaming and Broadcasting sessions

Radio information is always displayed

From the measuring device
For traced devices

Scanner information if available

If calls fulfils the standard requirements, Call quality is
also shown for voice calls
Confidential

CONFIDENTIAL MATERIALS

Analysis Tab Overview

Session overview Current Selection
Red Current session and test
White Other sessions or tests in the current selection
Gray Other sessions or tests in the scope but not in the current
selection

Confidential

CONFIDENTIAL MATERIALS

Information Organization
Information is divided into logical sub tabs

Tabs shown dynamically based on the content in the selected session and test
Session info
Test results (Service layer)

Protocol info (IP layer)

Scanning (RF layer)

Separated for WCDMA and GSM

Network technology (Layer1 to Layer3)

Listening quality, FTP, HTTP, etc.

Separated for GSM, GPRS/EDGE and UMTS

Separate Tab for B side, GSM (B), UMTS (B)

KPI

Voice Call (GSM)

Video Streaming
FTP Test
Confidential

CONFIDENTIAL MATERIALS

Analysis Details
Graph manipulation
Layer 3 filtering

Confidential

CONFIDENTIAL MATERIALS

Call Status Definition

Completed
Audio connection
Correct counterpart
Intentionally terminated

Dropped
Audio connection
Correct counterpart

Failed
No audio connection
Wrong counterpart

System Release
Call ended by user
Call ended because of equipment constraints
Confidential

CONFIDENTIAL MATERIALS

Data Session Status

Definition

Failed
No data connection could be established

Attach failed
PDP context activation failed or rejected
PPP authentication failed
No network coverage
Device hardware issue

Dropped
Data connection established
Connection ended before the end of the defined test session
Network forces a PDP deactivation
Network coverage lost
Device hardware issue (i.e. reboot)

Completed
Data connection established
PDP context deactivation (e.g. disconnect) driven by test session

System Release
Call ended by user
Call ended because of equipment constraint

Confidential

CONFIDENTIAL MATERIALS

Listening Quality Analysis

SQuad LQ MOS
(Narrow and/or
Wideband)
P.852 MOS
(optional)
Quality Cause
code
Signal and Noise
levels, SNR
Delay
Clipping
Speech Activity
Gain
DC offset
Frequency shift
Clip replay

CONFIDENTIAL MATERIALS

Data Analysis TCP/IP

Timestamps
Protocols
IP addresses
Port numbers
Header info
IP throughput
Packet count
Packet
sequence

CONFIDENTIAL MATERIALS
Confidential

Data Analysis FTP

FTP operation
File name
Throughput
Transfered
bytes
MCC-MNC

CONFIDENTIAL MATERIALS

Video Streaming Analysis

Video MOS
Quality Cause
code
Frame rate
Freezing
Matched
frames
Blurring
Blockiness
Jerkiness
PSNR
Lip Sync
Player and
Protocol
Clip replay

CONFIDENTIAL MATERIALS
Confidential

Analysis Streaming Media layer

Media Codec
Protocol analysis
Frame-by-Frame
analysis
Codec
parameters
Content
parameters
Frame type
display
IP throughput

Confidential

CONFIDENTIAL MATERIALS

GSM Scanner Analysis

Channel
Overview
Serving and
Neighbour
channels
Best server
Hot channels
RxLev, BSIC,
C/I
Operator
filtering
Markers
Optional CGI
decode and
multiple BSIC

CONFIDENTIAL MATERIALS
Confidential

WCDMA Scanner Analysis

Channel
Spectrum
(LX only)
Top CPICH
SC RSCP and
Ec/No
PSCH and
SSCH Ec/No
Delay Spread

CONFIDENTIAL MATERIALS
Confidential

CDMA Scanner Analysis

SC
Ec/No,
RSCP
Best
CPICH

CONFIDENTIAL MATERIALS
Confidential

GSM Network Analysis

GSM radio RF
BCCH and TCH
ARFCN
RxLev, RxQual, FER,
C/I
Codec type and rate
HSN, MAIO
DTX, TxPwr, TA, RLT
Measurement report
Serving Cell
Layer 3 message
decode
Markers
Home and Serving
operator
Cell-Id and LAC

CONFIDENTIAL MATERIALS

GPRS/EDGE Network Analysis

SNCDP, LLC,
RLC info
TBF state
Coding Scheme
TS allocation
EDGE BEP Info
RLC and LLC
throughput
RLC BLER
TxPwr, BLER,
target SIR
MAC info
GMM and SM
Signalling plane
CS and TS
allocation
statistics

CONFIDENTIAL MATERIALS

UMTS Network Analysis

WCDMA radio RF
IRAT neighbor list
UARFCN
RRC State
RSSI, RSCP, Ec/Io
TxPwr, BLER, target
SIR
Active, Monitor,
Detected set
Spreading Factor
Power Control info
RRC and NAS
signalling decode
Markers
Home and Serving
operator
CellId and LAC

CONFIDENTIAL MATERIALS

Analysis - HSDPA

SSCH Scheduling
SSCH Allocation
Throughputs:
Requested,
Scheduled,
HS-DSCH,
MAC-HS
UE Category
CQI
ACK, NACK status
HARQ Statistics
HS-DSCH
Modulation
RLC and MAC layer
allocation

Confidential

CONFIDENTIAL MATERIALS

Analysis - HSUPA

HSUPA(EUL)
Status indication
Radio Link Set
presentation
E-DCH and MAC-e
configuration
E-DCH Scheduling
and Reporting
information
HARQ Statistics
Throughputs:
Requested,
Scheduled,
E-DCH,
MAC-E
Serving Grant
Absolute Grant
Relative Grant

Confidential

CONFIDENTIAL MATERIALS

CDMA Network Analysis

RLP
Throughput
Monitor
Rx/Tx Vocoder
Rate
Active,
Candidate and
Neighbor Set
Finger Monitor
Layer3
signalling
Power Control
Info
IS-95/IS-2000
MUX Statistics

CONFIDENTIAL MATERIALS

Reports, Queries, KPI and Maps

Agenda ->

Confidential

CONFIDENTIAL MATERIALS

Reports
Horizontal approach
Wide set of predefined reports and KPI reports
Custom KPI reports
Possibility to generate Trending Analysis

Custom reports
Multi step process
Advanced functionality
Requires SQL query language, Excel Macro and Pivot
Table knowledge

Custom SQL scripts

For any kind of database data manipulation
Can be set to run during import process
CONFIDENTIAL MATERIALS

Map Plot Selection

Map Tab to see Map Plots
Values to plot ordered in a
tree structure
GSM Mobile
Mobile Layer 1 Measurements
RxQualFull

Grids or Points can be used

Favorites Plots can be
stored as well

Needed to include Maps in Reports

CONFIDENTIAL MATERIALS

Map window Plot types

Point plot
Plot values as stored in the database
point by point
Best for smaller areas
Needed for detailed analysis
Warning! Huge data sets can take
long time to plot

Radial map plot

Grid plot
Plot values averaged over grid
squares
Best for overview plots over large
areas
Confidential

CONFIDENTIAL MATERIALS

Map Plot Configurator

Predefined shade
Customizable shade
per value
User defined map
plots
KPI map plot wizard

Confidential

CONFIDENTIAL MATERIALS

Reports including pictures

Option to add pictures from Favorite Map plots in a report (new sheet for every map window)
Where: Configuration Report Configurator

Confidential

CONFIDENTIAL MATERIALS

Export to Google Earth

Display collected data on satellite maps from Google Earth

Provides 3D views (compared to the standard 2D views of MapInfo
Photo realistic maps offer more details and more information to
troubleshoot network issues
I.e. those related to specific geographical circumstances

Any value can be plotted onto the integrated MapInfo map or

exported to Google Earth
Possibility to store the representation in a Google Earth file format
(.kmz)
Requires Google Earth installed on the client
Requires the client to have Internet access

Confidential

CONFIDENTIAL MATERIALS

System Operation Practice Session

Agenda ->

Confidential

CONFIDENTIAL MATERIALS

Lets do it!

Create a new database

Import some measurement files into the database
Explore the Selection tabs and make different selections
Test the Cockpit View
Select all sessions where HandOverFromUTRANCommand-GSM message
was received
Analysis

Open different type of session and tests

Study the different sub tabs
Drag and drop values to show them on the charts
Expand Layer 3 messages

Reports generation
Select all the available sessions
Create some QualiPoc specific report

Define and generate a custom KPI report

Confidential

CONFIDENTIAL MATERIALS

So far any

Question?

Confidential

CONFIDENTIAL MATERIALS