National Planning and Performance

UMTS Optimization Plan

May, 2008
Version 13

FSC UMTS Support Team

Agenda

UMTS KPIs Targets

UMTS optimization process

Cluster Unloaded Optimization

Drive Test Configuration

Cluster Loaded and Late Sites Optimization

Drive Test Configuration

Market Loaded Optimization

Drive Test Configuration

Support Information

1- UMTS KPIs Overview

Why these KPIs?
Voice centric optimization
Packet KPIs are reported and actions taken only if KPIs are very poor
Report customer experience KPIs at market level

How to get there?

Cell coverage analysis
Pilot pollution analysis
3G and 2G neighbor list optimization based on scanner data
Dropped call analysis
Access failure analysis
Troubleshoot system wide issues affecting call setup time, latency and throughput

Test cases
Cluster unloaded and loaded
Market loaded

1- UMTS Voice/Data Cluster

Acceptance KPIs

UMTS Voice Unloaded/Loaded

Metric

Access Fails

Drops

DL/UL Quality

Target

2.0 %

2.0 %

95 % 2 %

Call Setup
Time
95 % 6
sec

Value from
drive

UMTS R99 and/or HSDPA Data

Metric

Target

Access Fails

Drops

Green
2.5%

Green 2.5%

Yellow
5.0%

Yellow 5.0%
Red > 5.0%

Throughput (DL/UL)
Latency
R99 210/180 kbps
HS 600 kbps

Call Setup
Time

95 % 5
sec

Red > 5.0%

R99 200 ms

Target

HS 120 ms

Value from
drive

GSM Voice

UMTS Cluster

1- UMTS Voice/Data Market Launch KPIs

UMTS Voice Unloaded/Loaded
Metric

Access Fails

Drops

DL/UL Quality

Target (IRAT Off)

2.0 %

2.0 %

95 % 2 %

Target (IRAT On)

GSM or Better

GSM or Better

Better than
IRAT Off

Call Setup
Time
95 % 6
sec
95 % 6
sec

Value from drive

UMTS R99 and/or HSDPA Data

Metric
Target
Value from drive

NA
NA
NA

NA
NA
NA

NA
NA
NA

GSM Voice

UMTS Market

Metric

Access Fails

Drops

Call Setup
Time

Target

X.X %

X.X %

X.X%

NA
NA
NA

Green GSM
Yellow > GSM
Red > UMTS
Target

Agenda

UMTS KPIs Targets

UMTS optimization process

Cluster Unloaded Optimization

Drive Test Configuration

Cluster Loaded and Late Sites Optimization

Drive Test Configuration

Market Loaded Optimization

Drive Test Configuration

Support Information

2- UMTS Optimization Process

2- UMTS Optimization Process

Cluster and Late Sites Optimization
Configurations
Drive Test Setup

Summary
Laptop 1

Device
Cluster
Unloaded Test
Cases

Type of Call

Mode

Comments

Up to 2 unloaded tests.

Scanner
Voice Short
Voice Long

DUAL
UMTS
UMTS

Scanning both UMTS and GSM

15sec duration and 10sec gap
1800sec duration

Basic RF verification test to identify

and fix swapped feeders, improve
coverage, add missing neighbors

MS4

PS DL/UL 2MB

UMTS

PS R99 test

Device

Type of Call

Mode

Comments

MS1

Scanner

DUAL

Scanning both UMTS and GSM

MS2

Voice Short

UMTS

15sec duration and 10sec gap

MS3

Voice Long

UMTS

1800sec duration

MS4

PS DL/UL 2MB

UMTS

PS R99 test. The final drive will do

HSDPA DL of 10MB and no UL test

MS1
Setup 1
MS2
MS3

Laptop 1

Setup 1

Cluster Loaded
Test Cases

Up to 3 loaded tests plus late sites

optimization
Optimization test to reduce pilot
pollution, improve coverage, quality,
accessibility and retainability of
voice services

Laptop 1 (Stationary, approximate 1.5 hours per location)

Setup 2

Device

Type of Call

Mode

Comments

MS1

PS R99

UMTS

MS2

PS HSDPA

UMTS

5 Dl 10MB, 5 UL 3MB and 1000 32B

ping done one after the other
5 DL 10MB and 1000 32B ping done
one after the other. To follow after MS1

Loaded stationary test

To collect PS performance in
stationary conditions

Laptop 1
Late sites
Loaded Test
Cases

Setup 1

Device

Type of Call

Mode

Comments

MS1

Scanner

DUAL

Scanning both UMTS and GSM

Late sites optimization

MS2

Voice Short

UMTS

15sec duration and 10sec gap

MS3

Voice Long

UMTS

1800sec duration

To integrate sites that became ready

during cluster optimization activities

MS4

PS DL/UL 2MB

UMTS

PS R99 test

2- UMTS Optimization Process

Market Optimization Configurations

Drive Test Setup

Summary

Laptop 1 (IRAT test at the UMTS coverage edge)

Setup 1

Device

Type of Call

Mode

Comments

MS1

Scanner

DUAL

Scanning both UMTS and GSM

MS2

Voice Long

DUAL

Infinite call till HO from UTRAN or drop

MS3

PS DL 10MB

DUAL

MS4

Idle

DUAL

10MB R99 DL till CC from UTRAN or

drop
Idle mode phone (cell reselection)

Device

Type of Call

Mode

Comments

MS1

Scanner

DUAL

Scanning both UMTS and GSM

User experience loaded test.

MS2

Voice Medium

UMTS

120sec duration and 30sec gap

MS3

Voice Medium

DUAL

UMTS, GSM and user experience

(IRAT ON) performance will be
collected

MS4

Voice Medium

GSM

120sec duration and 30sec gap

(allowing time for cell reselection to
UTRAN)
120sec duration and 30sec gap

Market Loaded
Test Cases

To optimize IRAT performance at

market coverage boundary

Laptop 1

Setup 2

Dedicated IRAT test under loaded

conditions

2- UMTS Optimization Process

Cluster Entry/Exit Criteria

Entry Criteria
At least 85% of the sites in cluster have been accepted
Sites are alarm free

Exit Criteria
KPIs have been met and reported including exclusion areas if applied
Full/provisional approval has been granted

Note: a cluster is a group of approximately 54 sites composed of about 3 sub cluster. A

sub cluster is a group of approximately 18 sites.

10

2- UMTS Optimization Process

Late sites (missing sites)

Treatment of late sites

Late sites should be integrated after cluster (sub cluster)
acceptance using the late sites drive test configuration
The drive route should include up to the second tier of
surrounding sites
Performance does not significantly deviate from cluster KPIs
If three or more sites are ready in one cluster (sub cluster) a redrive of the whole cluster (sub cluster) is recommended

11

2- UMTS Optimization Process

Market Entry/Exit Criteria

Entry Criteria
All clusters in the market have been accepted
No crucial sites pending for integration
Sites are alarm free

Exit Criteria
KPIs have been met and reported
Full/provisional approval has been granted

12

Agenda

13

UMTS KPIs Targets

UMTS optimization process

Cluster Unloaded Optimization

Drive Test Configuration

Cluster Loaded and Late Sites Optimization

Drive Test Configuration

Market Loaded Optimization

Drive Test Configuration

Support Information

13

3- Cluster Unloaded Optimization

Drive Test Configurations

Unloaded cluster drive to be repeated

a maximum of 2 times. If more drives
are required an approval from the
UMTS Market manager is required
KPI targets for unloaded test are best
effort.
Issue of change request is permitted
after the last drive without having to redrive the area
LT1 will be run with two simultaneous
command sequences. One for CS and
one for PS to be able to synchronize
the voice calls start and end on a
single TEMS file.
A request has been made to TEMS to
provide a command sequence that fix
the synchronization issues

14

3- Cluster Unloaded Optimization

Drive Test Configurations and KPIs

Setup 1 (Mobile Test)

Laptop 1
Device
MS1
Setup 1
MS2
MS3
MS4

15

Type of Call

Mode

Comments

Scanner
Voice Short
Voice Long

DUAL
UMTS
UMTS

Scanning both UMTS and GSM

15sec duration and 10sec gap
1800sec duration

PS DL/UL 2MB

UMTS

PS R99 test

Voice

PS R99

Access Failure Rate (MS2)

Access Failure Rate (MS4)

Drop Call Rate (MS3)

Drop Call Rate (MS4)

Quality (MS3)

DL Throughput (MS4)

Voice Call Setup Time (MS2)

UL Throughput (MS4)

Handover Factor (MS3)

PS Call Setup Time (MS4)

Agenda

16

UMTS KPIs Targets

UMTS optimization process

Cluster Unloaded Optimization

Drive Test Configuration

Cluster Loaded and Late Sites Optimization

Drive Test Configuration

Market Loaded Optimization

Drive Test Configuration

Support Information

16

4- Cluster Loaded Optimization

Drive Test Configurations
Issue of change request is
permitted after the last drive
without having to re-drive the area
as long as the changes are
minimal
The final drive of Setup 1 will be
done exchanging the PS DL/UL
R99 to HSDPA DL
Setup 2 can be initiated in
parallel to Setup 1 if enough
resources are available. Or it will
follow the Setup 1 optimization.
LT1 in Setup 1 will be run with two
simultaneous command
sequences. One for CS and one
for PS to be able to synchronize
the voice calls start and end on a
single TEMS file.
A request has been made to
TEMS to provide a command
sequence that fix the
synchronization issues of Setup 1

17

4- Cluster Loaded Optimization

Drive Test Configurations and KPIs

Setup 1 (Mobile Test)

Setup 1

Device
MS1
MS2
MS3
MS4

Type of Call
Scanner
Voice Short
Voice Long
PS DL/UL 2MB

Laptop 1
Mode
Comments
DUAL
Scanning both UMTS and GSM
UMTS
15sec duration and 10sec gap
UMTS
1800sec duration
UMTS
PS R99 test. The final drive will do
HSDPA DL of 10MB and no UL test

Possibly more drives will be needed

if HSDPA services impact the voice
performance

Voice

PS R99

HSDPA

Access Failure Rate (MS2)

Access Failure Rate (MS4)

Access Failure Rate (MS4)

Drop Call Rate (MS3)

Drop Call Rate (MS4)

Drop Call Rate (MS4)

Quality (MS3)

DL Throughput (MS4)

DL Throughput (MS4)

Voice Call Setup Time (MS2)

UL Throughput (MS4)

Handover Factor (MS3)

PS Call Setup Time (MS4)

Notes:
1-HSDPA will be tested replacing R99 when HS capable UE is available for the last drive

2-Same setup to be use for late sites optimization

18

4- Cluster Loaded Optimization

Drive Test Configurations and KPIs

Setup 2 (Stationary Test)

Device
MS1
Setup 2

MS2

Laptop 1 (Stationary, approximate 1.5 hours per location)

Type of Call
Mode
Comments
PS R99
UMTS
5 Dl 10MB, 5 UL 3MB and 1000 32B
ping done one after the other
PS HSDPA
UMTS
5 DL 10MB and 1000 32B ping done
one after the other. To follow after MS1

PS R99

HSDPA

DL Average Throughput (MS1)

DL Average Throughput (MS2)

DL Peak Throughput (MS1)

DL Peak Throughput (MS2)

UL Average Throughput (MS1)

Latency (MS2)

UL Peak Throughput (MS1)

Latency (MS1)

HSDPA will be tested when HS capable UE is available

19

The recommended numbered of

stationary locations is 5% of the
sites. This test should be started at
cluster but can be carried over to
market (early identification of issues
is key)

Agenda

20

UMTS KPIs Targets

UMTS optimization process

Cluster Unloaded Optimization

Drive Test Configuration

Cluster Loaded and Late Sites Optimization

Drive Test Configuration

Market Loaded Optimization

Drive Test Configuration

Support Information

20

5- Market Loaded Optimization

Drive Test Configurations

All three setups can be run in parallel. If Setup 1

found IRAT functionality issues Setup 2 (Mobile test)
should be stopped.
The stationary test (setup 2 from cluster) will be
started at cluster testing and can be carried over to
market

21

Setup 2 will be run with a command sequence controlling all

three medium calls.
Setup 1 will be driving from UMTS coverage to GSM till CS and
PS calls handover to GSM or drop
Issue of change request is permitted after the last drive without
having to re-drive the area as long as the changes are minimal

5- Market Loaded Optimization

Drive Test Configurations and KPIs

Setup 1 (IRAT UMTS Boundary Test)

Device
MS1
MS2
MS3
Setup 1

MS4

Laptop 1 (IRAT test at the UMTS coverage edge)

Type of Call
Mode
Comments
Scanner
DUAL
Scanning both UMTS and GSM
Voice Long
DUAL
Infinite call till HO from UTRAN or drop
PS DL 10MB
DUAL
10MB R99 DL till CC from UTRAN or
drop
Idle
DUAL
Idle mode phone (cell reselection)

Setup 1 test should also includes

inter-RNC and inter-switch areas to
test cell change between RNCs and
MSCs
Setup 1 and 2 can be run in parallel,
but if Setup 1 finds IRAT functionality
problems the team should contact
the team doing Setup 2 to stop the
drive

Voice
IRAT HO Failure (MS2)
IRAT CC Failure (MS3)
IRAT CC Interruption Time (MS3)
Time spent in CM (MS2)
Number of CM activations versus IRAT
HO from UTRAN commands (MS2)
Idle mode phone service map (MS4)

22

5- Market Loaded Optimization

Drive Test Configurations and KPIs

Setup 2 (User Experience Mobile Test)

Laptop 1

Setup 2

Device

Type of Call

Mode

Comments

MS1

Scanner

DUAL

Scanning both UMTS and GSM

MS2

Voice Medium

UMTS

120sec duration and 30sec gap

MS3

Voice Medium

DUAL

MS4

Voice Medium

GSM

120sec duration and 30sec gap

(allowing time for cell reselection to
UTRAN)
120sec duration and 30sec gap

UMTS Only

Dual Mode (IRAT On)

GSM Only

Access Failure Rate (MS2)

Access Failure Rate (MS3)

Access Failure Rate (MS4)

Drop Call Rate (MS2)

Quality (MS2)
3G-PSTN Call Setup Time
(MS2)

Drop Call Rate (MS3)

Quality* (MS3)
CM Activation (MS3)
IRAT Failure Rate (MS3)
Percentage of calls that
experienced a Handover to GSM
(MS3)

* Quality will be reported for the time the

UE is in UMTS

23

Drop Call Rate (MS4)

Quality (MS4)
2G-PSTN Call Setup Time
(MS4)

Agenda

24

UMTS KPIs Targets

UMTS optimization process

Cluster Unloaded Optimization

Drive Test Configuration

Cluster Loaded and Late Sites Optimization

Drive Test Configuration

Market Loaded Optimization

Drive Test Configuration

Support Information

24

6- Timeline

NOTES

If in any stage there is a justifiable requirement for an additional drive this needs to be approved by the UMTS
Market manager
Late site optimization will be executed if required. If the cluster is already passing the KPIs without the missing site
and integrating the site will delay the market drives a decision by the UMTS Market manager can be done to proceed
to market acceptance and integrate the site after the Market launch. If the site will help an exclusion area to improve
than it should be integrated into the cluster.

The timeline indicates areas where the stationary tests can be done, but it does not necessary implies that all the
days are required. These days can also use to troubleshoot small areas for example

Timeline

25

6- Cluster vs Market drive density

Cluster Drive Route

Market Drive Route

Cluster drive is more dense than market. The route should also cover part of the intercluster area.
Market drive is less dense but covers more area.

26

6- Market parallel testing possibility

Whole Market drive with Setup 1

Setup 1 drive area (day 1)

Possible Stationary location
Possible IRAT test location

If the market drive route is divided in day routes, IRAT and stationary test can be done in parallel
in the rest of the Market area.
Free resources from cluster can be deploy for market mobile and stationary test

27