Benchmarking Report

Circle:
City:
Month:

Confidential

9/7/15

Nokia 2014

City Map

State Map

Operators

Technology

Band of Operation

Vodafone

GSM

900 & 1800 MHz

Airtel

GSM

1800 MHz

Idea
Tata

Confidential

9/7/15

Nokia 2014

Benchmarked

GSM

900 MHz

Benchmarking Testing Overview

Date & time of testing
City drive route
distance

Tests done

Test Call pattern

1st Apr15 to 7th Apr15

9.00 A.M to 7.00 P.M
Road route 200 Kms Dedi mode test - Coverage footprint
Short call test Blocking, Call setup time, Drop calls, Rx Quality, HOSR,
SQI, C/I
Data call test THROUGHPUT, RTT, Coding Schemes, Timeslot Allocation,
PDP Context
FTP server used for ping: 182.19.95.104
HTTP Link used:http://speedtestluc.vodafone.ind.in/veltube/500kB.XLS
Short calls 90 seconds with 10 seconds break
Long calls --Continuous
Data calls Continuous

Benchmarking Testing Scenario

MS1:- Voice (Short Calls Duration 120 Sec and 20 Sec Wait)
MS2:- Voice (MS1 to MS2 Call )
MS3:- Data with HTTP 3 MB File download

Confidential

9/7/15

Nokia 2014

Cluster Route (With Sites)

Confidential

9/7/15

Nokia 2014

Coverage Footprint - Network Wide (Idle Mode)

Operator
Vodafone

Confidential

Operator -Airtel

9/7/15

Nokia 2014

Coverage Footprint - Network Wide (Idle Mode)

Operator Idea

Confidential

Operator -Tata

9/7/15

Nokia 2014

Comparative Idle Mode Rx Level

Comparative Idle mode Rx Level
35.00
30.00
25.00
20.00
15.00
10.00
5.00
0.00
0 to -60

-60 to -70

-70 to -80

-80 to -90

Vodafone

Airtel

-90 to -95

Idea

-95 to -100

Tata

Quality Samples
Vodafone

Airtel

Idea

-100 to -120

% Quality Samples

Tata

Vodafone

Airtel

Idea

Tata

0 to -60

0 to -60

20.75

25.26

23.005

6.56

-60 to -70

-60 to -70

26.37

25.36

25.865

17.42

-70 to -80

-70 to -80

22.47

24.58

23.525

34.64

-80 to -90

-80 to -90

18.78

20.01

19.395

31.37

-90 to -95

-90 to -95

7.42

3.62

5.52

6.31

-95 to -100

-95 to -100

3.43

0.92

2.175

2.37

-100 to -120

-100 to -120

0.78

0.25

0.515

1.33

Confidential

9/7/15

Nokia 2014

Voice short calls performance

Confidential

9/7/15

Nokia 2014

Network KPI Performance (Short Calls)

KPI Benchmarked

Call Blocking

Call setup time

Call Drops

HSR

Rx Quality

Total Calls
Bloc Calls
Drop Calls

Bloc Calls
Drop Calls

Vodafone
680
15
9

Total call attempts & Fails

Airtel
Idea
650
660
23
19
14
15

Tata
640
17
12

Vodafone
2.21
1.32

% Destribution
Airtel
Idea
3.54
2.88
2.15
2.27

Tata
2.66
1.88

Total Call Summary

800
700
600
500
400
300
200
100
0

680 650 660

640

15
Total Calls

23

19

Airtel

Idea

Vodafone
Minimum
Maximum
Average
Confidential

9/7/15

17

Bloc Calls
Vodafone

% Block & Drop Call

Nokia 2014

14

15

Drop Calls
Tata

12

4.00
3.50
3.00
2.50
2.00
1.50
1.00
0.50
0.00
Bloc Calls
Vodafone

Call Setup Time (Seconds)

Airtel
Idea

Drop Calls
Airtel

Idea

Tata

Tata

Blocked Calls Plot (with sites) Short Call (Vodafone)

10

Confidential

9/7/15

Nokia 2014

Blocked Calls Table Short Call (Vodafone)

11

SL. NO.

CELL ID

RX
QUALITY

Confidential

9/7/15

Nokia 2014

TA

LATITUDE

LONGITUDE

Reason

Dropped Calls Plot (with sites) Short Call (Vodafone)

12

Confidential

9/7/15

Nokia 2014

Dropped Calls Table Short Call (Vodafone)

13

SL. NO.

CELL ID

RX
QUALITY

Confidential

9/7/15

Nokia 2014

TA

LATITUDE

LONGITUDE

Reason

Handover Fail Plot (with sites) Short Call (Vodafone)

14

Confidential

9/7/15

Nokia 2014

Handover Fail Table Short Call (Vodafone)

Handover Fails
SL. NO.

15

Confidential

9/7/15

CELL ID

RX QUALITY

Nokia 2014

TA

RADIO LINK
TIMEOUT CURENT

RADIO LINK
TIMEOUT MAX

LATITUDE

LONGITUDE

Handover Summary
Handover Success Rate

Handover summary

100.00

300

80.00

250
200

60.00

150

40.00

100

20.00

50

0.00

0
Handover Fail
Vodafone

16

Handover
Airtel

Idea

Tata

Handover Summary
Airtel
Idea
12
16
215
199

Handover Fail
Handover

Vodafone
10
210

Handover Fail
Handover

% Handover Summary
Vodafone
Airtel
Idea
4.55
5.29
7.44
95.45
94.71
92.56

Confidential

9/7/15

Nokia 2014

Vodafone

Airtel
Handover Fail

Tata
18
235

Tata
7.11
92.89

Idea
Handover

Tata

RX Quality Plot- Network Wide (Short Call)

Operator
Vodafone

17

Confidential

Operator -Airtel

9/7/15

Nokia 2014

RX Quality Plot- Network Wide (Short Call)

Operator Idea

18

Confidential

Operator -Tata

9/7/15

Nokia 2014

Comparative Rx Quality
Coparative Rx Quality
90.00

83.89

83.20
75.15

80.00

80.61

70.00
60.00
50.00
40.00
30.00
20.00

11.38

16.15

12.04

13.26

10.00

4.74

8.70

4.76

6.13

0.00
0 to 2

3 to 5
Vodafone

Airtel

6&7

Idea

Tata

Quality Samples
Vodafone

Airtel

Idea

Tata

0 to 2
3 to 5
6&7

Vodafone
0 to 2
3 to 5
6&7
19

Confidential

9/7/15

80.20
11.80
8.00
Nokia 2014

% Quality Destribution
Airtel
Idea
79.9
10.3
9.80

Tata
81.1
8.2
10.70

74.6
14.2
11.20

C/I Plot Network wide short call

Operator
Vodafone

20

Confidential

Operator -Airtel

9/7/15

Nokia 2014

C/I Plot Network wide short call

Operator Idea

21

Confidential

Operator -Tata

9/7/15

Nokia 2014

C/I Comparative Distribution Chart Network Wide short Call

Comparative C/I Distribution
100.00
90.00
80.00
70.00
60.00
50.00
40.00
30.00
20.00
10.00
0.00
0 to 9

9 to 12
Vodafone

Vodafone

C/I Samples
Airtel
Idea

Airtel

Tata

0 to 9
9 to 12
12 TO 30

0 to 9
9 to 12
12 TO 30

22

Confidential

Vodafone
2.11
4.12
93.77

9/7/15

% C/I Destribution
Airtel
Idea
2.19
2.70
3.60
5.20
94.21
92.10

Nokia 2014

Tata
1.56
4.92
93.52

Idea

12 TO 30
Tata

Vodafone
0 to 9
9 to 12
12 TO 30
Over All

Average C/I Destribution

Airtel
Idea

Tata

SQI Plot Network wide short call

Operator
Vodafone

23

Confidential

Operator -Airtel

9/7/15

Nokia 2014

SQI Plot Network wide short call

Operator Idea

24

Confidential

Operator -Tata

9/7/15

Nokia 2014

SQI Comparative Distribution Short Call

Comparative SQI Distribution
90.00
80.00
70.00
60.00
50.00
40.00
30.00
20.00
10.00
0.00
-10 TO <=05

>05 TO <=15

>15 TO <=20
Vodafone

Vodafone

SQI Samples
Airtel
Idea

Airtel

Tata

-10 TO <=05
>05 TO <=15
>15 TO <=20
<20 TO <=25
>25 TO <=30

-10 TO <=05
>05 TO <=15
>15 TO <=20
<20 TO <=25
>25 TO <=30
25

Confidential

9/7/15

Vodafone
1.78
7.42
9.49
12.23
69.08

% SQI Destribution
Airtel
Idea
4.52
0.79
16.98
3.07
17.32
5.29
19.28
10.69
41.90
80.16

Nokia 2014

Tata
2.36
9.16
10.70
14.07
63.71

Idea

<20 TO <=25

>25 TO <=30

Tata

Vodafone
-10 TO <=05
>05 TO <=15
>15 TO <=20
<20 TO <=25
>25 TO <=30
Over All

Average SQI Destribution

Airtel
Idea

Tata

Codec Distribution Plot

Operator
Vodafone

26

Confidential

Operator -Airtel

9/7/15

Nokia 2014

Codec Distribution Plot

Operator Idea

27

Confidential

Operator -Tata

9/7/15

Nokia 2014

Codec Comparative Distribution short call

CODEC Samples
CODEC

Vodafone

Airtel

Idea

% CODEC Samples
Tata

CODEC

NON AMR FR

NON AMR FR

NON AMR HR

NON AMR HR

AMR FR

AMR FR

AMR HR

AMR HR

WB AMR

WB AMR

Vodafone

CODEC Samples
CODEC

28

Vodafone

Airtel

Idea

Tata

CODEC
AMR FR 12.2

AMR FR 10.2

AMR FR 10.2

AMR FR 7.95

AMR FR 7.95

AMR FR 7.40

AMR FR 7.40

AMR FR 6.70

AMR FR 6.70

AMR FR 5.90

AMR FR 5.90

AMR FR 5.15

AMR FR 5.15
Nokia 2014

Idea

Tata

% CODEC Samples

AMR FR 12.2

AMR FR 4.75
9/7/15
Confidential

Airtel

AMR FR 4.75

Vodafone

Airtel

Idea

Tata

Data Performance

Data Network Performance Network

HTTP Throughput
Wide
http://mumapplg.vodafone.ind.in/veltube/500kB.XLS

Ping Server
Server Used: 182.19.95.104

29

Confidential

9/7/15

Nokia 2014

Packet Technology Plot (EDGE/GPRS)

30

Confidential

9/7/15

Nokia 2014

Packet Technology Plot (EDGE/GPRS)

31

Confidential

9/7/15

Nokia 2014

Web Throughput Plots

Operator
Vodafone

32

Confidential

Operator -Airtel

9/7/15

Nokia 2014

Web Throughput Plots

Operator Idea

33

Confidential

Operator -Tata

9/7/15

Nokia 2014

Web Throughput Comparative summary

% FTP Throughput DL Samples

Avg FTP Throughput DL (Kbps)

60.00

100
90

50.00

80

40.00

70

30.00

60
50

20.00

40

94.71
72.18

30

10.00

83.15

20

0.00
0 to 8

8 to 16

16 to 32

Vodafone

Airtel

32 to 64
Idea

64 to 128

0 to 8
8 to 16
16 to 32
32 to 64
64 to 128
128 to 256

Web Throughput Samples

Airtel
Idea
1042081
1225861
71653
64036
105173
122090
204206
258565
435767
457582
616839
434386

0 to 8
8 to 16
16 to 32
32 to 64
64 to 128
128 to 256

Vodafone
28.81
3.30
6.91
15.51
25.61
19.86

% Web Throughput Samples

Airtel
Idea
42.09
47.84
2.89
2.50
4.25
4.76
8.25
10.09
17.60
17.86
24.92
16.95

Confidential

9/7/15

Nokia 2014

128 to 256

Tata

Vodafone
807637
92599
193768
434754
717996
556669

34

82.55

10
0
Vodafone

Tata
1025193
76096
140344
299175
537115
535965

Tata
39.22
2.91
5.37
11.45
20.55
20.50

0 to 8
8 to 16
16 to 32
32 to 64
64 to 128
128 to 256
Avg FTP Throughput DL

Airtel

Idea

Average Web Throughput Kbps

Vodafone
Airtel
Idea
2.14
2.22
1.88
11.83
11.28
11.49
24.15
24.02
24.48
48.12
47.58
47.09
93.61
96.61
94.02
170.84
176.26
172.68
82.55
94.71
72.18

Tata

Tata
2.08
11.53
24.22
47.60
94.75
173.26
83.15

MCS DL Plots
Operator
Vodafone

35

Confidential

Operator -Airtel

9/7/15

Nokia 2014

MCS DL Plots
Operator Idea

36

Confidential

Operator -Tata

9/7/15

Nokia 2014

MCS DL comparative summary

% MCS Coding Scheme
80.00
70.00
60.00
50.00
40.00
30.00
20.00
10.00
0.00
MCS-01

MCS-02

MCS-03

MCS-04
Vodafone

MCS 7 8 & 9 Distribution

100.00
90.00
80.00
70.00

MCS-05
Airtel

MCS-01
MCS-02
MCS-03
MCS-04
MCS-05
MCS-06
MCS-07
MCS-08
MCS-09

Vodafone

9/7/15

Airtel

Idea

Nokia 2014

Tata

MCS 0 TO 6
MCS 7 TO 9

MCS-07

MCS-08

MCS-09

Tata

0.71
0.03
0.27
0.10
0.16
4.09
5.29
15.67
73.69

% Distribution MCS Coding Scheme

Airtel
Idea
2.83
2.24
0.33
0.52
1.29
1.29
0.79
0.08
0.65
6.08
6.98
10.69
16.20
13.91
16.62
38.60
54.33
26.57

% Distribution 789 MCS Coding Scheme

Airtel
Idea
5.36
12.86
20.91
94.64
87.14
79.09

Vodafone

50.00

Confidential

Idea

Vodafone

60.00

37

MCS-06

Tata
1.68
0.40
0.98
0.65
6.19
5.74
8.67
24.23
51.46
Tata
15.64
84.36

CS DL & Timeslot allocation summary

% Distribution CS Coding Scheme
Vodafone
Airtel
Idea
Tata
100.00
99.77
100.00
100.00
0.00
0.23
0.00
0.00
0.00
0.00
0.00
0.00
0.00
0.00
0.00
0.00

CS-01
CS-02
CS-03
CS-04

Vodafone
1
2
3
4
5

TSL
TSL
TSL
TSL
TSL

% Timeslot Allocation
Airtel
Idea

Tata

Allocation
Allocation
Allocation
Allocation
Allocation

Web Session Time

Vodafone

Web session Time

Airtel
Idea

Tata

Avg Web session time

Ping test and PDP activation success rate summary

Vodafone
PDP
PDP
PDP
PDP

38

Context Activation Success

Context Activation Failure
Time <=2s
Time <=2s

Confidential

9/7/15

Nokia 2014

% PDP Samples
Airtel
Idea

Tata

Vodafone
Min RTT (ms)
Max RTT (ms)
Avg RTT (ms)

Ping Test Results

Airtel
Idea

Tata

Final Summary
Drive Details

Ahmedabad City

Gujarat

GSM Operator

KPI

GSM Band

Vodafone

Airtel

Idea

Docomo

900

900

900

1800

# of sites
Idle mode Coverage (% samples worse than -90 dBm)
Speech Quality (MOS- if available or else SQI) (AVG value)
NPS summary

Speech Quality (MOS- if available or else SQI) (% samples >20)

Call set up time in seconds
Drop call Rate(Short call)
DL throughput Kbps
SERVICE BENCHMARKING
Call set up Success Rate(Short Call)
Rx Quality Q>=5 (%) from Short calls

Regular summary

% samples on AMR FR 12.2

% samples on AMR HR 7.4
Web session time
Latency

39

9/7/15

Confidential

Nokia 2014

Jun-2015

Action Plan

40

9/7/15

Confidential

Nokia 2014

Coverage/Quality & Handover

BSC Name BTS Name

41

9/7/15

Confidential

Nokia 2014

Coverage/Quality & Handover Improvement Action Plan

BTS ID Seg ID CELL ID
LAC ID
Lat
Long
Action
New site required
Sector addition
relocation
Physical optimization (Orientation, Tilt, Height)
Frequency fine tune
Neighbour retune
BCCH Retune & Neighbour Optimization planned
TRX addition
Parameter change required

Throughput/Coding Scheme
BSC Name

42

9/7/15

Confidential

BTS Name

Nokia 2014

BTS ID

Seg ID

Throughput/ MCS Improvement Action Plan

CELL ID
LAC ID
Lat
Long
Action
New site required
Sector addition
TRX addition
DAP modification
PCU addition/load balancing
Parameter change required(MBP, MBG, MCA, MCU etc)

Thank
you.
43

Confidential

9/7/15

Nokia 2014