3G-Network

Benchmarking Report
NAIROBI CITY
UMTS Benchmarking Objective.
Mode Objective
Idle - Compare Coverage
Dual - Compare Call Setup Time

- Compare Accessibility

- Compare Handoff Success Rate

- Compare Received Quality

- Compare Retainability
- Coverage & Quality Plots
- Reselection Stats
Data Dual Mode - Compare FTP, HTTP accessibility
FTP – Compare DL & UL
throughputs
HTTP- Compare Throughputs
PING - Compare Latency
Strictly Private & Confidential
Comparison between Airtel, Safaricom, and Orange
Version 1.0 Networks
 Device Configuration

Operato Idle Dual FTP HTTP Ping

r
MOC MOC Data Data Data

Airtel Airtel www.google.c www.google.c

Airtel ftp.box.com
Mobile(1) Mobile(2) om o.ke/

Safaricom Safaricom www.google.c www.google.c

Safaricom ftp.box.com
Mobile(1) Mobile(2) om o.ke/

Orange Orange www.google.c www.google.c

Orange ftp.box.com
Mobile(1) Mobile(2) om o.ke/

Strictly Private & Confidential

Version 1.0
Content
 Overview
 RSCP Coverage footprint comparison
 Ec/No Comparison
 Handoff (soft handover) comparison
 CQI distribution
 Data technology distribution
 Active set Distribution
 Call Setup time and Accessibility comparison
 IRAT & Reselection Comparison
 Modulation comparison
 FTP Comparison
 HTTP comparison
 Ping Test comparison
 Benchmarking Summary
Strictly Private & Confidential
Version 1.0
Nairobi Network Overview

Subscribers
Kenya Population: 43 Million
(Circle wide)
Band of Mar 2012 No of (Nairobi: 2,888,940)
Operator Technology Figures Benchmarked
operation carriers
(in Millions) Area: Kenya 580,000 km2
Nairobi 696 km2
Airtel UMTS 2100 2.8 F1 √
Safaricom UMTS 2100 19.1 F1-F2 √
Orange UMTS 2100 3.0 F1-F2
Strictly Private & Confidential
√
Version 1.0
Benchmarking Testing Overview Nairobi– Total 4 Region

• From 15 Apr to 24 Apr 2014, Drive Route

Date & time of testing
• 02:46 A.M to 5:55 A.M

Drive distance • 975 km

• Coverage footprint RSCP (Idle

mode)
• Ec/No footprint (Dedicated mode)
Tests done • KPI performance (Dedicated mode-
Long Calls)
• Data throughput and latency test
(FTP,HTTP,PING)

• Short calls(call duration 180 sec,

call wait 30s) per operator
Test Call pattern
• Long calls – Continuous call
• Data sessions

Strictly Private & Confidential

Version 1.0
No of Sites Comparison from Drive Test Logs
Zone AIRTEL SAFARICOM ORANGE

CBD 37 121 43

EAST 111 244 147

NORTH 74 173 116

SOUTH 109 240 153

Total 331 778 459

 Airtel is 3rd in terms of Number of 3G sites.

Strictly Private & Confidential
***The information for number of sites retrievedVersion from1.0 log files is not exact.
 Voice Testing Algorithm

Test Details Specifications

No of Operators tested
Call Duration
Idle time in between calls
Dual Mode (Airtel, Orange and Safaricom)
Continuous call for 3 minute duration with 30 seconds of
Voice Test Algorithm Idle time. This was repeated for the entire duration of
3 mins (180 Secs) collection.
30 Secs

Strictly Private & Confidential

Version 1.0
Strictly Private & Confidential
Version 1.0
 Data Testing Algorithm

Test Details Specifications

No of Operators tested Dual Mode (Airtel, Orange & Safaricom) No HTTP Websites
1 www.google.com
Data Test Algorithm
2 www.facebook.com
Attach and PDP Activation Before every test 3 www.yahoo.com
Ping 3 times - 32 bytes on www.google.co.in 4 www.onlinesbi.com
FTP Download 15 MB (for Dual Mode) from server 5 www.cricinfo.com
FTP Upload 1 MB to Server 6 www.ovi.com
7 www.youtube.com
HTTP 10 different websites.
8 www.flipkart.com
Email send 100 KB Email to SMTP server
9 www.irctc.co.in
10 www.rediff.com

•After every application test, we have 2 sec Idle time before the next Application is tested.

Strictly Private & Confidential

Version 1.0
Strategic Location Testing

Strategic Locations Specifications

No of Operators tested Dual Mode (Airtel , Orange & Safaricom)

Data Test Algorithm

FTP Download 15MB (for Dual Mode) from Server

Email send 100KB Email to SMTP server

SMS SMS send to same number (160 char)

Apart from the above tests during the drive, at 5 strategic locations across the city,
additional stationary tests were carried out. These locations are important locations of
the city(Hot Spots).

Strictly Private & Confidential

Version 1.0
Strictly Private & Confidential
Version 1.0
Overall Results
Score Ranking
No. KPI
Airtel SFC Orange Airtel SFC Orange

1 Voice score (%) 86.92% 86.05% 82.60% 1 2 3

2 Data score (%) 42.00% 38.80% 50.02% 2 3 1

Coverage (% of samples RSCP > -

3 62.40% 75.50% 52.80% 2 1 3
82dbm)

4 EcNo (% of samples 0-8) 44.80% 39.40% 63.60% 2 3 1

Strength Weakness

1st in Retainability KPI 2nd in Coverage & Quality.

1st in Voice Score 2nd in Accessibility KPI.
1st in SHO SR. 2nd in Data Score.

Opportunity Threat

Make use of findings from the Other operators are on dual

BM to improve weak areas carriers with more site count,
13 therefore offer better value
17 July 2019
proposition.
Strictly Private & Confidential
Version 1.0
 Coverage RSCP Footprint
( Idle Mode)

RSCP Benchmark
>= -74 Good indoor coverage

-74 dBm to -82 dBm Suburban indoor & In-car

-82 dBm to -98 dBm Outdoor coverage

< -98 dBm Poor Coverage

Strictly Private & Confidential

Version 1.0
Coverage Footprint RSCP(Airtel)

Strictly Private & Confidential

Site and sectors are not plotted to maintain visibility. Version 1.0
Coverage Footprint RSCP(Safaricom)
Coverage Footprint RSCP(Orange)

Strictly Private & Confidential

Version 1.0
Nairobi Coverage RSCP Comparison

Airtel is 2nd in RSCP coverage.

Strictly Private & Confidential

Version 1.0
Region-wise RSCP Coverage Comparison
Nairobi CBD Nairobi North Region

Nairobi East Region Nairobi South Region

Strictly Private & Confidential

 Airtel is 2nd in CBD & East Regions, 3rd in NorthVersion
& South1.0
regions in coverage.
Quality Footprint Ec/No(Airtel)

Strictly Private & Confidential

Site and sectors are not plotted to maintain visibility. Version 1.0
Quality Footprint Ec/No(Safaricom)

Strictly Private & Confidential

Version 1.0
Quality Foot Print Ec/No(Orange)

Strictly Private & Confidential

Version 1.0
Nairobi Regions Ec/No Summary

Airtel is 2nd in Ec/No.

Strictly Private & Confidential

Version 1.0
Region-wise Ec/No Comparison
Nairobi CBD Nairobi North Region

Nairobi East Region Nairobi South Region

 Airtel is 3rd in CBD, 2nd in North, South & Strictly

East Private & Confidential
regions in Ec/No from 0 to -7.
Version 1.0
RSCP Analysis (AIRTEL)
Region 1

Region 4
Region 2 Region 3

Region 5

Region 6

Strictly Private & Confidential

Version 1.0
RSCP Analysis (AIRTEL)
Region 1

Strictly Private & Confidential

Version 1.0
RSCP Analysis (AIRTEL)
Region 2

Strictly Private & Confidential

Version 1.0
RSCP Analysis (AIRTEL)
Region 3

Strictly Private & Confidential

Version 1.0
RSCP Analysis (AIRTEL)
Region 4

Strictly Private & Confidential

Version 1.0
RSCP Analysis (AIRTEL)

Region 5

Region 6

Strictly Private & Confidential

Version 1.0
 RSCP Analysis (AIRTEL) Cont.
Region 1 : TKA_HAILE_SELAS, THIKA_TOWN are the nearest sites.
Recommendations : Set M-Tilt at 2 , E-Tilt at 2 of TKA_HAILE_SELAS_3 & THIKA_TOWN_3.

Region 2 : KIAMBAA, KIHARA_RED_HILL, NAIROBI_KITUSURU_ROAD, WANGIGE are the nearest sites.

Recommendations : Uneven terrain observed in the region, it is better to install a new site. Suggested to set E-Tilt at 2 of
KIAMBAA_1. Set azimuth at 0 & E-Tilt at 2 of NAIROBI_LORESHO_KCCT_3. Set azimuth at 170 of
WANGIGE_MARKET_2, it will be better to install a new site in the region to improve coverage. Set E-Tilt at 4 & M-Tilt at 0
of KINOO_2. Set M-Tilt at 2 & E-Tilt at 4 of KIKUYU_2.

Region 3 : KIAMBU_LAW_COURTS, KIST, KANUNGA_KIAMBU & KIAMBU_KASARINI are the nearest sites.
Recommendations : Check the coverage of site KAIMBU_LAW_COURTS is not showing any coverage in the region.
Suggested to set E-Tilt at 2 of KIST_1. Set M-Tilt at 3 & E-Tilt at 2 of KANUNGA_KIAMBU_1 . Set M-Tilt at 2 & E-Tilt
at 2 of KIAMBU_KASARINI_1.

Region 4 : KAMITI_CORNER, KIAMBU_KAMITI, NAIROBI_KAHAWA_WEST & NAIROBI_KIWANJA are the nearest

sites.
Recommendations : Set E-Tilt at 3 of KAMITI_CORNER_1. All the nearby sites are 4 km away & uneven terrain is
observed. Suggested to install a new site in the region to improve coverage in the region.

Region 5: NGONG & NGONG_OLKERI, NAIROBI_KEPHIS are the nearest sites.

Recommendations : Uneven terrain. Set M-tilt at 3 & E-Tilt at 4 of NGONG_OLKERI_3. Set azimuth of NGONG_3 at
300. Sites NAIROBI_KAREN, NAIROBI_KEPHIS, & NAIROBI_KAREN_CLUB are in heavy vegetation area causing poor
coverage in the region. Set M-Tilt at 2, E-Tilt at 2 & azimuth at 350 deg of NAIROBI_KEPHIS_3. Set M-Tilt at 4 & E-Tilt at
3 of NAIROBI_KAREN_1.

Region 6 : NAIROBI_JKUAT_KAREN_CAMPUS, NAIROBI_PARKVIEW & MAYOR_ROAD_ONGATA_RONGAI are the

serving sites.
Recommendations : Check coverage of site NAIROBI_JKUAT_KAREN_CAMPUS. Coverage drop below -98 just after
1.37 km. Set M-Tilt at 3 & E-Tilt at 2 of NAIROBI_PARKVIEW_1. Set M-Tilt at 2 & E-Tilt at 3 of
Strictly Private & Confidential
NAIROBI_MAMBA_VILLAGE_1. Version 1.0
EcNo Analysis (AIRTEL)

Poor quality due to poor coverage, latching on poor SC due

Strictly to missing
Private neighbors & pilot pollution. Analysis already provided to
& Confidential
improve coverage & reduce pilot pollution. Neighbor definitionVersion 1.0
improvement already suggested in event analysis.
Pilot Pollution (AIRTEL)

Strictly Private & Confidential

Version 1.0
Pilot Pollution (SAFARICOM)

Strictly Private & Confidential

Version 1.0
Pilot Pollution (ORANGE)

Strictly Private & Confidential

Version 1.0
 Comparison Overview
3G - Airtel 3G - Orange 3G – Safaricom
KPI Nairobi KPI Nairobi KPI Nairobi

No. of NodeB in Town 331 No. of NodeB in Town 459 No. of NodeB in Town 778

Number of Blocked Number of Blocked Number of Blocked

24 23 32
calls calls calls
Number of Drop calls 33 Number of Drop calls 78 Number of Drop calls 107

% of Rxlevel sample % of Rxlevel sample % of Rxlevel sample

37.5% 33.1% 56.7%
better then -75 dBm better then -75 dBm better then -75 dBm
% of Rxlevel sample % of Rxlevel sample % of Rxlevel sample
between -75 dBm to - 34.7% between -75 dBm to - 29.0% between -75 dBm to - 25.1%
85 dBm 85 dBm 85 dBm
% of Rxlevel sample % of Rxlevel sample % of Rxlevel sample
between -85 dBm to - 19.8% between -85 dBm to - 25.2% between -85 dBm to - 13.8%
95 dBm 95 dBm 95 dBm
% of Rxlevel sample % of Rxlevel sample % of Rxlevel sample
8.0% 12.7% 4.4%
below -95 dBm below -95 dBm below -95 dBm

% of Ec/Io sample % of Ec/Io sample % of Ec/Io sample

92.3% 94.6% 87.3%
better then -13 better then -13 better then -13

Average DL Average DL Average DL

757.92 708.00 366.33
Throughput -Kbps Throughput -Kbps Throughput -Kbps

Call Setup Time(s) 5.12 Call Setup Time(s) 7.14 Call Setup Time(s) 5.11
Strictly Private & Confidential
Version 1.0
Reselection Stats (Airtel)

For Orange & Safcom, call was latched on 3G for 100% of time.

Strictly Private & Confidential

Version 1.0
Network KPI Performance

Strictly Private & Confidential

Version 1.0
Drive test KPI Performance

Coverage Statistics
Accessibility Statistics
Retainability Statistics
Handoff Statistics
FTP, HTTP & PING Performance
Summary
Data Technology
Active Set Size & HSDSCH Code
Distribution
Modulation Scheme Distribution

Strictly Private & Confidential

Version 1.0
Coverage statistics Criteria
Coverage Rate (%) = A%*10+B%*8+C%*6+D%*1 [D should be considered till -98dBm]

10

For UMTS operator, RSCP is used to measure coverage

 A % samples where RSCP is greater -74dBm

 B % samples where RSCP is between -74 and -82 dBm
 C % samples where RSCP is between -82 and -90dBm
 D % samples where RSCP is between -90 and -98dBm

Coverage Score AIRTEL SAFARICOM ORANGE

0 to -74 3.42 3.06 5.38
-74 to -82 2.256 1.776 1.736
-82 to -92 1.53 1.704 1.044
-92 to -98 0.071 0.11 0.049
Score 72.77% 66.50% 82.09%

 Airtel is 2nd in coverage score.

Strictly Private & Confidential

Version 1.0
Voice Score statistics
Coverage Score AIRTEL ORANGE SAFARICOM
0 to -74 3.42 3.06 5.38
-74 to -82 2.256 1.776 1.736
-82 to -90 1.53 1.704 1.044
-90 to -98 0.071 0.11 0.049
Score 72.77% 66.50% 82.09%
OPERATOR CSSR BLOCKED
AIRTEL 96.44% 3.56%
ORANGE 96.53% 3.47%
SAFARICOM 95.52% 4.48%
OPERATOR CCSR DROPPED
AIRTEL 91.56% 5.07%
ORANGE 84.77% 12.19%
SAFARICOM 80.53% 15.69%

Overall Voice Score Score Rank

AIRTEL 86.92% 1
ORANGE 82.60% 3
SAFARICOM 86.05% 2

Voice Score(%) = [Coverage%*33.33+CSSR%*33.33+CCSR%*33.33]/100

 Airtel is 1st in overall Voice Score.

Strictly Private & Confidential
Version 1.0
Accessibility Statistics
Total Call Attempts Total Call Block Accessibility Ranking

AIRTEL 675 24 96.44% 2

ORANGE 663 23 96.53% 1
SAFARICOM 714 32 95.52% 3
OPERATOR CSSR (%) BLOCKED (%)
AIRTEL 96.44% 3.56%
ORANGE 96.53% 3.47%
SAFARICOM 95.52% 4.48%

 Airtel is 2nd in Accessibility KPI. Strictly Private & Confidential

Version 1.0
CCSR - Retainability Statistics
Total Call Established Total Call Drop Retainability Ranking

AIRTEL 651 33 94.93% 1

ORANGE 640 78 87.81% 2
SAFARICOM 682 107 84.31% 3
OPERATOR CCSR (%) DROPPED (%)
AIRTEL 91.56% 5.07%
ORANGE 84.77% 12.19%
SAFARICOM 80.53% 15.69%

 Airtel is 1st in Retainability KPI Strictly Private & Confidential

Version 1.0
SHO Statistics
Total HO Attempts Total HO OK HO SR Ranking

AIRTEL 23530 23530 100.00% 1

ORANGE 20130 20130 100.00% 1
SAFARICOM 16407 16407 100.00% 1

Airtel is 1st in SHO SR.

Strictly Private & Confidential

Version 1.0
ISHO Statistics
Total HO Attempts Total HO OK HO SR Ranking

AIRTEL 23 21 91.30% 1

Airtel is 1st in ISHO SR.

For Orange & Safcom, call was latched on 3G for 100% of time.

Strictly Private & Confidential

Version 1.0
Active Set Distribution

 Airtel is 1st in performance in Active set distribution.

Strictly Private & Confidential

Version 1.0
CQI Distribution

 Airtel is 3rd in number of samples of CQI distribution >25.

Strictly Private & Confidential

Version 1.0
Data Technology Distribution

 Airtel is 3rd in HSPA state.

Strictly Private & Confidential

Version 1.0
Modulation Scheme

 64QAM Modulation usage is 0% for all operators.

Strictly Private & Confidential

Version 1.0
HS-DCSH Code Distribution

 Airtel is 1st n HS-DCSH Code Distribution(10-15).

Strictly Private & Confidential

Version 1.0
FTP, HTTP & PING Performance Summary
FTP DL Throughput FTP UL Throughput HTTP Download Speed
Operator FTP DL SR FTP UL SR
(Kbps) (Kbps) (kbps)

Airtel 77.17 % 1386.13 97.54% 520.35 64.82

Orange 87.75% 1343.23 98.30% 733.02 60.28

Safaricom 71.92% 667.24 97.98% 562.7 60.19

Operator No of pings No of Ping Responses(ok) Ping Success Rate (%) AVG RTT(ms)

Airtel 996 953 95.68% 652

Orange 1085 1049 96.68% 408

Safaricom 821 730 88.91% 732

• Airtel is 2nd in FTP DL SR & 3rd in FTP UL SR.

* Airtel is 1st in FTP DL Throughput experience.
** No HTTP task is completed. All task are cancelled. Download speed is average of partial downloads.
**Ping Latency of Airtel is high  Need Improvement.
Strictly Private & Confidential
Version 1.0
EcNo vs CQI(AIRTEL)

Strictly Private & Confidential

Version 1.0
EcNo vs CQI(SAFARICOM)

Strictly Private & Confidential

Version 1.0
EcNo vs CQI(ORANGE)

Strictly Private & Confidential

Version 1.0
Nairobi Strategic Points Statistics

*Green color for operator having max value in different attributes for particular strategic point.
*Airtel is providing maximum DL throughput at most of the Hotspot.
** Call was latched on 3G for 100% of time.

Strictly Private & Confidential

Version 1.0
Event Analysis

Strictly Private & Confidential

Version 1.0
Thank You

Strictly Private & Confidential

Version 1.0