5G Network Deployment Seminar

WELCOME TO
MNT 5G SEMINAR TOUR US

ROHDE & SCHWARZ
MOBILE NETWORK TESTING
Arnd Sibila
Technology Marketing
arnd.sibila@rohde-schwarz.com
AGENDA
Time Topic
08:30 Registration and Continental Breakfast
09:00 Welcome and logistics
09:10 5G Technology Introduction – Slides 4-51
10:30 Coffee Break
10:45 Spectrum Clearance in a 5G Environment – Slides 52-77
11:15 Challenges of 5G site testing – Slides 78-109
12:00 Lunch provided by Rohde & Schwarz
13:00 Data Analytics for Benchmarking & Optimization – Slides 110-148
14:00 5G Real-World Use Case – Slides 149-170
14:30 Coffee Break
14:45 Ensuring QoE in 5G – Slides 171-201
15:30 Closing Remarks/Adjourn
2 Rohde & Schwarz Mar 2019 Evolving Technologies Overview

INTRODUCTION
ARND SIBILA
► Master’s degree in Electrical Engineering (Communication Technology, RF Technology),

Ruhr-University of Bochum, Germany
► Technology Marketing Manager for Wireless Technologies at Rohde & Schwarz
since 2012 (led the Infrastructure Global Key Account Manager group in 2014 and 2015)
► Technology Marketing in the Mobile Network Testing market segment since January 2016
► 20+ years in Siemens Communications and Nokia Siemens Networks (technical and
management roles in PM, PLM, System Architecture, CTO, BD, Portfolio Management,
Product Qualification)  strong focus on new technologies (LTE-Advanced, LTE,
WCDMA/HSPA, WiMAX, etc.)
3 Rohde & Schwarz Mar 2019 Evolving Technologies Overview

5G NR TECHNOLOGY INTRODUCTION
Rohde & Schwarz Mobile Network Testing
Arnd Sibila
Technology Marketing
CONTENTS
ı 5G market drivers and key challenges

ı 5G use cases
ı 5G NR technology and standardization
ı 5G network test solutions
ı Conclusion
5 Rohde & Schwarz Nov 2019 5G MNT technology introduction

THE STATUS OF COMMERCIAL AND LIMITED 5G NR AVAILABILITY
Status: December 2nd, 2019
 5G rollouts in cities
across the globe
 Weekly update from
verified public sources
and Ookla data
Source: Ookla 5G map  Korea and US might not
be properly covered
SOUTH KOREA – 5G STATUS
Source: RCR Wireless News, November 11, 2019
SKT:
► SK Telecom (#1 in Korea) reached 1.5 million 5G subscriber by end of September 2019
► SKT’s 5G subscribers represent nearly 44% of Korea’s 5G subscriber base
► SK Telecom targets 2 million 5G subs by end of 2019 (7 million by end of 2020)
KT:
► KT (#2 in Korea with 31% market share) targets 1.5 million 5G subscribers by end of 2019
► 85% of 5G customers signed up for the top-tier unlimited plans ( higher ARPU)
► First year-on-year increase in revenue in 7 quarters due to rapid adoption of 5G services
► Launched commercial 5G services April 2019
LG Uplus
► LG Uplus (#3 in South Korea) reported 540,000 5G subscribers end of August
► 50,000 5G base stations today, target is 80,000 by end of 2019 (90% of population)
Spectrum: 280 MHz in 3.5 GHz band and 2,400 MHz in 28 GHz band

MOBILE DATA TRAFFIC GROWTH: IT IS HAPPENING!
Ref: Cisco VNI mobile, 2017
Data traffic growth: 68%

from Q3 2018 to Q3 2019  Reality surpassed
68% forecast!
ı Absolute amount of data: 3-fold in 3 years!

Voice does not include VoIP. Traffic does not include DVB-H, Wi-Fi, or Mobile WiMAX. ı Operators have to invest for higher capacity

5G IS ALREADY GLOBALLY PRESENT
COMMERCIAL SERVICES ARE LAUNCHED
► 328 operators in 109 countries

are active in 5G (launches, demos, trials)
announced 3GPP-compatible 5G
service launches
(62 operators in 34 countries activated 5G
sites within their live commercial networks)
► Just the October 2019 snapshot:

figures are growing constantly
Source: GSA report: Evolution from LTE to 5G: Global Market Status, October 2019

4G TODAY AND 5G TECHNOLOGY FORECAST
GSA Reports (October ‘19):

► 777 commercially launched LTE / LTE-
Advanced networks in 228 countries
(36 networks with Gbps speeds)
are active in 5G (launches, demos, trials)
► 50 operators in 27 countries announced
3GPP-compatible 5G service launches
(62 operators in 34 countries activated
commercial 5G sites)
Source: GSA Evolution from LTE to 5G report, October 2019 Source: Ericsson Mobility Report Nov 2019
GSA Press Release November 22nd, 2019

FREQUENCY TRENDS FOR 5G
NR frequency range 2
Reserved numbers 257-512
Downlink Uplink
n257 26.5 – 29.5 GHz 26.5 – 29.5 GHz
n258 24.25 – 27.5 GHz 24.25 – 27.5 GHz
n259 39.5-43.5 GHz 39.5-43.5 GHz
n260 37 – 40 GHz 37 – 40 GHz
NR frequency range 1
reserved numbers 65-256
Downlink Uplink
… … …
n77 3.3 – 4.2 GHz 3.3 – 4.2 GHz
n78 3.3 – 3.8 GHz 3.3 – 3.8 GHz
n79 4.4 – 5.0 GHz 4.4 – 5.0 GHz
… … …

KEY CHALLENGES RELATED TO 5G NR RAN
Beamforming for Synch. Flexibility of air interface
New spectrum
and Broadcast Signals and gNB configuration
ı Even 3.5 GHz is different from ı How does beamforming work? ı Bandwidth:
today’s frequencies 5, 10, 15, 20, 25, 30, 40, 50, 60,
80, 100 MHz (FR1)
50, 100, 200, 400 MHz (FR2)
ı Subcarrier Spacing:
15, 30, 60 kHz (FR1)
60, 120, (240) kHz (FR2)
ı Mapping onto antenna ports:
ı What about coverage? single beam / multi beam
ı Spectrum clearance? sweeping
 New technology elements drive the need for (and complexity of)
5G NR network measurements

CONTENTS

ı 5G use cases
ı Conclusion

REVIEW OF 5G USE CASES
eMBB REMAINS PRIORITY 1 BUT … eMBB – the known playground
ı Established ecosystem (operators, manufacturers,
certification of devices)
enhanced Mobile ı Evolution from existing technologies and revolutionary
Massive IoT Broadband
additions (cm- / mm-wave)
ı A diverse ecosystem eMBB ı It’s all about data (speed and capacity)
(operators, manufacturers, ı Realizing and facing the challenges of cm-wave
local authorities, certification spectrum and OTA testing; 3.5GHz is important!
only for some technologies)
ı Mix of technologies
(GSM, Lora, Zigbee, WLAN, URLLC
Bluetooth, Cat M, NB-IoT,…) ı A significantly enhanced and
ı It’s all about cost efficiency diverse ecosystem (operators (?),
and massive connectivity manufacturers, verticals,
ı 3GPP: No NR based solution; certification not existing (yet))
will be addressed by evolving mMTC URLLC ı Principal support with high SCS
LTE-M (eMTC) and NB-IoT and self-contained slots
massive Machine Ultra reliable & ı It’s all about reliability and security
Type Communication low latency (data and capacity)
communication
CONTENTS

ı 5G use cases
ı Conclusion

3GPP RAN NR STANDARDIZATION OVERVIEW
REL-15 … REL-17 TIMELINE
2017 2018 2019 2020 2021
RAN #80 RAN #84 RAN #86
June 2018 June 2019 Dec 2019
Rel-15 Rel-15 test specifications completed

Rel-15 NSA Option 3 Late-Drop Rel-15 core specs
SA Option 2 & 5 for Option 4, 7 completed
RAN #80 RAN #87 RAN #88
June 2018 March 2020 June 2020
Rel-16 Rel-16 core specifications completed

Study-Item / Work-Item phase
PHY specs frozen ASN.1 specs frozen
RAN #84 RAN #85 RAN #86
June 2019 Sep 2019 Dec 2019 June 2021 Sep 2021
Rel-17
Rel-17 core
Study-Item / Work-Item phase specs
Rel-17 Kick-Off Approval of compl’d
Workshop E-mail discussion PHY specs frozen
Rel-17 Study-Items /
of work areas ASN.1 specs frozen
Source: RP-190563 Work-Items

5G NEW RADIO (NR) OFFERS A FLEXIBLE AIR INTERFACE
SUMMARY OF KEY PARAMETERS
Parameter FR1 FR2
Carrier aggregation Up to 16 carriers
Bandwidth per carrier 5, 10, 15, 20, 25, 30, 40, 50, 60, 80, 90, 100MHz 50, 100, 200, 400 MHz
Subcarrier spacing 15, 30, 60 kHz 60, 120, 240 (not for data) kHz
Max. number of subcarriers 3300 (FFT4096 mandatory)
Modulation scheme QPSK, 16QAM, 64QAM, 256QAM; uplink also supports π/2-BPSK (only DFT-s-OFDM)
Radio frame length 10ms
Subframe duration 1 ms (alignment at symbol boundaries every 1 ms)
MIMO scheme Max. 2 codewords mapped to max 8 layers in downlink and to max 4 layers in uplink
Duplex mode TDD, FDD TDD
Access scheme DL: CP-OFDM; UL: CP-OFDM, DFT-s-OFDM

ARCHITECTURE OPTIONS
OPTION 3 IS PRIORITY 1 IN 3GPP, FOLLOWED BY OPTION 2
Option 3: Option 2: Data
DC EN: E-UTRA-NR Standalone Control
eNB is the eNB gNB gNB is the gNB

Master Node (LTE) (5G) Secondary Node
MME SGW AMF UPF

EPC NGC
MME = Mobility Management Entity AMF = Access and Mobility Management Function
S-GW = Serving Gateway UPF = User Plane Function

MAXIMUM 5G NR DATA RATE PER LAYER
Frequency SCS Bandwidth DL UL Efficiency DL Efficiency UL

Range
FR1 15 kHz 50 MHz 288.9 Mbps 309.1 Mbps 5.78 bps/Hz 6.18 bps/Hz
FR1 30 kHz 100 MHz 584.3 Mbps 625 Mbps 5.84 bps/Hz 6.25 bps/Hz
FR1 60 kHz 100 MHz 577.8 Mbps 618.1 Mbps 5.78 bps/Hz 6.18 bps/Hz
FR2 60 kHz 200 MHz 1.08 Gbps 1.18 Gbps 5.40 bps/Hz 5.90 bps/Hz
FR2 120 kHz 400 MHz 2.15 Gbps 2.37 Gbps 5.38 bps/Hz 5.93 bps/Hz
Compare to 15 kHz 20 MHz 100 Mbps 100 Mbps 5.00 bps/Hz 5.00 bps/Hz
LTE

NR PHYSICAL LAYER DETAILS
CYCLIC PREFIX (CP) STRUCTURE IDENTICAL IN EACH SUBFRAME
Symbol length = 66.67 µs
15 kHz subcarrier spacing (LTE like)
1 subframe = 1 ms 0 … 7 … 13
= 1 Slot
10 slots per frame

f = 2  15 Slots / Slots /

[kHz] frame subframe
1 2 3 10 0 15 10 1
CP 1 30 20 2
insertion
IFFT 2 60 40 4
3 120 80 8
1 2 3 4 40
4 240 160 16
Symbol length = 16,67µs

1 subframe = 1 ms 60 kHz subcarrier spacing
= 4 slots 0 … 28 … 55
40 slots per frame

HOW CAN A UE IDENTIFY A 5G CARRIER?
First action of UE looking for 5G cell: search for Synchronization Signals
Carrier BW
BWP 1 BWP 2 BWP 3
SSB
SSB
frequency
SSB = SS/PBCH block

ı One SSB is always transmitted  the only Always-On signal in 5G NR!
ı The 5G NR UE uses the SSB for
 Synchronization
 System information (MIB/SIB) BWP: BandWidth Part:
 Cell and Beam quality measurements contiguous subset of physical resource
blocks within the overall carrier bandwidth
of a certain frequency spectrum
BANDWIDTH PARTS (BWP)
Motivation: Provide a flexible method to assign various numerologies to a device, thereby

adapting to different QoS requirements.
Up to four BWPs in DL/UL per UE:
ı Single BWP at a given time
(active BWP)
ı No reception of PDSCH or
PDCCH outside DL BWP
ı No Transmission of PUSCH
or PUCCH outside UL BWP
ı BWPs can be switched by RRC
(slow), DCI (fast) or based on
timers

239
SS/PBCH BLOCKS = SSB DM-RS

. . . . . .
192
Synchronization Signal Block = SSB . . . . .
► Time domain: 182
SSB consists of 4 OFDM symbols, where

PSS, SSS and PBCH with associated . . . . .
DM-RS occupy different symbols

► Frequency domain:
56
SSB consists of 240 contiguous

. . . . .
subcarriers 47
. . . . .
► Like in LTE the Cell ID can be determined

9
from the used PSS/SSS sequences
5
1
PSS: Primary Synchronization Signal SSS: Secondary Synchronization Signal 0
PBCH: Physical Broadcast Channel DM-RS: DeModulation Reference Signal

SSB
OCCURRENCE IN THE FRAME: CASE A, B AND C
Case A (15kHz) 5ms 5ms
f  3GHz (L=4) …
3.6MHz
3  f  6GHz (L=8) …
0 1 2 3 4 5 6 7  Block index 0…Lmax-1
Case B (30kHz) …
f  3GHz (L=4)
…
3  f  6GHz (L=8)
7.2MHz
Case C (30kHz) …
f  3GHz (L=4)
…
3  f  6GHz (L=8)

SSB AND DIFFERENT BEAMS – „BEAMFORMING“
► Demodulation of the PBCH  determines the SSB index and
 distinguishes between the periodically broadcasted SSBs
► Each SSB uses different DM-RS embedded in the PBCH (FR1: PBCH in 3 OFDM symbols,
in each symbol PBCH DMRS sequence is initialized differently  23 = 8 options)
► Example: Case A with subcarrier spacing of 15 kHz and 8 SSB indices

5 ms
Case A (15 kHz)
…
3  f  6 GHz (L=8)
0 1 2 3 4 5 6 7  Block index 0…Lmax-1
Different beams / SSB indices
 Beamforming of synchronization signals and broadcast information via 5G NR SSBs

SSB – IN SINGLE BEAM OR MULTI BEAM CONFIGURATION
Single Beam
► SSB index is used to separate SSB … …
transmission on different beams
(encoded in the MIB)
► Mapping of antenna ports and Multi Beam sweeping

physical beams to the SSB index can … …
differ between infrastructure suppliers
time
SSB SSB SSB SSB … SSB … SSB SSB SSB SSB … SSB
► SS Bursts can also be repeated 0 1 2 3 m 0 1 2 3 m
SS burst 0 SS burst 1
(periodicity is given in MIB)
 5G NR network measurements need to cope with high flexibility and configurability

5G NR: SIMPLE BEAMFORMING
Same PCI, different SSB indices
gNB uses SSBs to be mapped on

„static“ beams. PDSCH & PUSCH will
also follow SSB beam concept

5G NR: ENHANCED (UE SPECIFIC) BEAMFORMING
Same PCI, different SSB indices
+ UE specific CSI-RS for gNB uses SSBs to be mapped on
beamforming support „static“ beams.
PDSCH & PUSCH will be on UE

specific beams. CSI-RS and reporting
needed to support beam adjustment
CRI feedback

5G NR AND NEXTGEN CORE: NETWORK SLICING
source: Nokia
Network Slice: a network customized to provide an optimized solution for a specific

market scenario which demands specific requirements with end to end scope
CONTENTS

ı 5G use cases
ı Conclusion

R&S TEST SOLUTIONS TO DEPLOY 5G NR NETWORKS
Spectr. Clearance / Interfer. Hunting 5G NR network measurement solution Data Analytics
Passive measurements Active measurements SmartAnalytics Scene
R&S®TSMA6 R&S®FPH 31GHz R&S®FSH R&S®TSME6 R&S®TSMA6 5G Router 5G smartphones

TDD gated trigger
Shoulder bag Backpack for mmwave QualiPoc Android ready for 5G

R&S®MNT100&PR200 R&S®MobileLocator
Site Acceptance
5G NR
Serving Cell 5G NR Cell
History
5G NR
Uplink
5G NR Cell
SmartAnalytics
5G NR Quality
Downlink
RSRP,
RSRQ Scene - NPS
Tx Power
DL Thp
QualiPoc Android R&S®ROMES4: 5G NR Software for network engineering, analysis and

R&S®TSMA6
(ready for 5G) optimization

DIFFERENCE BETWEEN SCANNER AND MOBILE PHONE
MEASUREMENTS
Measurement device
Passive: just receiving, Active: SIM-based connection to

Measurement mode
no SIM required its operator
Measurement accuracy Accurate (+/- 1dB) +/- 6dB
All receivable cells (all operators, Connected cell and neighbors
Measured cells
all configured frequency bands) (limited), own operator
Measurement speed / frequency + -
Use case Reference RF measurement Real world, comparability
Solution: Scanner controlled

by QualiPoc Android
DIFFERENCE BETWEEN SCANNER AND MOBILE PHONE:
THE “dB” LESSON
“1 dB is nothing, 2 dB is a lot!”
The decibel (symbol: dB) is a unit of measurement used to express the ratio of one
value of a power quantity to another on a logarithmic scale. It is called the power level.
(Wikipedia.com)
Ratio in dB Ratio in abs. power
1 1.26
2 1.6 PH = 16 mW
𝑃𝑎
𝐿𝑝 = 10 log10 𝑑𝐵 3 2
𝑃𝑏
6 4 PA = 4 mW ± 6 dB
10 10
20 100 PL = 1 mW
30 1000 
DIFFERENCE BETWEEN SCANNER AND MOBILE PHONE:
MEASUREMENT SPEED LTE RSRP measurements of a scanner:
 All cells
Serving Cell (from all operators, 1 band)
Just 10 cells were configured here.
9 measurements
in 25 seconds
60 seconds
LTE RSRP measurements of a smartphone:

 Serving cell
 + neighbor cells sporadically
(from own operator, 1 band) 60 seconds

5G NR NETWORK MEASUREMENT SOLUTION
TSME6: For comfortable

Ultra-compact network scanner walk tests
ROMES4: 5G NR Software for network

engineering, analysis and optimization
TSMA6:
Autonomous network scanner (running on laptop or NUC PC in TSMA6)
plus downconverter for 28 / 39 GHz frequency bands
 Industry’s first commercially available 5G NR network measurement

solution launched by Rohde & Schwarz Mobile Network Testing
5GNR „BEAMFORMING“ FOR SYNCHRONIZATION SIGNALS
AND BROADCAST CHANNEL INFORMATION
Example: Case A with subcarrier spacing of 15 kHz (3.6 MHz bandwidth) and 8 SSB indices
5ms
Case A (15kHz)
…
3  f  6GHz (L=8)
0 1 2 3 4 5 6 7  Block index 0…Lmax-1
► Each block uses different DM-RS embedded in the PBCH

 Scanner TSME6 / TSMA6 performs measurements per beam
 Scanner TSME6 / TSMA6 and ROMES support 5GNR beamforming from day 1

BANDWIDTH OF NETWORK SCANNER (THE 100 MHz QUESTION)
 20 MHz – the most efficient choice for RF frontend
ı 5G NR offers higher bandwidths, but:
ı All SSB below 6 GHz fit into 20 MHz bandwidth
€$
ı There is no other always-on signal in 5G NR downlink than the SSB
ı Spectrum measurements over the whole frequency range (spectrum scan,
Automatic Channel Detection) are done with 20 MHz frontend since years
ı SSB measurement in mmWave frequencies (120 and 240 kHz subcarrier spacing)
with one 20 MHz scanner frontend using fast frequency hopping
ı Better noise figure than 100 MHz frontend
ı Better receiver sensitivity
ı Best approach for multi-technology measurements (2G, 3G, 4G, 5G)
 All important 5G NR network measurements are done using a 20 MHz scanner frontend

HOW TO FIND THE SSB EASILY?
5G NR SCANNER – AUTOMATIC CHANNEL DETECTION (ACD)
Often the SSB frequency is
not exactly known before
executing 5G NR
measurements.
5GNR SSB
 The 5G NR ACD automatically finds the SSB by detecting:
ı SS-Ref frequency of 5G NR cell-defining SSBs following GSCN raster (3GPP compliant)
ı Cell-defining SSBs which are apart from the GSCN channel raster
ı The transmission case (number of SSBs) is determined by the SS-Ref
SCANNER-BASED 5G NR MEASUREMENTS:
MULTI BEAM EXAMPLE IN ROMES
… …
Cell Color by PCI
Beam Color by SSB Index

MAIN TAKE-AWAY –
COVERAGE
► Expected UE sensitivity: -125dBm SS-RSRP
~ 6.5km distance
~ -120 dBm (SS-RSRP)
-110dBm SS-RSRP
► Suburban area (3.7 GHz)
► Surprisingly good SSB

coverage
► Static SSB beamforming
 -100dBm SS-RSRP
allows for long radio range -90dBm SS-RSRP
 Operators can try to reuse gNodeB

site grid ?

QUESTIONS: CAN WE MAP THE SSB INDICES ON BEAMS?
HOW DOES BEAMFORMING WORK?
Heat map
► First approach: Beam switch PCI switch (e.g. SS-RSRP)
Assumption: Each SSB index can be

mapped to a certain beam PCI
Strongest SSB index

is shown
► How to analyze that?
Use the ROMES4 map feature and

display the strongest SSB index on a map

SSB / BEAMFORMING
VERIFICATION Same PCI, different SSB indices
► Best received SSB index /

beam visualized on the map
► Surprisingly good match with

horizontal “micro sectors”

(SSB beam indices)
► 3.7 GHz, sub-urban

environment
gNodeB

MILLIMETER WAVE NETWORKS - BEAMFORMING AT ITS BEST
► Massive number of antenna elements („massive MIMO“)  max. 64 SSB beams
► Ultra precise beamforming with flexible beam width for FR2
► SW controlled phased array antenna
Closer to gNB
Less gain, wider beam
More gain, narrow beams e.g. 25° downtilt
e.g. 10° downtilt
63
High gain, pencil beam
e.g. 0° downtilt
4 5 6 7 12 13 14 15 20 21 22 23 28 29 30 31
Can go down to a few meters

TRIAL NETWORK 28GHz

PCI / CELL COVERAGE EVALUATION IN THE FIELD
► Focus on PCI

BEAMFORMING EVALUATION IN THE FIELD (28 GHz)
► One PCI
► Focus on best beam
(SSB index)
„Massive beamforming“
can be evaluated
in the field
For more info please

visit demo 1 and 2

FIRST UE-BASED 5G NR MEASUREMENTS
ROMES4 measuring on 5G mobile device
5G NR
Serving Cell 5G NR Cell
History
5G NR
Uplink
5G NR Cell
5G NR Quality
Downlink
RSRP,
RSRQ
Tx Power
DL Thp
https://www.linkedin.com/feed/update/urn:li:activity:6488431089424564224
FIRST UE-BASED 5G NR MEASUREMENTS
► NR Serving cell information: 5G NR measurement in
 NR DL ARFCN QualiPoc Android *)
 PCI *) Beta Release 19.0
 SSB Index
► L1 RSRP / RSRQ
► L2 PDSCH, PDCP, PUSCH information
► LTE-NR EN-DC L3 signaling
► Application layer info
5G NR RRC Layer 3
signaling

BLOCK DIAGRAM: MM-WAVE/SUB 6 GHz MEASUREMENT SETUP
INCLUDING TSME6 / TSMA6, SIMULTANEOUS MEASUREMENTS
5GNR Sub 6 / IF
RF Downconverter Real-time
mm-wave switching
Alternative with R&S®TSMA6
and tablet for control
LTE HW control R&S®TSME6
RF Local oscillator Ultra Compact
sub-6 GHz
Drive Test Scanner
Standard performance setup TSME30DC
High performance setup
Downconverter
5GNR R&S®TSME6
RF IF
Local oscillator HW control PC including

R&S®TSME6 R&S®ROMES4
TSME30DC Drive Test Software
LTE RF

CONTENTS

ı 5G use cases
ı Conclusion

CONCLUSION
5G NR commercial rollout running now – many pre-commercial trials!
Commercial 5G NR smartphones available on the market
5G NR network measurements need to cope with high flexibility, configurability and

complexity of new technology elements
Commercial 5G NR network measurement solution available by Rohde & Schwarz
Verification of coverage and SSB beamforming in many networks with R&S
 Rohde & Schwarz MNT is committed to support the industry with network test
solutions from early trial phase to network optimization and benchmarking
https://www.rohde-schwarz.com/MNT-5G
https://blog.mobile-network-testing.com/
► Mobile Network Testing
5G SPECTRUM CLEARANCE
AND INTERFERENCE HUNTING
MNT 5G Seminar US, December 2019

Arnd Sibila
Technology Marketing MNT
(Peter Busch / MNT Expert)

AGENDA
► Frequency clearing (Why now)
► Impact of interference on capacity
► Spectrum clearance before or after
deployment
► Interference sources real world examples
► Spectrum clearance real world

700 MHz, 3500 MHz, FR2
► Learnings and conclusion
PARTICULAR CHALLENGES OF 5G USE CASES
(WHY NOW)
enhanced Mobile
Broadband
eMBB
The demand on interference-free Industries like automotive as well as

dynamic range increases. NB-IoT URLLC automation (Industry 4.0), will
mMTC
devices can work on downlink demand very high reliability – not
signals as low as -130 dBm accepting any external
Massive Machine Ultra reliable &
Type Communication low latency influence/interference.
communication
54 Rohde & Schwarz Dec 2019 5G Spectrum clearance and Interference Hunting
FREQUENCY CLEARING (WHY NOW)
► Worldwide we start to use old low frequency bands for LTE. Partly to increase data capacity,
partly because 5G needs an Uplink
► 5G deployments will be predominantly TDD. In TDD, finding Uplink interference becomes much
more complicated compared to FDD.
► If you do not care for your spectrum, you might end up like one operator in China trying to deploy
LTE in 900 MHz band.
Network size: 400.000 sites.

Times 3 = 1.200.000 sectors
Average number of BDA found per sector = 10
Estimated number of Interferers = 12.000.000
BDA: Bi-Directional Amplifier

AGENDA
deployment

700 MHz, 3500 MHz, FR2
IMPACT OF INTERFERENCE
NB-IoT -130 dBm
5th Gen (5G) -120 dBm
WHAT IS THE IMPACT OF INTERFERENCE ON CAPACITY?
Example MCS vs. SINR ► Not easy to quantify
800 800
► Depending on many parameters

700
700
and implementation
600 600
Relative throughput / %
500
500 Rule of thumb: 256QAM
10 dB less SINR (MCS 20...27)
400
400
 50% less The graph is a simplified real-world example for EPA5,
300
300 data throughput 2x2MIMO and HARQ.
The MCS-SINR relation depends on the specific Base
Station vendors' algorithms, performance and
200
200 64QAM
(MCS 11...19) scheduler implementation, as well as on the channel
fading profile etc.
100
100 16QAM
(MCS 5...10)
00 QPSK (MCS 0...4)
-15 -15 -5-5 55 15
15 25
25 35
35 45
45
MCS: Modulation and Coding scheme
SINR / dB
SINR: Signal to Interference and Noise Ratio
TAKEAWAY: Interference dramatically impacts network performance

 Spectrum clearance in new spectrum becomes essential
AGENDA
deployment

700 MHz, 3500 MHz, FR2
SPECTRUM CLEARANCE BEFORE OR AFTER DEPLOYMENT
► Before deployment ► After Deployment

 All visible Signals are Interference  Wanted and not wanted signals
 No complicated masking to avoid  Complicated masking techniques needed
wanted signals
 Easy mapping of potential interference  Sometimes need to wait “quiet times” to
via drive testing with scanner efficiently hunt interference
 No OSS telling you where to start  OSS will know where and when
Interference happens
 Limited time to do the job  Can be done without time limitation
(continuous process within operations)
MASKING UPLINK WITH GATED TRIGGER
Trigger Free Run

(Down Link
and Uplink)
Interference
Gated Trigger
(only Uplink)
Trigger Free Run

(Down Link
and Uplink)
Interference
Gated Trigger
(only Uplink)
AGENDA
deployment

700 MHz, 3500 MHz, FR2
BI-DIRECTIONAL AMPLIFIER IN WARSAW
Band 900 Uplink
► Wrongly deployed BDA: donor and serving antenna not completely decoupled
BI-DIRECTIONAL AMPLIFIER IN CHINA
Donor antenna
Serving antenna
BI-DIRECTIONAL AMPLIFIER IN CHINA
Narrowband Wider-band, with

Wideband
frequency instability
CAMERA SYSTEM IN ISTANBUL
► Complete 2.1 GHz UL band (bd 1)

interfered
JAMMER IN KENIA
► Intentional interference!
► Interference easy to find
► Users of jammers are uncooperative
AGENDA
deployment

700 MHz, 3500 MHz, FR2
SPECTRUM CLEARANCE
R&S®ROMES4
Drive test software
Filter
R&S®TSME6
Drive test scanner
RF Antenna
GPS Antenna
SPECTRUM CLEARANCE REAL FIELD MEASUREMENTS
RESULTS AT 700 MHz
R&S®ROMES4 NETWORK PROBLEM ANALYZER
(AUTOMATED IDENTIFICATION VIA POST PROCESSING)
REAL FIELD MEASUREMENTS RESULTS AT 3500 MHz
ADAPTING TOOLS FOR FR2 (MM-WAVE)
► Interference hunting at mm-wave requires

special tools
 Higher-frequency analyzers / receivers
 Different antennas
► Analyzers can either natively support FR2
frequencies or use external downconverters
► Antennas are often small horns
 Highly directional
 Cables need to be very short
REAL FIELD MEASUREMENTS AT 28 GHz
LEARNINGS AND CONCLUSIONS
5G use cases are less tolerant of interference - require cleaner spectrum for optimal
performance.
FR1 bands which are “interference free” for pre-5G may not be okay for 5G.
Probability of interference is higher at lower frequencies
Tools and techniques used for 5G need to be much more sensitive / faster than
those used in previous cellular generations
Spectrum clearance for TDD mode before launch is recommended
Interferers are less common and more localized at FR2 but TDD and physical
obstructions makes interference hunting more complicated and time consuming
5G SPECTRUM CLEARANCE
AND INTERFERENCE HUNTING
Thank You
Questions?
https://www.rohde-schwarz.com/MNT
CHALLENGES OF 5G SITE TESTING
Arnd Sibila
(Peter Busch / MNT Expert)
Rohde & Schwarz

AGENDA
► Technology Overview
 Dual connectivity NSA (Sib 2 LTE ….)
 SSB, Beams, TDD
► Deployment setups (different antennas)
 RRH with detached antenna
 Integrated active antenna
► Site acceptance / troubleshooting procedure
► Functional tests
 Download/Upload/Speed test
► Spectrum analyzer measurements
 OBW – or simple power measurement
 SSB in time domain
 Separating uplink from downlink with gated trigger
► 5G Site testing solution receiver measurements
 Automated Channel Detection (ACD)
 List of received cells and beams (PCI, SSB)
 LTE anchor cell, RF-Power Scan
► Learnings and Conclusions
79 Rohde & Schwarz Dec 2019 Challenges of 5G Site Testing

5G TECHNOLOGY OVERVIEW
DUAL CONNECTIVITY NSA (SIB 2 LTE ….)
SSB, BEAMS
TIME DIVISION MULTIPLEX (TDD)
5G NR NETWORK ARCHITECTURE OPTIONS
OPTION 3 IS PRIORITY 1 IN 3GPP, FOLLOWED BY OPTION 2
Option 3: Option 2:
DC EN: E-UTRA-NR Standalone
eNB is the
Master Node
eNB gNB gNB
MME SGW AMF UPF

EPC NGC
Data
Control
NON-STAND ALONE (NSA) MODE
OPTION 3
System information block

(SIB) 2
LTE
3GPP Rel. 15:

“upperlayerindication”: UE
has entered in 5G coverage
area
TIME DIVISION MULTIPLEX (TDD)
UL UL DL UL DL UL DL
DL

DEPLOYMENT SETUPS (DIFFERENT ANTENNAS)
RRH WITH DETACHED ANTENNA
INTEGRATED ACTIVE ANTENNA
DEPLOYMENT SETUPS
RRH WITH SEPARATE ANTENNA
► Installations with separate Antennas allow
conducted measurements.
► Reflection and Distance To Fault (DTF)

measurements, either in cabling or the
antenna, are possible.
► Identification of the specific broken component

(RRH, Cable or Antenna) possible.
► Over The Air (OTA) measurements possible.

DEPLOYMENT SETUPS
INTEGRATED ACTIVE ANTENNA
► Fully integrated installations allow only
Over The Air (OTA) measurements.
► Indication of reflection can be checked

by OSS counter only.

SITE ACCEPTANCE/ TROUBLE SHOOTING
PROCEDURE
SITE ACCEPTANCE / TROUBLE SHOOTING PROCEDURE
Receiver
Spectrum Signal decoding
Mobile phone analyzer OTA  ACD
 Bands
Functional tests measurements
 EARFCN -
 PING RTT  Is there a signal?
NR-ARFCN
 Upload  Are there SSBs?
 LTE anchor cell
 Download  Is there external
 PCI, SIB2
Interference?
 5G cell
 PCI, SSB
ACD = Automatic Channel Detection

FUNCTIONAL TESTS
DOWNLOAD/UPLOAD/SPEED TEST
FUNCTIONAL TESTS
WHAT FOR?
When a 5G site is installed, functional tests verify the correct connection to the network and
the site build integrity
Integrity
Integrity testing usually contain these three tests:
► Ping: Measuring latency (RTT round trip time).
► Download: Measuring throughput of a HTTP download
test.
► Upload: Measuring throughput of a HTTP upload test

FUNCTIONAL TESTS
REQUIRED EQUIPMENT
► For performing these functional tests, we can use any Android smartphone with R&S
QualiPoc Android application installed.
Android 5G smartphone 5G SIM card QualiPoc application & license

QUALIPOC ANDROID - INTEGRATION LEVELS
COTS
COTS
(with external
diagnostic port)
Rooted
(fully integrated
device with internal
diagnostic port)
COTS: Commercial Off The Shelf

QUALIPOC ANDROID – INTEGRATION LEVELS
COTS (WITH EXTERNAL DIAGNOSTIC PORT)
► Using a smartphone (COTS) with an open diagnostic port
plus the R&S NRP CompuStick
provides all RF trace information to QualiPoc
Available parameters e.g.
for LTE technology including DL and UL:
R&S NRP
 MCC/MNC, TAC, Cell Id, eNB/Sector ID
CompuStick
 DL EARFCN, PCI, Bandwidth
 RSRP, RSRQ and RSSI
 CA information
for 5G NR:
Power Bank
 RF Band, SSB NR-ARFCN
 PCI,
 SS-RSRP, SS-RSRQ, SS-SINR
 and many more…
FUNCTIONAL TESTS
PING
►Ping test on QualiPoc measures
the latency to a defined host.
►It verifies that the connection

from this site to the network is
established.

FUNCTIONAL TESTS
DOWNLOAD TEST
► QualiPoc offers multiple downlink tests.
 FTP download
 HTTP download (single thread)
 Capacity download (FTP or HTTP multiple, parallel threads)
► These tests give high-level confirmation that the downlink of this site is
working and performing as expected.
► Particularly by using the Capacity DL test, the multiple parallel DL

threads will try to squeeze the best possible throughput out of the
network.

FUNCTIONAL TESTS
UPLOAD TEST
► QualiPoc offers multiple uplink tests.
 FTP upload
 HTTP upload (single thread)
 Capacity upload (FTP or HTTP multiple, parallel threads)
► These tests give high-level confirmation that the uplink of this site is
working and performing as expected.
► Particularly by using the Capacity UL test, the multiple parallel UL

threads will try to squeeze the best possible throughput out of the
network.

SPECTRUM ANALYZER OTA
MEASUREMENTS
OBW – OR SIMPLE POWER MEASUREMENT
SSB IN THE TIME DOMAIN
SPECTRUM ANALYZER OTA MEASUREMENTS
TEST SET UP
For OTA Measurements with a Spectrum

Analyzer, a directional antenna with line of
sight is necessary.
SPECTRUM ANALYZER MEASUREMENTS
OBW – OR SIMPLE POWER MEASUREMENT
If the functional test fails
to show the expected
results, the first question
is: Is there a 5G signal in
the air? To answer that, a
spectrum analyzer can be
used.
Yellow Trace = Max Hold

Green Trace = Clear/Write
OCCUPIED BAND WIDTH (OBW)
Using the Max Hold
function of the spectrum
Analyzer and the OBW
function. The occupied
bandwidth can then be
measured.
Yellow Trace = Max Hold

SSB IN TIME DOMAIN
Setting the centre
frequency to the
centre of the SSB
block and switching to
Zero Span, the SSBs
can be seen using a
video trigger.

SEPARATING UPLINK FROM DOWNLINK WITH GATED TRIGGER
Trigger Free Run

(Down Link
and Uplink)
Interference
Gated Trigger
(only Uplink)

5G SITE TESTING SOLUTION RECEIVER
MEASUREMENTS
AUTOMATED CHANNEL DETECTION (ACD)
TOP N POOL WITH PCI AND SSB
LTE ANCHOR CELL
RF-POWER SCAN
5G SITE TESTING SOLUTION RECEIVER MEASUREMENTS
TEST SET UP DIAGRAM
For the receiver measurements,

including decoding of PCI/SSBs,
a simple omnidirectional antenna
in sufficient.
The antenna can even be placed
in the bag.
The receiver unit need to have
adequate sensitivity and a special
algorithm to adjust the dynamic
window very fast.

AUTOMATED CHANNEL DETECTION (ACD)
► Using the Rohde & Schwarz
5G Site Testing Solution,
demodulation and decoding
can be added to the
spectrum measurements.
► Automated Channel
Detection (ACD) is used to
show all LTE and 5G signals.
► Automatic identification of
channel frequency and SSB
position.

LIST OF RECEIVED CELLS AND BEAM (PCI, SSB)
► By filtering, for example via
Band, PCI, MNC/MCC or
SSB, you can select the
signal of interest and check 5G NR LTE
the availability of
beams/PCIs, boundaries of
beams/sectors, as well as
side lobes.
► The results will be shown in a
so called Top-N view (list of
received cells and beams,
highest signal in front) or as a
graph in a value over time
chart

LTE ANCHOR CELL
► Key parameter like SS-RSRP
or SS-SINR can be displayed
as graphs, as well.
LTE
► In parallel, the LTE anchor

cell is measured with it’s key
parameter.
5G NR

LEARNINGS AND CONCLUSION
► To detect the presence of a 5G network, it is necessary to locate the SSB as it is the only
always-on signal
► Functional tests performed by a smartphone-based tool are reflecting very well on whether
the gNB is working properly and about its basic performance.
► Important to verify the SSB index distribution in the field is in accordance with expectation.
► Verification of LTE anchor cell is important in NSA configuration.
► In case the UE is not performing in accordance with expectation, a receiver with decoding
(PCI/SSB) functionality is very important.
► There is not one tool, you should use for everything. A set of instruments,
deployment/situation tailored, seems to be the most efficient, cost effective solution.

CHALLENGES OF 5G SITE ACCEPTANCE
Thank You
Questions?
www.rohde-schwarz.com/mnt
5G BENCHMARKING AND
OPTIMIZATION
Arnd Sibila
Rohde & Schwarz Mobile Network Testing
MOBILE NETWORK LIFECYCLE
Quality Benchmarking and

Network Optimization
are closely connected
 Ideally, benchmarking data
should be used for optimization
 Optimization actions should be
proven by benchmarking
111 Rohde & Schwarz Dec 2019 5G optimization and benchmarking

CONTENTS
ı Market drivers and scoring motivation

ı Benchmarking methodology using NPS
ı Basis for network optimization
ı Example: Using benchmarking data for
optimization
ı Is Network Optimization in 5G different?

MOTIVATION: WHY QUALITY OF EXPERIENCE INTELLIGENCE?
Subscription penetration Q3 2019 (percent of population)
Applications!
Source: Ericsson Mobility Report (Nov 2019)
 Nearly no people without subscriptions in most regions

 New subscribers have to be gained from competing operators
 Operators have to differentiate in provided Network Performance and Quality of Experience (QoE)
 Perceived QoE of applications determines end user satisfaction and operators’ success
THE VALUE OF BENCHMARKING
Accurate and reliable benchmarking data has a lot of value:
► Insights about Quality of Experience of networks (user-perceived quality)
► Compare the own network quality with competitors’ networks
Some points have to be considered though:
► User-perceived QoE  test most used service types
► Data collection: accurate and reproducible (temperature, shielding, …)
► Use devices that support ALL technologies of network under test
► Data from all layers (Application Layer down to spectrum information).
 Needed for a deep dive  can trigger optimization activities or defend against legal claims
 Clear differentiation to e.g. crowdsourcing

CURRENT SITUATION OF NETWORK SCORES
► Operator pays a service provider for a network scoring campaign or crowdsourcing data that promise
a certain result
► There are many different network scores in the market.
A few examples:
 Connect Score / P3 Score
 Chip Score
 OneScore from GWS
 RootMetrics score Scored AT&T video streaming
 OpenSignal score POOR GOOD
 Huawei/CMCC NEI
 Ookla
 …
► Different methodologies (often not disclosed)  proprietary methods
 All these existing scores are not comparable

 ETSI STQ ratified and published TR in August 2019

THE VALUE OF A COMPARABLE NETWORK SCORE
► For Operator Marketing: to create marketing claims

“Best Network”, “Fastest Network”, “Best for Streaming services”,..
► For the Operator CTO: as a management tool

“I want my team to improve the network quality by n % over next m month!”
► For Infrastructure vendors: as a competitive advantage

“The networks using our infrastructure perform better than xy”
► For Service Companies: to generate more business

“We can help you to win next years public benchmark”

CONTENTS

optimization

NETWORK PERFORMANCE SCORE
Represents the user-perceived QoE
Standardized (ETSI STQ TR 103 559) and accepted
Vendor independent, objective methodology:

► Reference benchmarking metric
► Holistic network view across competitors
► Target setting for improvements
► Framework for a QoE-based

investment prioritization

NETWORK PERFORMANCE SCORE:
DIFFERENT LEVELS OF AGGREGATION
One
score Level 3: Weight and aggregate all regions to a
per country countrywide score (the “CxO level”)
Regional Level 2: Weight and aggregate QoE of all

aggregation service classes per region
QoE Score for each Level 1: Evaluate QoE for all service classes
service class based on
voice and data KPIs (different dimensions of a service class)
Methodology currently in standardization in ETSI STQ (TR 103 559 draft available)
“Best practices for robust network QoS benchmark testing and scoring”

WHAT DRIVES QOE OF A SERVICE?
WHAT ARE DIMENSIONS OF IT? One
score
per country
Regional
aggregation
Score of QoE of each
Use existing KPIs for QoE evaluation: service class based on

voice and data KPIs
► Service availability
 Do I have access to the service at all?
 Do I stop waiting because of too long waiting times?
► Waiting for ‘action’ (task being started and/or completed)

 How is the accepted duration (patience) for a normal ‘web task’, QoE
getting a call connected or seeing the video starting. of a service
► How is the quality of the media (e.g. video, voice, pictures,…)

 Is the quality how I expect it?

LEVEL 1: HOW TO EVALUATE QOE OF SERVICE CLASSES?
How to rate KPIs different dimensions to each other? Simple example for telephony One
score
per country
► (Only) what can be perceived, should have an impact on scoring

Regional
aggregation

► Normalize to a common scale (0 … 1000) voice and data KPIs
► Weight and Aggregation

LEVEL 1: EVALUATE QOE OF SERVICE CLASSES?
One
►Perception and normalization to a common scale

score
per country
Regional
aggregation

voice and data KPIs
Perception ~ f(technical improvement)
Target!
no benefit!
technical improvement

DOES DATA THROUGHPUT DRIVE THE PERCEPTION?
NO! …BUT TIME DOES! One
score
per country
Regional
aggregation

voice and data KPIs
Data Throughput  Duration of a task
Saturation
Data throughput/Mbps Data throughput/Mbps
This dominates the ‚Throughput KPI‘ average But there is no difference in perception!

WHAT DRIVES PERCEPTION IN VIDEO QUALITY?
One
score
per country
Regional
aggregation
► Video on YouTube  Video resolution

voice and data KPIs
MOS
Video resolution as KPI is not sufficient to rate the video quality

 Video MOS according to ITU-T J.343.1 rates the quality of the video on the screen
 Viewing distance is important
HOW TO TAKE INTO ACCOUNT THE SATURATION IN One
score
per country
PERCEPTION?
Regional
aggregation

voice and data KPIs
Some examples
Average Mean Data Rate DL Average Call Setup Time
100% 100%
100%
0% 0%
1 Mbps 100 Mbps 4.5 s 12 s
Streaming Success Ratio Average Video MOS J343.1

0% 100% 100%
Low High
threshold threshold
‘bad’ ‘good’
0% 0%
80% 100% 3 4.5

NETWORK PERFORMANCE SCORE – LEVEL 2:
WEIGHT AND AGGREGATE ALL SERVICE CLASSES PER REGION One
score
per country
Regional
aggregation

voice and data KPIs
QoE of service classes Weight Aggregation

THE NETWORK PERFORMANCE SCORE – LEVEL 3:
THE COUNTRY-WIDE LEVEL One
score
per country
Regional
aggregation
The Network Performance Score rates the overall QoE of a network by combining Score of QoE of each
voice and data KPIs
the fulfillment of main KPIs from different services.

CONTENTS

optimization

THE NETWORK PERFORMANCE SCORE:
AGGREGATION AND DRILL DOWN
+
Aggregation: Drill down:
ı Regional weighting (acc. to traffic, population, …) ı Critical region
ı Benchmarking different operators ı Critical service class
ı Comparison of technology and (infra) vendors ı Critical dimension of service class
ı Inter-market comparison (compare countries)  Basis for network optimization

NETWORK OPTIMIZATION: FROM LABOUR-INTENSIVE WORK
TO AUTOMATED ACTIONS
Traditional way What has changed? The new way
ı Capacity and data rates ı Mobile data explosion due to ı Perceived QoE is focus
ı Capacity upgrades lasted video ı ETSI harmonized scoring
longer ı Tougher competition methodology for quality
ı Customer complaints drove ı 5G adds flexibility and ı Deep insights into network
optimization complexity performance and trend
ı Manual trouble shooting and ı New 5G use cases require analysis provide automated
network optimization reliability and low latency action recommendations
ı Accurate data collection in a comparable way is essential

ı Sophisticated data analytics with increasing automation required
ı Operators have to continuously measure and improve network performance and end-user QoE
ı New reliability and latency measurements to be defined
 Network Performance Score is the ETSI harmonized QoE scoring and benchmarking method
NETWORK PERFORMANCE SCORE
The famous ONE figure per
countrywide network
performance (measured from
end users’ perspective  QoE)
► Voice score (40% weight)
► Data score (60% weight)
 All measurement details are available for further analysis and drill-down

QOE CRITERIA AND KPIS (EXAMPLE: VOICE SERVICE)
Voice KPIs
Service Availability (high weight)

Shows points including complete weighting
and the potential to max achievable points
Waiting for action
Quality of the media
 10th percentile: additional points for low number of very bad samples /
 90th percentile: additional points for high number of very good samples

QOE CRITERIA AND KPIS (EXAMPLE: DATA SERVICE)
Data KPIs
Higher weight to
ı Browsing Services
ı and Video services
Higher weight to availability compared

to waiting time and media quality
 More to come in the demonstration

CONTENTS

optimization

Multi Country Benchmarking
in Africa to Improve
Customer Experience
Navindran Naidoo
Group Chief Technology Officer
Rohde & Schwarz

MTN  Leading Operator in Africa
Extensive
quality
infrastructure:
23 countries across
Africa and the Middle East
Syria
Iran
Afghanistan
236 million subscribers

Guinea Conakry
Guinea Bissau
Benin
Nigeria
Cameroon South
Sudan
Sudan Yemen
Market Capitalization Liberia

Ghana Uganda
28bn
Kenya
Ivory Rwanda
Coast Congo
$ Brazzaville
Zambia
Namibia
Botswana
Largest Market Customers Swaziland
Share in South
Africa
14 Countries 28M ISP businesses: Namibia, Botswana, Kenya
136
RATIONALE FOR MTN STANDARDISING BENCHMARKING
Moving from a Network KPI centric assessment to Customer Centric Approach
2017 – Network KPI Focus 2018 – Customer Centric Approach
Assessment conducted by Independent and regulatory/industry aligned

MS Vendor assessment
Ensure one consistent version of the truth from a
Different methodologies
standardised methodology
per vendor.
KPI focus methodology Benchmark MTN network experience against
and scores competitors as well as European markets.
Vendor feature specific Customer centric outcomes used to improve

recommendations customer experience
7 OPCOS #1 Network
NPS as at Dec 2017
12 OPCOS #1 Network NPS as at Aug 2019
137 Rohde & Schwarz

SOUTH AFRICA RESULTS AND ACTIONS
2018 1st Round Results 2018 2nd Round Results
Overall Benchmarking Network NPS : Overall Benchmarking Aug 2018
Ranking Ranking: Network NPS :
Sample Actions implemented.

• Improving call retainability (CDR in rural areas (roads) where the ratio of
dropped calls are higher)
• Implement AMR-WB 23.85 Kbit/s speech coding for UMTS
• Troubleshoot the UMTS RRC performance issues in Johannesburg
138
• Extend the usage of 256 QAM, 4x4 MIMO and 3CCA to compensate for the higher
CONTENTS

optimization

ISOLATED SINGLE 5G NR SITE (3 SECTORS // 3 X 7 BEAMS)
► Clear 3 sectors with different PCIs,
► Sharp split of individual beams per cell
with some reflections / misalignments

NUMBER OF MEMBERS PER TOPN POOL (5G NR & LTE)
► Number of members per TopN pool based on dynamic range of scanner
► LTE live network // isolated single 5G NR site with 3 cells
5G NR
LTE #1
LTE #2
LTE #3

5G NR – SINR VS RSRP (SCANNER MEASUREMENTS)
► SINR vs RSRP similar to LTE
► Gap due to SINR degradation?

5G NR – SINR VS RSRP (SCANNER & UE MEASUREMENTS)
► Max SS-SINR depends on implementation

 Scanner: 30 dB
 Samsung S10 (EU): 25 dB
► Very good correlation between scanner and
UE measurements
► Scanner much more sensitive compared to UE
► Min SS-RSRP // SS-SINR
 Scanner: -140 dBm // -15 dB
 UE: -125 dBm // -5 dB

DRILL DOWN INTO SPECIFIC CELLS (PCI)
► Drill down into a specific PCI offers the view on anomalies in the SINR vs RSRP plot
► E.g. degraded SINR values (blue circles) identified to same PCI (green)
► E.g. better SINR values (red circle) identified for PCI (blue)

DRILL DOWN INTO INDIVIDUAL SSB INDEX PER CELL (PCI)
► Further drill down to SSB indices (color coded) of a specific PCI offers additional insight
about anomalies in the SINR vs RSRP plot
► In this example no obvious anomalies visible

CONCLUSION
Quality Benchmarking important for operator success
ETSI STQ ratified and published TR 103 559 in August 2019

“Best practices for robust network QoS benchmark testing and scoring”
Rohde & Schwarz MNT implemented ETSI TR methodology in test solutions

Network Performance Score connects Benchmarking with Optimization
Good correlation between network scanner and mobile measurements

Both devices are needed for network optimization tasks
SINR vs RSRP correlation plots are a powerful instrument to investigate interference

or network load caused performance degradations  Drill down possible
 Rohde & Schwarz MNT is committed to support the industry with network test
solutions from early trial phase to network optimization and benchmarking
146 Rohde & Schwarz Dec 2019 5G optimization and benchmarking https://blog.mobile-network-testing.com/
NETWORK PERFORMANCE SCORE:
The fastest way from QoE centric
data to actionable insights
Questions? .
www.rohde-schwarz.com/nps .
www.rohde-schwarz.com/smart .
MNT SOLUTION PORTFOLIO
Data
Analytics
Data
Collection
Hardware
options

5G REAL USE CASES
NETWORK MEASUREMENTS AND
INSIGHTS
Arnd Sibila
Technology Marketing Manager
Rohde & Schwarz MNT
(Anwar Faizd Osman)

AGENDA
► New spectrum – real measurements

► FR1 (3.5 GHz) measurement in Italy,
Australia and Korea
► FR2 / mmWave measurements in Malaysia
► DL / UL relation 3.5 GHz (UE Tx power)

CHALLENGES IN EARLY 5G ROLL OUT – NEW FREQUENCIES
Attenuation ► Is the new spectrum really free?
Criteria 600/700 MHz 3.5 GHz 26/28 GHz
Signal Very
Very good Limited
propagation difficult
Mobile Limited Network

Known
communication knowledge practice?
 “New” spectrum is often interfered

 Signal propagation = Interference propagation!
151 Rohde & Schwarz Dec 2019 5G Real world use cases
SPECTRUM CLEARANCE REAL FIELD MEASUREMENTS
RESULTS AT 700 MHz
152 Rohde & Schwarz Dec 2019 5G Real world use cases Germany 700 MHz
REAL FIELD MEASUREMENTS RESULTS AT 3500 MHz
153 Rohde & Schwarz Dec 2019 5G Real world use cases Germany 3.5 GHz
CHANNEL INTERFERENCES IN 3.5GHz 5G SIGNAL
Actual 5GNR
SSB signal
transmitted
Wideband Interference ≈ 20MHz BW Potential

interferers to
5GNR signal
at some
specific
locations
154 Rohde & Schwarz Dec 2019 5G Real world use cases Australia 3.5GHz
AGENDA

Australia and Korea

SSB / BEAMFORMING
VERIFICATION Same PCI, different SSB indices
► Best received SSB index /

beam visualized on the map
► Surprisingly good match with

horizontal “micro sectors”

(SSB beam indices)
► 3.7 GHz, sub-urban

environment
gNodeB
Italy 3.7 GHz
MAIN TAKE-AWAY –
COVERAGE
► Expected UE sensitivity: -125dBm SS-RSRP
~ 6.5km distance
~ -120 dBm (SS-RSRP)
-110dBm SS-RSRP
► Suburban area (3.7 GHz)
► Surprisingly good SSB

coverage
► Static SSB beamforming
 -100dBm SS-RSRP
allows for long radio range -90dBm SS-RSRP
 Operators can try to reuse gNodeB

site grid ?
Italy 3.7 GHz
IDENTIFIED PROBLEM WITH INITIAL gNB DEPLOYMENT
- ONLY 2 SECTORS WERE DETECTED OUT OF A 3 SECTOR gNB INITIALLY
► Sector 3 supposed Location

to be covering the of 3 Sector
green direction/area gNB
► Configuration issue
detected: Different
SSB offset for this
particular PCI
► Resolved by
infrastructure vendor
after gNB restart
158 Rohde & Schwarz Dec 2019 5G Real world use cases Australia 3.5GHz
HOW SCANNERS HELP IDENTIFYING 5G DEPLOYMENT ISSUES
► Measurement of RSRP/SINR for each PCI and Beam Index
► PCI visualization and coverage range
► Beam index visualization and Beam index coverage range for a specific PCI
► gNB configuration and antenna array performance measurement
► Identifying missing sector signals (PCI sectors, beam (micro-)sectors)
► Scanner much more sensitive compared to UE
Min RSRP Min SINR
Scanner -140 dBm -15 dB
UE -125 dBm -5 dB
USE CASE FROM KOREA 5G SCANNING MEASUREMENT
► Coverage issue identified using the 5G scanner and drive test tool
► The BTS provided lower data rate compared to LTE in certain area
► The issue was due to problem at a specific PCI/Beam of the BTS
► ROMES drive test tool offers Multi Layer view  shifting separate map plots
 Easy to identify bad coverage/interference problems at specific locations and their
corresponding PCI/beam
INTERFERENCE ISSUE DUE TO SPECIFIC PCI/BEAM PROBLEM
Coverage (RSRP) at this point is ok,

but SINR is very bad,
location correspond to PCI 444, beam 0
Beam
index plot
PCI Plot
SINR Plot
RSRP Plot
The ROMES drive test tool can be used to identify coverage to interference issue by using
multi-layer view in measurement file.
► PCI 262 seems to be interfered

► PCI 444 is best received
► SINR anyhow bad
► Strong interference area
AGENDA

Australia and Korea
► FR2 / mmWave measurements in
Malaysia
MMWAVE 5G NETWORK – COVERAGE VERIFICATION
► 21 BTS covering
0.8 km2
► 70% of measured
RSRP < -120 dBm
► 5G UE unable to receive
signals below this level
► TSMA6 scanner able to
measure RSRP
< -140 dBm
164 Rohde & Schwarz Dec 2019 5G Real world use cases Malaysia 28 GHz
MMWAVE 5G NETWORK – COVERAGE VERIFICATION
► Removing signals below
-120 dBm RSRP reveals many
blind spot
► Disappointing!
► But: After reporting it came out
that only 5 BTS were
transmitting
► Coverage verification helped

identifying deployment issues
165 Rohde & Schwarz Dec 2019 5G Real world use cases Malaysia 28 GHz
5G SCANNING TEST CASE STUDY FROM MALAYSIA
– FROM MEASUREMENT TO POST PROCESSING
Test Tools Functions
• Data collection: Measure both

• R&S TSMA6 scanner
LTE and 5G mmWave signals
• LTE & mmWave antennas
at the same time with one
• R&S 30GHz down converter
scanner
• To record the measurement

• R&S ROMES4 Drive Test
result, real-time analysis in-field
Software
and generate test report
• SmartAnalytics: • Data analytics: Analyze the

Post Processing Web Based measurement result and
Software generate test report
AGENDA

Australia and Korea

TX POWER VS. (SS-)RSRP – LTE & 5G NR DEVICES
► Max Tx power used nearly instantly
► Max Tx power for RSRP < -85 dBm
► Two discrete branches of max TX power
LTE 5G
TX POWER VS. (SS-)RSRP – LTE & 5G NR DEVICES
► Max Tx power used nearly instantly also for LTE ► Extremely poor TX power performance
► Max 24 dBm @5G NR // Max 23 dBm @LTE in LTE for the Samsung S10 (EU)
CONCLUSION
Clean spectrum is essential pre-condition for good 5G network performance
5G in 3.5 GHz band looks promising due to beamforming gain
5G in mmwave bands is difficult in particular for continuous coverage area
Early 5G smartphones require strong improvements
 Rohde & Schwarz MNT provides commercially available network test solutions
from early trial phase to network optimization and benchmarking
Mobile Network Testing
ENSURING QOE IN 5G NETWORKS

EVOLVING APPLICATIONS AND
MEASUREMENTS
Arnd Sibila
(Dr. Jens Berger)
December 2019
AGENDA
► Technical improvements and who uses 5G
► Traditional and new applications and how

they will change
► Interactivity and how to test
► New QoE concepts and QoE models
► Conclusion
5G TECHNICAL IMPROVEMENTS
WHAT DO PEOPLE EXPECT AND WHAT ARE 5G PROMISES?
► More data-speed! Technically it means more transport capacity
► More interactivity! Technically it means very short transport latency and seamless transport
► More flexibility! Technically addressed by ‘network slices’ serving different needs and QoS requirements
► New applications and use cases! (Finally)
173 Rohde & Schwarz Dec 2019 Ensuring QoE in 5G

5G DEPLOYMENT – FIRST STEP IS DONE IN FIELD
► First 5G real field deployments are done! It is not as much benefit for a normal customer…
► What does it mean in a first step? Download is going a bit faster,
but none of the 5G promises, yet.
 5G EN-DC  5G non-standalone mode
 Device is connected by LTE (4G), one or more 5G carriers are added for supporting transfer capacity
 Requires dual connectivity (4G + 5G) eMBB
► What is next?
 5G standalone access (no dual connectivity required)
 URLLC
 (mMTC)
mMTC URLLC
WHO USES 5G AND HOW?
► Todays networks are optimized for humans using smartphones
► In 5G new classes of users will take advantage of the infrastructure
 Humans (smartphone use case)
 Automotive (connected, autonomous driving, Vehicle-to-X) Requires

 Industry 4.0 (Smart Manufacturing, private 5G networks) 5G standalone
 IoT, mMTC (Smart City, Connected Energy,...)
 Each class causes individual traffic patterns and has individual requirements to the network!
 A network optimized for human users may not deliver best performance for cars or industry

WHAT TO EXPECT FROM 5G?
► Human users will be one user class amongst others
► Main popular applications will remain, but evolve
► New application areas and use cases will be

launched and used
► It is not a ‘switch-on’ rather a ‘phase-in’

 Applications will use what is made available
 There will be a transition phase
Source:

WHAT HAPPENS BEHIND THE SCENES TECHNICALLY?
APART FROM 5G
► Simple Video Download is replaced by DASH
► HTTP almost disappeared and is replaced by HTTPs
► FTP almost disappeared
► TCP is more and more replaced by QUIC
► Today’s remaining UDP traffic could be replaced by a QUIC derivate to make it reliable
► New applications will create and use new types of protocols (e.g. AR, VR, XR)
► Far most data traffic is handled by proprietary and encrypted protocols
DASH: Dynamic Adaptive Streaming over HTTP

177 Rohde & Schwarz Dec 2019 Ensuring QoE in 5G QUIC: Quick UDP Internet Connections
WHAT DOESSystem
3GPP TS23.501: 3GPP SAY ABOUT
Architecture for the 5GQOS?
System (5GS); Stage 2 (Rel16, draft 09/19)
5G QoS characteristics (chap 5.7.3.)
► Priority Level
► Packet Delay Budget (including Core Network Packet Delay Budget)
► Packet Error Rate
► Maximum Data Burst Volume (for Delay-critical GBR resource type only)
► Averaging window (for GBR and Delay-critical GBR resource type only)
Non-GBR

AGENDA

they will change
► Conclusion
LET’S START SIMPLE:
HOW TELEPHONY WILL EVOLVE IN 5G?
► 3GPP Telephony (telephony as primary service)
 QoE makes no significant difference to 4G VoLTE
 Very short call setup time, EVS 24.4 high quality coding
 Accessibility and sustainability will further increase

 Video Telephony may increase but strong competition by OTT
► OTT Telephony
 Today (4G) OTT telephony applications are still behind VoLTE
 Lower accessibility and sustainability (more failed and dropped calls)
 Voice quality can be lower due to time-warping and packet loss (unreliable channels), not by coding
 Significant improvement in 5G (more reliable channels, short latency)
 OTT services will become fully equivalent or even superior to VoLTE (because of wider functionality)

DATA APPLICATIONS IN 5G
THE VAST MAJORITY
► Existing applications and use cases
 Today’s use cases will remain popular
(HTTP-Browsing, Video streaming, OTT Messaging, posting to social media,…)
► Evolving applications and use cases (based on existing use cases)

 4K/8K video, HDR  Similar to today, ‘just’ more throughput
 360° video, Virtual Reality  Similar to today, ‘just’ more throughput
 Rendering will move from device to core (in interaction with device)
 Live video feed, video upstream  Similar to today, more throughput, more reliable
 Real time gaming  More throughput, shorter latency, more reliable
 Rendering will move from device to core (cloud gaming)
► New applications and use cases

 Applications: Augmented reality, Virtual Reality vs. Use Cases: AR gaming, remote control, VR retail shopping,…
 Highly adaptive to network conditions by Machine Learning and AI techniques

WILL WE HAVE AN AR OR VR ‘SERVICE’?
Application Use Cases
► “Service” is UDP (or QUIC)
► Individual use cases will use

same underlying libraries and techniques
and may lead to similar data patterns
in the network
► Differences will be in the objectives and
the requirements in performance
► Individual QoE models for individual
use cases
(an AR retail shopping has different
objectives than an AR assisted surgery)
182 Rohde & Schwarz Dec 2019 Ensuring QoE in 5G Source:

HOW TO MEASURE QOE – WHAT WILL HAPPEN?
► Let’s go back to the integral QoE concept and its dimensions
Connectivity will be
‘always’ given, how to 5G
measure very rare ‘fails’?
This is the idea of

‘ultra reliable’ in URLLC
Instead chasing individual

‘failed access’,
a new concept could be a
‘network stability score’
(‘probability to fail’)

Access time will become

5G
very short
Only minor influence on QoE

in the future

This is the key and the

challenge at the same time! 5G
How to measure? What are the key parameters?

AGENDA

they will change
► Conclusion
TESTING INTERACTIVITY – THE DOOR INTO 5G
► The future will be interactive and real-time
► There will be tons of new interactive applications
► What does it mean: Interactivity?

 More than Bitrate
 Latency and Continuity are key
 Latency stands for transport and also response time Interactivity

 Continuity covers interruptions, undercuts
of required data rate and indirectly packet loss

HOW TO TEST INTERACTIVITY?
► Interactivity is a perceptual metric, depends on application and use case
► Let’s start with: How to measure
 Bitrate
 Round-trip latency / response time
 Continuity
of a data connection between a device in the field

and a server in the network

THE NEW INTERACTIVITY TEST
► The device sends a stream of unique packets to an (active) server
► The server sends back packets as responses
 Data-rate controlled by frequency and size of packets
 Round-trip latency, packet delay variation and packet error rate / corruption ratio measured
► Based on UDP (…is the future anyway)
► Packet rates of 100 to 1500 per second.

This is a continuous packet flow!

THE NEW INTERACTIVITY TEST – THE TECHNIQUE BEHIND
► The protocol and basic implementation is taken from TWAMP
► TWAMP: Two-Way Active Measurement Protocol – specified by IETF, open source
► Implemented under Android native (R&S MNT) to minimize OS influence
 Ready for URLLC
► Server location and implementation:

 Industry target: TWAMP responders in firewalls, routers, infrastructure
 R&S MNT will deploy own server installations
 Server package available by R&S MNT for private installations

THE NEW INTERACTIVITY TEST – PARAMETERS & RESULTS
► Control parameters (on technical level) are: ► Results:
 Data rate TX and RX
 Packet rate low
high  Round-trip latency and
small
packet delay variation
 Packet size  Packet error rate
large
 Delay budget
(…if exceeded,
packet is counted
accepted delay
as dropped)

THE NEW INTERACTIVITY TEST – IN PRACTICE
► Pre-defined ‘Traffic Pattern’ to emulate a certain application, e.g. e-Gaming
► Constant packet flow (low, medium, high)
► Composed patterns (e.g. emulating a 10s ‘e-Gaming’ phase)

 Initial phase
 Highly interactive phase
 Sustainable phase
 Trailing phase
are emulated by different packet flow rates
► Achieved bitrate, round-trip latency and packet

delay variation for each phase and for ‘overall’
duration
► Interactivity score ‘e-Gaming’

► e-Gaming emulation in 4G / LTE
Interactivity Score Per packet

round-trip latency Round-trip latency
(Median and 10th percentile)
Round-trip latency and

packet delay variation
Packet error rate
Achieved bitrate
► Detailed measurement results available (even per packet)
► e-Gaming emulation in 4G / LTE  Bad channels
Delay variation
Packet loss

INTERACTIVITY TEST
SMART ANALYTICS
► e-Gaming emulation in 4G / LTE
Achieved bitrate
Interactivity Score
Packet error rate
Round-trip latency
Packet delay variation

AGENDA

they will change
► Conclusion
INTERACTIVITY SCORE – THE QOE MODEL
► For emulating ‘real’ applications we will apply a generic QoE model
► The QoE model produces a ‘synthetic’ MOS based on QoS and technical KPIs
► Interactivity Score (~ ‘synthetic MOS’)

Interactivity Score = f1 (latency, time) * f2 (delay variation) * f3 (packet loss)

INTERACTIVITY SCORE – E-GAMING
► Interactivity Score
𝐼𝑛𝑡𝑒𝑟𝑎𝑐𝑡𝑖𝑣𝑖𝑡𝑦 𝑆𝑐𝑜𝑟𝑒 = 𝑆𝑐𝑜𝑟𝑒𝐿𝐴𝑇𝐸𝑁𝐶𝑌 ∗ 𝑆𝑐𝑜𝑟𝑒𝑃𝐷𝑉 ∗ 𝑆𝑐𝑜𝑟𝑒𝑃𝐿 ∗ 100 %
Factors scaling linearly

the Interactivity Score

INTERACTIVITY TEST CONCEPT – THE QOE MODEL
► This sort of generic QoE model is fully scalable
► Based on a common set of parameters
‘Drone control’
► Different QoE models for different

Interactivity use cases

SUMMARY
► 5G allows for ‘always available’ services and very short access times
 focus more on quality of a running use case
► Interactivity and continuity become crucial for real-time applications under 5G
► Interactivity Test: combines testing round-trip latency, packet delay variation,

packet error rate and proofing bitrate in one single test
► Full set of detailed results (down to per-packet)
► Smart integrative scoring: Interactivity Score for given use cases (e.g. e-Gaming)
► Interactivity is key for future applications!

Interactivity Test released in R&S network test solutions
► We are 5G URLLC ready!

THANK YOU!
…AND KEEP BEING REAL AND INTERACTIVE!

5G Network Deployment Seminar

Hochgeladen von

Dokumentinformationen

Originaltitel

Copyright

Verfügbare Formate

Dieses Dokument teilen

Dokument teilen oder einbetten

Freigabeoptionen

Stufen Sie dieses Dokument als nützlich ein?

Sind diese Inhalte unangemessen?

Copyright:

Verfügbare Formate

5G Network Deployment Seminar

Hochgeladen von

Copyright:

Verfügbare Formate

WELCOME TO

MNT 5G SEMINAR TOUR US

2 Rohde & Schwarz Mar 2019 Evolving Technologies Overview

► Master’s degree in Electrical Engineering (Communication Technology, RF Technology),

3 Rohde & Schwarz Mar 2019 Evolving Technologies Overview

Rohde & Schwarz Mobile Network Testing

ı 5G market drivers and key challenges

5 Rohde & Schwarz Nov 2019 5G MNT technology introduction

7 Rohde & Schwarz Nov 2019 5G MNT technology introduction

Data traffic growth: 68%

ı Absolute amount of data: 3-fold in 3 years!

8 Rohde & Schwarz Nov 2019 5G MNT technology introduction

► 328 operators in 109 countries

► Just the October 2019 snapshot:

9 Rohde & Schwarz Nov 2019 5G MNT technology introduction

GSA Reports (October ‘19):

10 Rohde & Schwarz Nov 2019 5G MNT technology introduction

n257 26.5 – 29.5 GHz 26.5 – 29.5 GHz

n258 24.25 – 27.5 GHz 24.25 – 27.5 GHz

n259 39.5-43.5 GHz 39.5-43.5 GHz

n260 37 – 40 GHz 37 – 40 GHz

n77 3.3 – 4.2 GHz 3.3 – 4.2 GHz

n78 3.3 – 3.8 GHz 3.3 – 3.8 GHz

n79 4.4 – 5.0 GHz 4.4 – 5.0 GHz

11 Rohde & Schwarz Nov 2019 5G MNT technology introduction

12 Rohde & Schwarz Nov 2019 5G MNT technology introduction

ı 5G market drivers and key challenges

13 Rohde & Schwarz Nov 2019 5G MNT technology introduction

ı 5G market drivers and key challenges

15 Rohde & Schwarz Nov 2019 5G MNT technology introduction

Rel-15 Rel-15 test specifications completed

Rel-16 Rel-16 core specifications completed

16 Rohde & Schwarz Nov 2019 5G MNT technology introduction

17 Rohde & Schwarz Nov 2019 5G MNT technology introduction

eNB is the eNB gNB gNB is the gNB

MME SGW AMF UPF

18 Rohde & Schwarz Nov 2019 5G MNT technology introduction

Frequency SCS Bandwidth DL UL Efficiency DL Efficiency UL

19 Rohde & Schwarz Nov 2019 5G MNT technology introduction

Symbol length = 16,67µs

20 Rohde & Schwarz Nov 2019 5G MNT technology introduction

BWP 1 BWP 2 BWP 3

SSB = SS/PBCH block

Motivation: Provide a flexible method to assign various numerologies to a device, thereby

22 Rohde & Schwarz Nov 2019 5G MNT technology introduction

SS/PBCH BLOCKS = SSB DM-RS

Synchronization Signal Block = SSB . . . . .

► Time domain: 182

SSB consists of 4 OFDM symbols, where

DM-RS occupy different symbols

SSB consists of 240 contiguous

► Like in LTE the Cell ID can be determined

PBCH: Physical Broadcast Channel DM-RS: DeModulation Reference Signal

23 Rohde & Schwarz Nov 2019 5G MNT technology introduction

0 1 2 3 4 5 6 7  Block index 0…Lmax-1

24 Rohde & Schwarz Nov 2019 5G MNT technology introduction

► Example: Case A with subcarrier spacing of 15 kHz and 8 SSB indices

Different beams / SSB indices

 Beamforming of synchronization signals and broadcast information via 5G NR SSBs

25 Rohde & Schwarz Nov 2019 5G MNT technology introduction

► Mapping of antenna ports and Multi Beam sweeping

 5G NR network measurements need to cope with high flexibility and configurability

26 Rohde & Schwarz Nov 2019 5G MNT technology introduction