MOBILE NETWORK TESTING

DIVERSITY BM II
R&S Regional Headquarters Singapore
Albert Huang, Customer Project Manager
1 PRODUCT OVERVIEW
2 BEST IN CLASS
3 BM II SPECIFICATIONS
4 OTHER PRODUCTS

19.06.2015 COMPANY CONFIDENTIAL 2

MNT PORTFOLIO
Benchmarking

Optimization

Service Quality
Monitoring

Data management,
analysis & reporting

19.06.2015 COMPANY CONFIDENTIAL 3

QUALIPOC
Benchmarking
Optimization
Service Quality Monitoring

19.06.2015 COMPANY CONFIDENTIAL 4

ROMES/DIVERSITY
Benchmarking
Optimization

19.06.2015 COMPANY CONFIDENTIAL 5

NETWORK BENCHMARKING

Definition
Network Benchmarking is all about comparing Performance and
Quality of A with B with C…
One can benchmark different Network Operators, different infrastructure vendors, different
geographical areas, different services, different technologies, different devices, different use
cases…

The results are typically used by:

 Network Quality Management to measure their own network quality and compare it with
the competition or to compare against quality thresholds
 Network Optimization teams to improve the quality of the network where needed
 Marketing departments to work out marketing claims
 Network planning to decide on network investments

19.06.2015 COMPANY CONFIDENTIAL 6

FOOTPRINT

Mobile Operators Testing Service providers Regulators Infrastructure vendors

19.06.2015 COMPANY CONFIDENTIAL 7

FOOTPRINT
SECTOR MARKET SHARE

Anite
Accuver 3%
13%

Ascom
26%
SwissQual
58%

Benchmarking Leader
BMII launched MWC 2013 (February 2013)
Source: SwissQual estimates based on published data till 2013 Un-parallel Reliability with <0.8% modular
failure rate till date

19.06.2015 COMPANY CONFIDENTIAL 8

DEVICES
Google Samsung
Nexus 10

Nexus 5
(P8110) Galaxy Note 3

Galaxy Note 3
(N900T)

(SC-01F) Devices
HTC
Nexus 7

One M8
(K009) Galaxy Note 3

Galaxy Note 3
(SM-N9005)

(SM-N900V)
Supported List &
One

One
XL

XL
(X325s)

(X325u)
Galaxy Note 3

Galaxy Note 4
(SM-N900W8)

(SM-G910F)
Integration Program
Lenovo K910L Galaxy Note 4 (SM-G910W8)
LG 8350 Galaxy Note 4 (SM-N910G) 66 devices actively still in
G2

G3
(VS980)

(D727)
Galaxy Note Edge

Galaxy Note Edge

(SM-N915G)

(SM-N915W8)
commercial market
Sony
G3 (D855)

Xperia Z1 (C6903)
Galaxy S5

Galaxy S5
(SC-04F)

(SM-G9008V)
BYO Phones
Xperia Z2 (D6503) Galaxy S5 (SM-G900A)

Xperia Z3 Tablet Compact (SGP621) Galaxy S5 (SM-G900AZ)

New phone integration
Xiaomi
Samsung
Note 4G Redmi Galaxy S5 (SM-G900F)
program
Galaxy S4 (GT-I9505) Galaxy S5 (SM-G900FQ)

Galaxy S4 (GT-I9506) Galaxy S5 (SM-G900I)

Galaxy S4 (GT-I9507) Galaxy S5 (SM-G900M)

Galaxy S4 (GT-I9515L) Galaxy S5 (SM-G900P)

Galaxy S4 (SCH-I545) Galaxy S5 (SM-G900R4)

Galaxy S4 (SCH-I545L) Galaxy S5 (SM-G900R7)

Galaxy S4 (SCH-L720T) Galaxy S5 (SM-G900T)

Galaxy S4 (SCH-R970X) Galaxy S5 (SM-G900T1)

Galaxy S4 (SGH-I337) Galaxy S5 (SM-G900V)

Galaxy S4 (SGH-I337M) Galaxy S5 (SM-G900W8)

Galaxy S4 (SGH-I337Z) Galaxy S5 (SM-G901F)

Galaxy S4 (SGH-M919) Galaxy Tab 2 (SGH-I497)

Galaxy S4 (SGH-M919N) Galaxy Tab 4 (SM-T530N)

Galaxy S4 (SGH-M919V) Galaxy Tab 4 (SM-T537A)

Galaxy S4 (SHV-E330L) Galaxy Tab 4 (SM-T537V)

(SGH-
Galaxy S4 Mini I257) Galaxy Tab 8.9 (GT-P7320)
(SGH-
Galaxy S4 Mini I257M) Galaxy Tab 8.9 (GT-P7320T)
(GT-
Galaxy Note 10.1 N8010) Galaxy Tab 8.9 (SGH-I957)
(GT-
Galaxy Note 10.1 N8013) Galaxy Tab 8.9 (SGH-I957D)
(GT-
Galaxy Note 10.1 N8020) Galaxy Tab S (SM-T705)
(SCH-
Galaxy Note 10.1 I925)

Galaxy Note 10.1 (SM-P600)

Galaxy Note 10.1 (SM-P605)

19.06.2015 COMPANY CONFIDENTIAL 9

TEST CASES
2G 3G 4G
• Air Interface logging (Idle monitoring)   
• Forcing Functions (Technology/Band, Advanced Forcing)   
• Voice Call testing (Call To Any)   
• Speech MOS Testing (SQUAD or P.863 NB and WB)   
M>L and M>M, MOC and MTC, DL and UL

• Speech Audio Delay Testing (SQUAD RTT)   

• Data   
Ping, FTP DL/UL, HTTP DL/UL, Capacity DL (multi thread HTTP), IPERF

• HTTP Browsing   
• Messaging   
SMS, MMS, Email

• Youtube Video Streaming   

Non-reference and J.343.1 Video MOS

• Multi-RAB job (Simultaneous Voice and Data)   

• Parallel jobs (Up to 3 jobs running independent)   

19.06.2015 COMPANY CONFIDENTIAL 10

1 PRODUCT OVERVIEW
2 BEST IN CLASS
3 BM II SPECIFICATIONS
4 OTHER PRODUCTS

19.06.2015 COMPANY CONFIDENTIAL 11

DIVERSITY BENCHMARKER II
PRODUCT HIGHLIGHTS
Modularity
Cascadeable
PC modules
Up to 8 modules for a true
benchmarking approach
Up to 24 test devices per system
Individually hot-swappable
processing module with soft
shutdown features
19.06.2015
Productivity
Easy to operate
Pre-configured at start up
Multi-channel test start and
stop with one button
System status dashboard and
customizable workspaces
Easy to clone for company
wide roll-out
COMPANY CONFIDENTIAL 12
DIVERSITY BENCHMARKER II
PRODUCT HIGHLIGHTS
Reliability
Ruggedized system
designed for drive
testing in all scenarios
Very low Hardware Failure rate
Solid State for high-vibration
operation
Enclosed module design
minimizes dust intrusion
19.06.2015
Safety
Key for the
hardware and
software design
Meeting safety standards
for car installation
Smart user interface
reduces user’s actions
Direct 12V connection to
vehicle battery
COMPANY CONFIDENTIAL 13
DIVERSITY BENCHMARKER II
PRODUCT HIGHLIGHTS INFLUENCE OF AMBIENT TEMPERATURE ON NET THROUGHPUT

arstechnica: In-depth with the Snapdragon 810‘s heat

300000

250000 239868 237047

217780
190321 197503
200000

Device Control 150000

121020
101784 100891
Cooling and Healing 100000

problems. April 24,2015

Thermal airflow design with 50000
43278

active cooling over

Smartphones performing 0

Source:
5˚ Celcius 15˚ Celcius 35˚ Celcius
measurements Max Avg Min

Smartphones remain at high

R&S – SwissQual, Internal Studies of Temperature

Influence toward throughput performance, June 2015
clock speed to ensure
optimum results
Self healing device reset
capabilities with automatic
restart of blocked devices

Source:
19.06.2015 COMPANY CONFIDENTIAL 14
DIVERSITY BENCHMARKER II
PRODUCT HIGHLIGHTS

CPU BENCHMARK

Future Proof Design 8276

4G and Beyond
3711
Intel i3 or i7 processor
Faster processor in the market 3456

Thermal air flow design and

2481
market leading cooling system
for PC modules 664

0 2000 4000 6000 8000 10000

i7-3770T i3-3220T i7-3517UE i7-2610UE Atom D2550

Source:
http://www.passmark.com/index.html , all figures extracted
May 2015.

19.06.2015 COMPANY CONFIDENTIAL 15

DIVERSITY BENCHMARKER II
PRODUCT HIGHLIGHTS
Configuration
SQL configuration database
Automatic hardware and
SIM card detection
Device and Measurement
task grouping
Data device interface
selection
- Dial Up, Proprietary NDIS or
Win7 Mobile Broadband
19.06.2015
Data acquisition Test Execution
Safe measurement file Intra module communication
writing allowing synchronous task
Patent-pending data starting and stopping
reduction technology to Alternate task execution
manage measurement
between modules for Shared
file size growth
network testing
Flexible job decisions, select
specific tests parameters
based on Technology
Sequential or Parallel Multi-
RAB/DTM text execution
COMPANY CONFIDENTIAL 16
DIVERSITY BENCHMARKER II
MEASUREMENT SCENARIO

19.06.2015 COMPANY CONFIDENTIAL 17

1 PRODUCT OVERVIEW
2 BEST IN CLASS
3 BM II SPECIFICATIONS
4 OTHER PRODUCTS

19.06.2015 COMPANY CONFIDENTIAL 18

 DIVERSITY BENCHMARKER II
COMPONENTS RCM
DMR RF Combiner Module:
Device Module Rack: Optional Slide-in Module
Including 2 4-ports RF
Maximum 8 slots for Test
combiner and accessories
Device Modules such as:
Audio SlideIn Modules with SSM
Smartphones or Feature
Scanner SlideIn Module:
Phones – DataSlideIn Module
with USB Data Stick or Optional Slide-in Module
MiniPCIe modules Including R&S TSME scanner

DSM ASM
Data SlideIn Module: Audio SlideIn Module:
RF shielded data device housing RF shielded phone housing
Automatic power fault recovery Battery emulation
High stability device cradle Automatic power fault
External antenna low loss recovery
connectors High stability phone cradle
Autonomous cooling External antenna low loss
For USB Devices as well as connectors
embedded MiniPCIe Autonomous cooling
External SIM slot External SIM Slot

CMR
Computer Module Rack: Control Laptop:
CSM
8 slots for Computer SlideIn System Control and
Modules
Computer SlideIn Module:
Monitoring
Gbit LAN switch with 10 ports Measurement PC Connects to CBM LAN
12V DC power input Connects Phone, Data Devices switch
Main Power Switch and RF Scanners
Controlled via Gbit LAN

19.06.2015 COMPANY CONFIDENTIAL 19

DIVERSITY BENCHMARKER II
COMPONENTS

Performance Efficient
Full LTE capability Up to 4 devices per CSM
Intel Ivy Bridge mainboard 2 phones in ASM phone housing
with i3 CPU, 2.8GHz 1 USB modem or mPCle in DSM
(+20% performance housing with 1 ASM
compared to PCM-i7)
1 USB modem only with 2 ASMs
4GB RAM, Win7 x64, SSD
1 Multi-technology RF Scanner

Robust Smart
For all drive testing Total Android
and conditions Smartphone support
Special mSATA Runs tests directly on
SSD disc the device
High friction, high power Automatic Android application
USB connector for USB management
data sticks
Active cooling for devices Full POLQA, PESQ and SQuad
housed in ASM/DSM Speech test support

19.06.2015 COMPANY CONFIDENTIAL 20

1 PRODUCT OVERVIEW
2 BEST IN CLASS
3 BM II SPECIFICATIONS
4 OTHER PRODUCTS

19.06.2015 COMPANY CONFIDENTIAL 21

R&S© TSMA
AUTONOMOUS DRIVE TEST SCANNER

1 No PC required
2 Hot-swappable battery pack
3 Proven TSME scanner platform

19.06.2015 COMPANY CONFIDENTIAL 22

QUALIPOC FREERIDER III
THE ULTIMATE PORTABLE BENCHMARKER

1 Multi-device Protective Core

2 The only Active cooling backpack
3 Walk test and Drive test
4 Smart power supply concepts
5 R&S TSME scanner

19.06.2015 COMPANY CONFIDENTIAL 23

Visit: www.swissqual.com
DIVERSITY BENCHMARKER II
THE REFERENCE BENCHMARKER

1 Hot swappable modules

2 Self-recovery functionalities
3 Independent temperature control
4 Unbeatable processing capability
5 Reliable and scalable

19.06.2015 COMPANY CONFIDENTIAL 25