1.

Single Site Test Tools Setup

As the figure below shown, UE connects to laptop and GPS on the top roof of test
vehicle.

List of tools for single site test as the following table.

Items Name of tools Description

1 TEMS DT software

2 TEMS Discovery DT data analysis software

3 Test terminal UE of cat3 ,cat4,cat6

4 SIM card Speed unlimited.

5 GPS USB GPS

6 Power converter Power converter from 12V to 220V for notebook use during drive test.

7 Notebook Testing software installed and data record

8 Digital Map Provide geographical information for drive testing

9 Vehicle Have enough workspace and cigarette lighter or battery power supply.

2. Single Site KPIs

In case terminal to support CA/VoLTE is not available, related test cases will be
postponed and will be conducted when devices are available.
In case KPI is not met due to technical reasons then corrective action will be
discussed between SF and ZTE and will be implemented and re-offered for testing.
 Testing by internal FTP/UDP server provided by ZTE.
The test results should meet as per exhibit D1.1 document (single site ATP).

2.1 Stationary KPIs

 RRC Connection Request Success Rate

1. Test Procedures
1) After the test setup is ready.
2) Find suitable location, attach the UE to the network, start download 1 file which is
1G through internal FTP server for 60 seconds.
3) Detach terminal(UE) for 10 seconds.
4) Repeat step 2 to step 3 for 10 times.

2. Signaling Flow chart

3. KPI Formula
RRC Connection Request Success Rate= Total Number of RRC Connection Requests
Success / Total Number of RRC Connection Requests *100%

 ERAB drop rate (or drop call rate)

1. Test Procedures
1) After the test setup is ready.
2) Find suitable location, attach the UE to the network, start download 1 file which is
1G through internal FTP server for 60 seconds.
3) Detach terminal (UE) for 10 seconds.
4) Repeat step 2 to step 3 for 10 times.

2. Signalling Flow chart

 3. KPI Formula
Main formula:
ERAB drop rate (or drop call rate) = Number of drop calls * 100%/Total Number of
calls
For measurement, reflect to below formula
ERAB drop rate (or drop call rate) = Total number of
(RRCConnectionReestablishmentRequest-RRConnectionReestablishmentcomplete)
*100% / Total number of Activate default EPS bearer context accept

 Latency

1. Test Procedure
1) After the test setup is ready.
 2) Find suitable location, ping 100 times from laptop to internal FTP server with 32
bytes through LTE network.

2. Formula
Latency= Sum (total ping latency)/ quantity of ping request

In case of abnormal situation (like fading due to rain, transmission latency more than
2ms, etc.) observed in transmission system, corrective action shall be done by ZTE
and test will be re-offered to SF later.

 Packet Loss

1. Test Procedure
1) After the test setup is ready.
2) Find suitable location, ping 100 times from laptop to internal FTP server with 32
bytes through LTE network.

2. Formula
Packets Loss= quantity of ping time out/ quantity of ping request * 100%

 DL Throughput

Throughput testing done for TDD 20MHz, TDD 30MHz, FDD 5MHz, FDD 10MHz.

1. Test Procedures
1) After the test setup is ready.
2) Find suitable location, start download 10 files each of which is 1G simultaneously
through internal FTP or UDP server.
3) Keep the downloading for 1 minute.

2. Formula
Throughput=Sum(PDCP DL throughput of each sample)/Number of valid samples.

 UL Throughput

Throughput testing done for TDD 20MHz, TDD 30MHz, FDD 5MHz, FDD 10MHz.

1. Test Procedures
 1) After the test setup is ready.
2) Find suitable location, start upload 10 files each of which is 1G simultaneously
through internal FTP or UDP server.
3) Keep the upload for 1 minute.

2. Formula
Throughput= SUM (PDCP UL throughput of each sample)/Number of valid samples.

2.2 Mobility KPIs

 Handover Success Rate (Intra)

1. Test Procedures
1) After the test set up ready, drive the vehicle.
2) Start download 1 file which is 1G through internal FTP server
3) Intra ENodeB handover test 6 times handover per site. (cell1->cell2, cell2->cell3,
cell3->cell1, cell1->cell3, cell3->cell2, cell2->cell1).

2. Formula
Handover success rate (Intra) =Intra frequency intra ENodeB Handover success
times/Intra frequency intra ENodeB Handover request attempts*100%

 Handover Success Rate (Inter or X2/S1 interface)

Following handover categories to be tested where applicable

a) X2 HO, b) S1 HO, c) Inter vendor

Exclude isolated sites.

1. Test Procedures
1) After the test set up ready, drive the vehicle.
2) Start download 1 file which is 1G through internal FTP server.
3) Intra-freq handover inter ENodeB test twice handover per site. (eNodeB1-
>eNodeB2, eNodeB2->eNodeB1).

2. Signaling Flow chart

 3) Formula
Handover Success Rate (Inter or X2/S1 interface) = Intra frequency inter ENodeB
Handover success times / Intra frequency inter ENodeB Handover request attempts
*100%

2.3 VoLTE KPI

 VoLTE Setup Success Rate

1. Test Procedure
1) After the test setup is ready.
2) Use the terminal to dial a VoLTE call and then hold the call connection for 60
seconds.
3) Hang up the terminal 30 seconds.
4) Dial another VoLTE call.
5) Perform this test for at least 10 times.

2. Signaling Flow chart

 3. Formula
VoLTE Setup Success Rate =Quantity of completed VoLTE calls / total of VoLTE call
connection requests * 100%

3. Function test

 VoLTE Handover Function Test

1. TEST PURPOSE:
The test is to determine the success of VoLTE call handover.
2. TEST PROCEDURE:
1) Make a VoLTE call to test call number and ensure that voice connection exist.
2) The VoLTE call shall be a continuous call.
3) Stop call when handover happened.