Beruflich Dokumente
Kultur Dokumente
0
KPI Reference
Issue 03
Date 2013-06-26
and other Huawei trademarks are trademarks of Huawei Technologies Co., Ltd.
All other trademarks and trade names mentioned in this document are the property of their respective
holders.
Notice
The purchased products, services and features are stipulated by the contract made between Huawei and
the customer. All or part of the products, services and features described in this document may not be
within the purchase scope or the usage scope. Unless otherwise specified in the contract, all statements,
information, and recommendations in this document are provided "AS IS" without warranties, guarantees or
representations of any kind, either express or implied.
The information in this document is subject to change without notice. Every effort has been made in the
preparation of this document to ensure accuracy of the contents, but all statements, information, and
recommendations in this document do not constitute a warranty of any kind, express or implied.
Website: http://www.huawei.com
Email: support@huawei.com
Purpose
Due to the rapid expansion of multimedia applications, the downlink peak data rate now
exceeds 100 Mbit/s. The Long Term Evolution (LTE) standard was developed to meet this
increasing demand. A set of KPIs have been defined to evaluate this new system's
performance, especially that of the evolved Radio Access Network (eRAN).
Product Versions
The following table lists the product version related to this document.
Intended Audience
This document is intended for:
Network planners
Network administrators
Network operators
Change History
This section provides information about the changes in different document versions.
03(2013-06-26)
This is the third commercial release.
Compared with Issue 02 (2013-05-30), Issue03 (2013-06-26) includes the following changes.
Change Type Changed Part Change Description
02 (2013-05-30)
This is the second commercial release.
Compared with Issue 01 (2013-04-28), Issue 02 (2013-05-30) includes the following changes.
01 (2013-04-28)
This is the first commercial release.
Compared with Issue Draft A (2013-02-08), this issue modified the mapping between the Cell
Downlink Average Throughput KPI/Cell Uplink Average Throughput KPI and counters.
Draft A (2013-02-08)
This is a draft.
Contents
4 Mobility KPIs............................................................................................................................... 11
4.1 Intra-Frequency Handover Out Success Rate ................................................................................................. 11
4.1.1 Description ............................................................................................................................................ 11
4.1.2 Definition .............................................................................................................................................. 14
1 Overview
This document specifies a set of eRAN KPIs used to evaluate the performance of the LTE
system and provides a detailed description of the counters necessary for calculating these
KPIs. Given that LTE is a new system, the KPIs in this document are drafts, and as such, are
subject to change. KPIs will be updated according to commercial network management and
radio network optimization needs.
The KPIs in this document are classified into the following seven categories:
Accessibility KPIs
Retainability KPIs
Mobility KPIs
Service integrity KPIs
Utilization KPIs
Availability KPIs
Traffic KPIs
This document contains the following contents.
Chapter Details
2 Accessibility KPIs
Accessibility KPIs are used to measure the probability that a user accesses the network and
requests services in the given operating conditions. The service provided by the E-UTRAN is
defined as EPS/E-RABs. (EPS is short for evolved packet system, and E-RAB is short for
E-UTRAN radio access bearer). Radio Resource Control (RRC) connections and System
Architecture Evolution (SAE) setups are the main procedures whose performance is measured
by accessibility KPIs.
2.1.2 Definition
The RRC Setup Success Rate (Service) KPI is defined in Table 2-1. Note that the number of
RRC connection setup attempts (service) and the number of successful RRC setup
connections (service) are collected based on the description in section 2.1.1 "Description."
Formula RRCConnectionSuccessservice
RRCS_SRservice 100%
RRCConnectionAttemptservice
Associated See chapter 9 "Counter List."
Counters
2.2.2 Definition
The RRC Setup Success Rate (Signaling) KPI is defined in Table 2-2. Note that the number of
RRC connection setup attempts (signaling) and the number of successful RRC setup
connections (signaling) are collected based on the description in section 2.1.1 "Description."
Formula RRCConnectionSuccessother
RRCS _ SRother 100 %
RRCConnectionAttemptother
The eNodeB collects the number of E-RAB connection setup attempts at measurement point
A, and the number of successful E-RAB connections is counted at measurement point B, as
shown in Figure 2-2 and Figure 2-3. Note that the eNodeB needs to specify the Quality of
Service (QoS) Class Identifier (QCI) for VoIP in the E-RAB setup message.
The voice service can be identified by the QoS information, particularly the QCI in the
E-RAB Setup Request message. In general, QCI 1 is assigned to the voice service.
2.3.2 Definition
The E-RAB Setup Success Rate (VoIP) KPI is defined in Table 2-3. Note that the number of
E-RAB connection setup attempts (VoIP) and the number of successful E-RAB setup
connections (VoIP) are collected based on the descriptions in section 2.3.1 "Description."
Formula VoIPERABSetupSuccess
VoIPERABS _ SR 100 %
VoIPERABSetupAttempt
2.4.2 Definition
The E-RAB Setup Success Rate (All) KPI is defined in Table 2-4. The number of E-RAB
connection setup attempts (all) and the number of successful E-RAB setup counters (all) are
collected based on the description in section 2.3.1 "Description."
Formula ERABSetupSuccess
ERABS _ SR 100 %
ERABSetupAttempt
2.5.2 Definition
The Call Setup Success Rate KPI is defined in Table 2-5. The KPI is calculated by
multiplying the RRC Setup Success Rate (Service) KPI, the S1 Signaling Connection Setup
Success Rate KPI, and the E-RAB Setup Success Rate (All) KPI.
Formula CSSR
RRCConnectionSuccessservice S1SIGConnectionEstablishSuccess ERABSetupSuccess
100%
RRCConnectionAttemptservice S1SIGConnectionEstablishAttempt ERABSetupAttempt
3 Retainability KPIs
Retainability KPIs indicate the network's capability to retain services requested by a user for a
desired duration once the user is connected to the services. Retainability KPIs are important in
evaluating whether the system can maintain a certain level of service quality.
When the eNodeB sends an E-RAB Release Indication message to the MME or a UE Context
Release Request message to the MME as shown in Figure 3-1, the abnormal E-RAB release
counter is incremented if the bearer to be released carries data and the release cause is not
"Normal Release", "Detach", "User Inactivity", "CS Fallback triggered", "UE Not Available
for PS Service", or "Inter-RAT Redirection". If the message contains several E-RAB ID IEs
(in the E-RAB To Be Released List IE), the counter will be incremented for each individual
E-RAB.
3.1.2 Definition
The Call Drop Rate (VoIP) KPI is defined in Table 3-1.
Formula VoIPERABAbnormalRelease
VoIP _ CDR 100 %
VoIPERABRelease
Associated See chapter 9 "Counter List."
Counters
3.2.2 Definition
The Service Drop Rate (All) KPI is defined in Table 3-2.
Formula ERABAbnormalRelease
Service_ CDR 100 %
ERABRelease
Associated See chapter 9 "Counter List."
Counters
Formula ERABAbnormalRelease
AlwaysOnline _ CDR 100 %
ERABReleaseOfAlwaysOnline
Associated See chapter 9 "Counter List."
Counters
4 Mobility KPIs
Mobility KPIs are used to evaluate E-UTRAN mobility performance, which is critical to
customer experience. Three categories of mobility KPIs are defined based on the following
handover types: intra-frequency, inter-frequency, and inter-Radio Access Technology (RAT).
Two scenarios are available for the inter-eNodeB HO, as shown in Figure 4-2 and Figure 4-3.
The HO attempts are collected at point B. When the source-eNodeB (S-eNodeB) sends an
RRC Connection Reconfiguration message to the UE, it decides to perform an inter-eNodeB
HO. In this KPI, the source and target cells of the handover operate at the same frequency.
The number of inter-eNodeB intra-frequency HO attempts is measured at the source cell.
The number of successful inter-eNodeB intra-frequency HOs is collected at point C, as shown
in Figure 4-2 and Figure 4-3. During a handover with the source and target cells at the same
frequency, the number of successful inter-eNodeB intra-frequency HOs is measured in the
source cell. This measurement occurs when the S-eNodeB receives a UE Context Release
message from the target-eNodeB (T-eNodeB) or a UE Context Release Command message
from the MME, indicating that the UE T-eNodeB is successfully attached to the T-eNodeB.
4.1.2 Definition
The Intra-Frequency Handover Out Success Rate KPI is defined in Table 4-1. Note that the
attempted HO and the successful HO counters are collected based on the description in
section 4.1.1 "Description."
Formula IntraFreqHOOutSuccess
IntraFreqHOOut _ SR 100 %
IntraFreqHOOutAttempt
4.2.2 Definition
The Inter-Frequency Handover Out Success Rate KPI is defined in Table 4-2. Note that the
attempted HO and the successful HO counters are collected based on the description in
section 4.2.1 "Description."
Formula InterFreqHOOutSuccess
InterFreqHOOut _ SR 100 %
InterFreqHOOutAttempt
Two scenarios are available for the inter-eNodeB HO, as shown in Figure 4-5 and Figure 4-6.
The HO attempts are collected at point B in the target cell when the T-eNodeB sends a
Handover Request Acknowledge message to the S-eNodeB or the MME. The number of
successful inter-eNodeB HO s are measured in the target cell at point C when the T-eNodeB
receives an RRC Connection Reconfiguration Complete message from the UE and sends a
UE CONTEXT RELEASE message to the S-eNodeB or when the T-eNodeB sends a
HANDOVER NOTIFY message to MME.
4.3.2 Definition
The Handover In Success Rate KPI is defined in Table 4-3. Note that the attempted HO and
the successful HO counters are collected based on the description in section 4.3.1
"Description."
Formula HOInSuccess
HOIn _ SR 100 %
HOInAttempt
4.4.2 Definition
The Inter-RAT Handover Out Success Rate (LTE to CDMA) KPI is defined in Table 4-4. The
number of LTE-to-CDMA2000 HO attempts and the number of successful inter-RAT HOs
from LTE to CDMA2000 are collected as described in section 4.4.1 "Description."
4.5.2 Definition
The Inter-RAT Handover Out Success Rate (LTE to WCDMA) KPI is defined in Table 4-5.
The number of LTE-to-WCDMA HO attempts and the number of successful inter-RAT HOs
from LTE to WCDMA are collected as described in section 4.5.1 "Description."
4.6.2 Definition
The Inter-RAT Handover Out Success Rate (LTE to GSM) KPI is defined in Table 4-6. The
number of LTE-to-GSM HO attempts and the number of successful inter-RAT HOs from LTE
to GSM are collected as described in section 4.6.1 "Description."
4.7.2 Definition
The Inter-RAT Handover Out Success Rate (LTE to TD-SCDMA) KPI is defined inTable 4-7.
The number of LTE-to-TD-SCDMA HO attempts and the number of successful inter-RAT
HOs from LTE to TD-SCDMA are collected as described in section 4.7.1 "Description."
Unit %
The service integrity KPIs indicate the E-UTRAN impacts on the service quality provided to
the end-user. The service integrity KPIs can be calculated for each cell or radio network.
5.1.2 Definition
The Service Downlink Average Throughput KPI is defined in Table 5-2. Nine different
sub-KPIs exist for each QCI. The formula for each KPI is mapped to its corresponding
counter. Table 5-1 lists the requirements for services with different QCIs.
Unit kbit/s
5.2.2 Definition
The Service Uplink Average Throughput KPI is defined in Table 5-3. Nine sub-KPIs exist for
each QCI. The formula for each KPI is mapped to its corresponding counter.
Unit kbit/s
5.3.2 Definition
The Cell Downlink Average Throughput KPI is defined in Table 5-4 and is calculated based
on all the data transferred at the downlink and the time it takes to transfer. The formula is
mapped to its corresponding counters.
Formula CellDLTrafficVolume
CellDLAveThp
CellDLTransferTime
Unit kbit/s
5.4.2 Definition
The Cell Uplink Average Throughput KPI is defined in Table 5-5 and is calculated based on
all the data transferred at the uplink and the time it takes to transfer. The formula is mapped to
its corresponding counters.
Formula CellULTrafficVolume
CellULAveThp
CellULTransferTime
Unit kbit/s
5.5.2 Definition
The Cell Downlink Maximum Throughput KPI is defined in Table 5-6 and is calculated based
on the maximum volume of traffic transferred each second. The formula is mapped to its
corresponding counters.
Formula CellDLMaxTrafficVolumeforEach1s(bit)
CellDLMaxThp
1000 (ms )
Unit kbit/s
5.6.2 Definition
The Cell Uplink Maximum Throughput KPI is defined in Table 5-7 and is calculated based on
the maximum volume of traffic transferred each second. The formula is mapped to its
corresponding counters.
Formula CellULMaxTrafficVolumeforEach1s(bit)
CellULMaxThp
1000 (ms )
Unit kbit/s
6 Utilization KPIs
Utilization KPIs are used to evaluate the capabilities, such as the capability to meet traffic
demands, in specific internal conditions.
6.1.2 Definition
The uplink and downlink Resource Block Utilizing Rate KPIs are defined in Table 6-1.
Formula RB _ Used DL
RB _ URDL 100 %
RB _ AvailableDL
RB _ UsedUL
RB _ URUL 100 %
RB _ AvailableUL
6.2.2 Definition
The Average CPU Load KPI is defined in Table 6-2. The CPU load is calculated by averaging
the CPU usage ratio during the measurement period.
Measurement CPU
Scope
Formula MeanCPUUtility
7 Availability KPIs
A cell is available when the eNodeB can provide EPS bearer services. Availability in a cell
can be measured when a variety of hardware/software faults occurs in the cell.
7.1.2 Definition
The Radio Network Unavailability Rate KPI is defined in Table 7-1. This KPI is calculated
based on the length of time all cell services are unavailable on the radio network.
Formula CellUnavailTime
RAN _ Unavail _ Rate Cluster
100 %
TheTotalNumberOfCellsInCluster*{SP}* 60
NOTE
"SP" indicates the reporting period for counters in minutes.
8 Traffic KPIs
Traffic KPIs are used to measure the traffic volume on the LTE Radio Access Network (RAN).
Based on traffic types, the traffic KPIs are classified into the following categories: radio
bearers, downlink traffic volume, and uplink traffic volume.
8.1.2 Definition
The Radio Bearers KPIs are defined in Table 8-1 and include ten different sub-KPIs. The
formula for each KPI is mapped to its corresponding counter.
Formula RadioBearers
RadioBearers _ QCI _ 1
RadioBearers _ QCI _ 2
RadioBearers _ QCI _ 3
RadioBearers _ QCI _ 4
RadioBearers _ QCI _ 5
RadioBearers _ QCI _ 6
RadioBearers _ QCI _ 7
RadioBearers _ QCI _ 8
RadioBearers _ QCI _ 9
Unit NA
8.2.2 Definition
The Downlink Traffic Volume KPIs are defined in Table 8-2 and include ten sub-KPIs. The
formula for each KPI is mapped to its corresponding counter.
Formula DLTrafficVolume
DLTrafficVolume_ QCI _ 1
DLTrafficVolume_ QCI _ 2
DLTrafficVolume_ QCI _ 3
DLTrafficVolume_ QCI _ 4
DLTrafficVolume_ QCI _ 5
DLTrafficVolume_ QCI _ 6
DLTrafficVolume_ QCI _ 7
DLTrafficVolume_ QCI _ 8
DLTrafficVolume_ QCI _ 9
Associated See chapter 9 "Counter List."
Counters
Unit bit
8.3.2 Definition
The Uplink Traffic Volume KPIs are defined in Table 8-3 and include ten sub-KPIs. The
formula for each KPI is mapped to its corresponding counter.
Formula ULTrafficVolume
ULTrafficVolume_ QCI _ 1
ULTrafficVolume_ QCI _ 2
ULTrafficVolume_ QCI _ 3
ULTrafficVolume_ QCI _ 4
ULTrafficVolume_ QCI _ 5
ULTrafficVolume_ QCI _ 6
ULTrafficVolume_ QCI _ 7
ULTrafficVolume_ QCI _ 8
ULTrafficVolume_ QCI _ 9
Associated See chapter 9 "Counter List."
Counters
Unit bit
8.4.2 Definition
The Average User Number KPI is defined in Table 8-4. The formula is mapped to its
corresponding counters.
Formula AveUserNumber
Associated See chapter 9 "Counter List."
Counters
Unit NA
8.5.2 Definition
The Maximum User Number KPI is defined in Table 8-5. The formula is mapped to its
corresponding counters.
Formula MaxUserNumber
Associated See chapter 9 "Counter List."
Counters
Unit NA
9 Counter List
Table 9-1 provides a list of all the counters relevant to KPI calculation. In each KPI
specification, one or more parameters are used to calculate the KPI, as shown in the KPI
formula. Each parameter is mapped to a counter. For details on each counter, see eNodeB
Performance Counter Reference.
Note that only QCI 1 is used for VoIP service (conversational voice). According to Table 6.1.7
in 3GPP TS 23.203, QCI 7 can also be assigned to non-conversational voice. In this document,
QCI 7 is not considered to be part of the VoIP service in KPI calculation.
The counters listed in the following table are described in eNodeB Performance Counter
Reference.
L.Thrp.bits.UL.QCI.8
L.Thrp.bits.UL.QCI.9
Average User Number AvgUserNumber L.Traffic.User.Avg
Maximum User MaxUserNumber L.Traffic.User.Max
Number
10 References
1. 3GPP, TS36.331 v10.9.0 (March 2013), "Evolved Universal Terrestrial Radio Access
(E-UTRA), Radio Resource Control (RRC); Protocol Specification, (Release 10)"
2. 3GPP, TS36.300 v8.6.0 (September 2008), "Evolved Universal Terrestrial Radio Access
(E-UTRA) and Evolved Universal Terrestrial Radio Access Network (E-UTRAN);
Overall description; Stage 2 (Release 8)"
3. 3GPP, TS36.413 v8.3.0 (September 2008), "Evolved Universal Terrestrial Radio Access
(E-UTRA) and Evolved Universal Terrestrial Radio Access Network (E-UTRAN); S1
Application Protocol (S1AP) (Release 8)"
4. 3GPP, TS23.401 v8.4.0 (December 2008), "Technical Specification Group Services and
System Aspects; General Packet Radio Service (GPRS) enhancements for Evolved
Universal Terrestrial Radio Access Network (E-UTRAN) access (Release 8)"
5. 3GPP, TS23.203 v8.3.1 (September 2008), "Technical Specification Group Services and
System Aspects: Policy and charging control architecture (Release 8)"
6. eNodeB Performance Counter Reference