MPLS in Mobile Backhaul

Luyuan Fang
Broadband Forum Ambassador Cisco Systems

MR-234
Issue 2

May 2010

Doug Hunt
Broadband Forum Ambassador Alcatel-Lucent

Agenda
1. Introduction to the Broadband Forum 2. MPLS in Mobile Backhaul
Issues, trends and enablers of the transition to IP/MPLS in evolving backhaul architectures MPLS fit and operation in the mobile backhaul network and the support of end-to-end SLAs, QoS, and high availability features For legacy network migration (TDM and ATM), LTE support (IP/ Ethernet) and their operation in MPLS backhaul networks Operations, Administration and Management (OAM) capabilities of IP/ MPLS backhaul networks

3. MPLS Basics

4. MPLS Pseudowires

5. MPLS OAM and Protection

11. Packet Synchronization and Timing 12. MPLS Mobile Backhaul Initiative MMBI 13. Summary
2

MPLS in Mobile Backhaul Tutorial Contributors

Matthew Bocci Alcatel-Lucent Rao Cherukuri Juniper Networks Dave Christophe Alcatel-Lucent Sultan Dawood Cisco Systems Doug Hunt Alcatel-Lucent Fabien Le Clech France Telecom Drew Rexrode Verizon Nikhil Shah Juniper Networks Dave Sinicrope Ericsson

We are the United Broadband Forum

http://www.broadband-forum.org

The Broadband Forum is the central organization driving broadband solutions and empowering converged packet networks worldwide to better meet the needs of vendors, service providers and their customers. We develop multi-service broadband packet networking specifications addressing interoperability, architecture and management. Our work enables home, business and converged broadband services, encompassing customer, access and backbone networks.

The BroadbandSuite
Goals and Focus
The BroadbandSuite is broken down into three major domains: BroadbandManagement
Goal enhance network management capabilities and enable an intelligent, programmable control layer that unifies diverse networks Focus - empower service providers to deliver and efficiently maintain personalized services that enhance the subscriber experience

BroadbandNetwork
Goal - establish network architecture specifications to support current and emerging services and applications Focus - deliver access, aggregation and core specifications that provide inherent interoperability, quality, scalability and resiliency capabilities from end-to-end

BroadbandUser
Goal - Define unified networking standards by establishing a common set of CPE capabilities within the business, home and mobile environments Focus - Simplify the service delivery process by developing common devices identification, activation, configuration and maintenance specifications
5

broadband-forum.org

Broadband Forum Scope

PARTNER APPLICATION FUNCTION PARTNER CONTROL FUNCTION

Management

Quality of Experience TR-069 (CWMP) Identity, Accounting and Policy Operations and Network Management DSL Quality Management TR-176 DSL Profiles for IPTV

IDENTITY
TR-069 ACS

BILLING OSS
CWMP TR-069

TR-126 IPTV Quality of Experience

Network
Multi-Service Core
VoD
SIP

TR-144 Multi Service Requirements

Edge

Aggregation

Access

TV

Content Network

P2P E-FTTx

IP/MPLS

TR-101, TR-156 Ethernet Aggregation

GPON EPON DSL

Mobile Network
SGW RNC BSC

Multi Service Architecture & Requirements

Certification, Test and Interoperability

broadband-forum.org

We dont work alone

Coordinated industry efforts maximize value with minimum overlap

broadband-forum.org

MPLS in Mobile Backhaul

Issues, trends and enablers of the transition to IP/MPLS in evolving backhaul architectures

State of the Market

Voice and text messages drive majority of current revenue
Price competition Declining average Reduction or flattening of growth in revenue per user (ARPU) minutes per subscriber in markets such as North America Subscribers granted ability to customize phones

Initial 4G (LTE/WiMAX) trials/deployments

Significantly expand data capacity to enable new devices, services and applications ARPU growth 1st generation wireless network built as a data network Focus on reducing cost per bit
9

Evolution to LTE is all about services

CDMA

2001

2002

2003

2004
CDMA2000 1xEV-DO
DL: 2.4 Mbps UL: 153 kbps

2005

2006

2007
EV-DO Rev A
DL: 3.1 Mbps UL: 1.8 Mbps

2008
EV-DO Rev B

2009

2010
LTE
Requirement: DL: 100 Mbps UL: 50 Mbps

CDMA2000 1X
DL: 153 kbps UL: 153 kbps

Services Voice High-speed data Picture/Video Email Web browsing WCDMA

Broadband data VOD, MOD High-speed Internet Enterprise applications

Broadband Real-time Applications

Real-time apps Video telephony, VoIP,PTx, Interactive gaming, Multimedia

HSDPA Rel 5 HSUPA Rel 6

DL: 3.1-73 Mbps UL: 1.8-27 Mbps

Multimedia, VoIP, Video Delivery, Advanced IMS

GSM GPRS
DL: 114 kbps UL: 114 kbps

EDGE
DL: 384 kbps UL: 384 kbps

UMTS (W-CDMA) R99

DL: 384 kbps UL: 384 kbps

HSPA+ Rel 7
Phase 2

HSPA+ Rel 8
Phase 1

LTE
Requirement: DL: 100 Mbps UL: 50 Mbps

DL: 1.8-7.2 Mbps UL: 384Kbps

DL: 7.2 Mbps UL: 5.2 Mbps

TRANSPORT

Target: DL: 40 Mbps UL: 10 Mbps

TDM (SONET/SDH, PDH)

FR, HDLC, ATM/IMA

IP/Ethernet

10

Data revenue for mobile operators

Mobile Data revenue (as % of total ARPU) is growing Mobile broadband data traffic is growing much faster than corresponding revenue growth
11

From 2G/3G to LTE: Towards all-IP, simplified network architecture

2G/3G
CDMA / EVDO GSM / GPRS EDGE UMTS HSPA
Voice Channels IP channel BTS Node B SGSN PDSN BSC / RNC
Packet Switched Core

Broadband Forum focus areas for backhaul

GMSC

Softswitch

MGW

PSTN Other mobile networks Internet

Circuit Switched Core (Voice)

MSC

What is EPC ?
LTE+EPC

New, all-IP mobile core network introduced with LTE

End-to-end IP Clear delineation of control plane and data plane Simplified architecture: flat-IP architecture with a single core

GGSN HA

VPN

IP channel eNode B (eNB)

Evolved Packet Core

Transport (backhaul and backbone)

(All-IP)

Evolved Packet Core = end-to-end IP transformation of mobile core

12

State of market : LTE

Large number of cell sites will support mix of 2G, 3G and 4G (LTE/WiMAX) RAN types Worldwide LTE subscribers will cross 200 millions by 2014
Source: Infonetics, Q3. 2009, ABI research

13

Backhaul connections Growth (By Technology Type)

Operators migrating mobile backhaul to converged, packetbased architectures Microwave used extensively in Europe and Asia Multiple options for backhaul transport Varies based on geography, availability, volume, inter/ intra carrier relationships
Worldwide Mobile Backhaul New Connectivity by Technology

Source: Infonetics, 2008

14

Business and technical Drivers for Mobile backhaul evolution

Expense of the Mobile backhaul is sizable portion of overall OPEX of Mobile operator Fix the legacy backhaul bottleneck (Scale) Solution need to support co-existence of 2G, 3G and 4G base stations on the same cell site. Future Proof: Path to 4G, Next Generation Networks Address network synchronization

15

LTE Deployment requires evolution of backhaul transport

LTE+EPC
eNB IP channel

Evolved Packet Core

eNB

Transport (backhaul and backbone)

(All-IP)

LTE is built on an all-IP flat architecture compared to 3G and previous generations of mobile technology it has A more direct data and control path between the mobile user and the core network Base stations (called eNBs) with additional functionality including direct communication of client data and control plane traffic between eNBs Transport Implications Favors more flexible backhaul mesh, such as architectures that do not need to transverse the aggregation points To support transport of latency-sensitive traffic between eNBs, need a backhaul architecture that minimizes latency MPLS at the aggregation points is one of the likely solutions to this challenge
16

LTE Deployment requires evolution of backhaul transport (continued)

LTE+EPC
eNB IP channel

Evolved Packet Core

eNB

Transport (backhaul and backbone)

(All-IP)

Flatter IP architecture requires smooth interworking between previously separate mobile backhaul and backbone transport networks VPN scaling: LTE enabled eNB user plane by-passes RNC, connects directly to PS-Core Scope of E2E network planning, traffic engineering, transport SLA monitoring increases (e.g. high availability, stringent E2E QoS is no longer broken up into segments with mobile NEs between each)

17

Why MPLS?
MPLS is THE unifying technology for various backhaul types MPLS is proven in Service Provider deployments globally it delivers on its promises MPLS adds carrier-grade capabilities
Scalability - millions of users/end points Resiliency - high availability including rapid restoration Manageability ease of troubleshooting & provisioning Traffic Engineering plus QoS predictable network behavior Multiservice support for 2G, 3G ATM and IP RAN (e.g. LTE, WiMAX) and co-existence with other types of traffic e.g. residential Virtualization VPNs to ensure separation of OAM from signaling / bearer planes, partitioning of multi-operator traffic
18

Why IP/MPLS in Mobile Backhaul?

Backhaul requires co-existence of multiple transport options
MPLS is proven mechanism to support ATM, TDM, Ethernet, HDLC emulation (Pseudowires) Allows legacy RAN equipment to continue to be utilized (CAPEX protection) while leveraging the advantages of new packet transport networks

Packet Backhaul needs to support multi-media traffic

Voice/VoIP, Video, SMS, MPLS TE enables advanced QoS capability Improved network utilization, Better ROI

Reliability is critical
MPLS offers faster convergence and interoperable mechanisms for failure detection and recovery

Backhaul is increasingly becoming a strategic asset

MPLS at cell site enabled carriers to offer new revenue generating services (i.e. L2/L3 VPNs)

IP/MPLS

Scalability
19

Resiliency

Multi-Service Manageability

TE/QOS

Multi-phase MPLS migration into RAN Transport

Phase 1 Cell Site
TDM T1/E1 Copper ATM T1/E1 Copper Enet/PPP T1/E1 Copper PPP T1/E1 Copper

Radio Access Network

Hub
Enet Fiber

IP/MPLS Backbone
MTSO
BSC RNC WAC
TDM/IP ATM/IP Enet

2G TDM/IP 3G ATM/IP WiMAX - Enet LTE - Enet

Aggregation via SDH/SONET

TDM ATM PPP Enet SDH/SONET Fiber

Converged IP/MPLS Backbone

TDM ATM PPP Enet wave (PDH channels)

TDM ATM PPP Enet wave (SDH ch)

Separate transmission facilities for different technologies

ATM Aggregation Overlay

Central Aggregation, Consolidation, Service Routing

MPLS edge

20

Multi-phase MPLS migration into RAN Transport

Phase 2 Cell Site
TDM T1/E1 Copper ATM T1/E1 Copper Enet/PPP T1/E1 Copper PPP T1/E1 Copper

Radio Access Network

Hub
MPLS Aggregation for all Technologies
TDM ATM PPP Enet MPLS SDH/SONET fiber TDM ATM PPP Enet MPLS Ethernet fiber

IP/MPLS Backbone
MTSO
BSC RNC WAC
TDM/IP ATM/IP Enet

2G TDM/IP 3G ATM/IP WiMAX - Enet LTE - Enet

Converged IP/MPLS Backbone

TDM ATM PPP Enet wave (PDH channels)

Separate transmission facilities for different technologies

TDM ATM PPP Enet MPLS Ethernet ch wave

Common facility for all traffic

Central Aggregation, Consolidation, Service Routing

MPLS edge

21

Multi-phase MPLS migration into RAN Transport

Phase 3 Cell Site
MPLS Aggregation for all Technologies
2G TDM/IP 3G ATM/IP WiMAX - Enet LTE - Enet

Radio Access Network

TDM ATM Enet IP MPLS SDH/SONET fiber TDM ATM Enet MPLS Ethernet fiber IP

IP/MPLS Backbone
MTSO
BSC RNC WAC
TDM/IP ATM/IP Enet

Hub
MPLS Aggregation for all Technologies

TDM ATM Enet MPLS SDH/SONET fiber TDM ATM Enet MPLS Ethernet fiber

Converged IP/MPLS Backbone

TDM ATM Enet IP MPLS Ethernet ch wave

TDM ATM Enet MPLS Ethernet ch wave

Router

Common facility for all traffic

Common facility for all traffic

MPLS edge IP/MPLS is agnostic to transmission techniques in Access

22

Mobile Backhaul Standards Landscape

3GPP
RAN definition and specification definition of the RAN and its interfaces

Broadband Forum
MMBI architecture of mobile backhaul transport support with MPLS WT-145 next generation broadband network architecture to support mobile backhaul Certification certification of MPLS technologies to support mobile backhaul transport Tutorials and Marketing education on MPLS in mobile backhaul transport and issues

Metro Ethernet Forum

MBH Phase I and II Metro Ethernet services and interfaces required to support mobile backhaul MBH Marketing and Tutorial education on Ethernet in mobile backhaul transport and issues

ITU-T SG 15
Adaptive & Differential Clock Synchronization specification
23

What is MMBI ?
MPLS in Mobile Backhaul Initiative
Work item embraced by the Broadband Forum Defining role IP/MPLS technologies in Mobile backhaul (including LTE)

IP/MPLS Forum launched the industry wide initiative in 2Q 2007 and the Broadband Forum continues that work
Framework and Requirements Technical Spec: IP/MPLS Forum 20.0.0 Detailed technical specs are ongoing work MPLS in Mobile Backhaul Certification Program
Pilot phase on TDM over MPLS complete ATM over MPLS in development Ethernet and IP over MPLS (future work item)

24

What MMBI aims to solve/facilitate ?

Faster mobile broadband deployment
HSPA/HSPA+/LTE, EV-DO, LTE

Enhanced experience for mobile users with new data services and application, along with voice
Location based service, VoIP, gaming, etc

Future-proof investments Improve mobile operators bottom line and simplify operations
Converging technology specific backhaul networks to single multi-service packet infrastructure Based on proven benefits of IP/MPLS while leveraging costbenefits of Ethernet
25

MMBI Reference Architecture (more on this later)

Access
BS

Aggregation
Mobile Aggregation Site Gateway Edge Node Access Node Edge Node

Abis
TDM TNL

Cell Site Gateway

Core MSC 2G MSC 3G Iu-CS

IP/ MPLS Core mobile networ k

RC
TDM TNL

Iub
ATM TNL

Iub/S1
IP TNL

Access network xDSL, microwave, Leased Line, GPON, Optical Eth

Abis Iub

A Gb S5/S8A

Aggregation network
Edge Node Edge Node

ATM TNL

S5/S8A
PDN GW

IP TNL

Iub/S1

Abis
HDLC TNL

HDLC TNL

Abis Iur

Iu-CS Iu-PS

Gb SGSN 2G

Iu-PS

MPLS transport network RAN

SGSN 3G

MPLS PE function could be integrated into the BS (BTS/Node B/BS)/RC

Terminology

WCDMA/ UMTS

CDMA 2000/1x
BTS BSC MSC PDSN

LTE
eNB A GW PDN GW

Technology
GSM/UMTS CDMA 4G

Data Services
EDGE, GPRS, HSPA CDMA2000, 1xRTT, EV-DO LTE

Base Station Node-B Base Station Controller RNC Circuit Edge devices MSC Packet Edge devices SGSN, GGSN 26

MPLS Basics
MPLS operation in the mobile backhaul network Support of end-to-end SLAs, QoS, and high availability features

MPLS Definition
Multiprotocol Label Switching (MPLS) is a network technology that enables network operators to implement a variety of advanced network features, both to serve their customers and to enhance their own network utilization. These features are a result of the transformation of the connectionless per-hop behavior of an Internet Protocol (IP) network into a connection-oriented forwarding along MPLS Label Switched Paths (LSP). MPLS operates over a range of devices such as routers, switches, etc, using enhanced IP protocols and leveraging Operations Administration and Management (OAM) systems similar to those with IP
MPLS can be viewed as an extension of IP, rather than its replacement.

28

MPLS works with both IPv4 and IPv6 MPLS is currently being extended to provide additional packet transport capabilities (MPLS-TP)

Label Switched Path (LSP)

LSP is the path followed by labelled packets that are assigned to the same FEC
Packets of similar characteristics are treated/forwarded in a similar way

LSP

IP source network

IP destination network

MPLS network

FEC is Forwarding Equivalence Class

This class is formed based on the equivalence in forwarding, i.e., forwarding equivalence FEC-to-label binding mechanism Flow (stream, traffic trunk) of IP packets forwarded over same LSP FEC-to-label binding mechanism binding is done once, at the ingress
29

Network Engineering vs. Traffic Engineering

Network Engineering
"Put the bandwidth where the traffic is"
Physical cable deployment Virtual connection provisioning

Traffic Engineering
"Put the traffic where the bandwidth is"
On-line or off-line optimisation of routes Ability to diversify routes

Leverage knowledge of available resources in network

30

Providing Resiliency with MPLS

Lower Layers
Partial or full mesh Automatic Protection Switching strategies of SONET/ SDH/WDM

MPLS Layer
Outage
Protection and Re-routing procedures

Administrative
Re-optimization and Preemption

IP Layer
IGP convergence algorithms
IGP: Internal gateway protocol

31

Carrier-Grade IP/MPLS Protection

Restoration time
Recovery times smaller than IGP convergence times. 50ms fail-over possible. Failover transparent to edge service protection mechanisms

Resource efficiency
Leverages statistical gains over use of optical or SDH/SONET layers

Service differentiation
MPLS enables granular levels of protection. This helps service differentiation (QoS, protection)

Node protection
Service awareness assist in node protection or protection of layer 2 traffic

Robustness
Route pinning avoids transient LSP behavior when SPF routing changes

Interoperability
32

MPLS provides standardized protection in multi-vendor environments RFC 4090: FRR extensions to RSVP

MPLS Pseudowires
For legacy network migration (TDM and ATM), LTE support (IP/Ethernet) and their operation in MPLS backhaul networks

What is PWE3?
PWE3 Pseudowire Emulation Edge-toEdge IETF Working Group assigned to study carriage of Legacy and New Services over MPLS Protocol encapsulations can be carried over MPLS
Legacy Services under consideration are:
FR, ATM, SONET & SDH, DS0, DS1, DS3,

And new services such as:

Ethernet, VLANs, etc.
34

MPLS Pseudowire
Reference Model
Native Emulated Service
Pseudowire (PW) (forward) MPLS Tunnel LSP (forward)

CE1

AC

PE1

IP/MPLS Network
MPLS Tunnel LSP (backward) Pseudowire (backward)

PE2

AC

CE2

AC: Attachment Circuit ATM, Ethernet , FR, IP, TDM, etc Attachment Circuit (AC) CE: Customer Edge - Same at each end PE: Provider Edge
35

MPLS Point-to-Point Services

Label Stacking
Tunnel Header PW Header
VC Encaps Information

Layer 2 payload

Three Layers of Encapsulation

1) LSP Tunnel Header: Contains information needed to transport the PDU across the IP / MPLS network 2) Pseudowire Header: Used to distinguish individual PWs within a single tunnel 3) Emulated VC Encapsulation: Contains the information about the enclosed PDU (known as Control Word)

LSP Tunnel Header determines path through network Pseudowire Header identifies VLAN, VPN, or connection at the end point All services look like a Virtual Circuit to MPLS network
36

Layer 2 Encapsulation - PWE3

Ethernet
RFC 4448
3G to 4G (LTE/WiMax) 3G R99/R3 UMTS

ATM cell and ATM AAL5

RFC 4717

TDM
RFC 4553 (structure agnostic)
RFC 5086 (CES0PSN)

2G to 3G

PPP/HDLC
RFC 4618

CDMA

37

Encapsulation Methods for Transport of Ethernet over MPLS Networks

4 octets

Tunnel Header
bits Set to 0 to signify PW data

4 octets

PW Header
4 0000

Control Word
12 Reserved

4 octets

Payload (Ethernet/802.3 PDU)

16 Sequence Number

Control Word (use is optional)

Enables transport of an Ethernet/802.3 PDU across a MPLS network Ethernet PDU consists of the Destination Address, Source Address, Length/Type, MAC Client Data and padding Ethernet PW operates in one of two modes:
Raw mode: If there is a 802.1Q VLAN tag in a frame, it is passed transparently by network Tagged mode: Each frame must contain at least one 802.1Q VLAN tag which PW termination points have an agreement (signaled or manually configured) on how to process tag

Optional Control Word allows: Sequence number to guarantee order of frames use is optional
38 RFC 4448

ATM Cell Mode Encapsulation for Transport over MPLS

4 octets 4 octets

Tunnel Header
bits 4

PW Header
4 4

52 octets 52 octets Control ATM cell #1 ATM cell #2 minus FCS minus FCS word 6 Length 16 Sequence Number

4 octets

0000 Flags Res

Control Word

N-to-One Cell Mode Multiple Cell Encapsulation Control Word (optional) VPI VCI ATM Payload (48 bytes) VPI VCI ATM Payload (48 bytes) PTI C PTI C

2 modes relevant to backhaul:

One-to-One Cell Mode - maps one ATM VCC (or VPC) to one PW N-to-One Cell Mode - maps one or more ATM VCCs (or VPCs) to one PW (shown above); only required mode for ATM support

Ingress performs no reassembly Control word is optional: If used, Flag and Length bits are not used
39 RFC 4717

Structure-Agnostic TDM Encapsulation for Transport over MPLS (SAToP)

4 octets

Tunnel Header
bits

4 octets

PW Header
4 1 1

Control Word
2 2 6

4 octets

Fixed RTP Header* 16

TDM Payload
* Optional see RFC 3550

0000 L R RSV FRG Length

Sequence Number

SAToP Control Word

Structure agnostic transport for TDM (T1, E1, T3 and E3) bit streams
Ignores structure imposed by standard TDM framing Used in applications where PEs do not need to interpret TDM data or
participate in TDM signaling

SAToP Control Word allows:

Detection of packet loss or mis-ordering Differentiation between MPLS and AC problems as causes for emulated

service outages Conservation of MPLS network bandwidth by not transferring invalid data (AIS) Signaling of faults detected at PW egress to the PW ingress
40 RFC 4553

PW Control Plane
PWs have a control plane that signals binding of PW label to the PW FEC

PE

MPLS

Tunnel LSP

PE

CE

Layer 2 AC

Pseudowire

Layer 2 AC

CE

Ethernet ATM TDM, etc

Payload (L2 protocol) Targeted LDP PW Label LSP Label RSVP-TE or LDP Inner Label Outer Label

MPLS Label Stack

PW Setup and Maintenance: IETF RFC 4447 41

MPLS Pseudowires for Backhaul

2G
BTS

L2 AC

MPLS RAN
Pseudowire

3G
Node B

MTSO PE L2 AC

4G
eNB, BS

Cellsite PE

Tunnel LSP

PW frame payload (L2 protocol)

PW Label T-LSP Label Inner Label Outer Label

MPLS Label Stack Pseudowires Emulate a native layer 2 service, such as Ethernet, TDM, ATM VC/VP, FR VC, etc Many PWs carried across MPLS network in a tunnel LSP PWs can utilise features of the MPLS network for resiliency, QoS, etc

42

Multi-Segment PW for Backhaul

2G
BTS

Cell Site

Ethernet, TDM, ATM MS-PW

3G
Node B

MPLS Access

MPLS Aggregation
Pseudowires Tunnel LSP T-PE

4G
eNB, BS

S-PE

Hub
T-PE

MTSO

43

A static or dynamically configured set of two or more contiguous PW segments that behave and function as a single point-to-point PW Enables: Scalability to hundreds of base stations connecting to RNC/BSC site Multi-domain operation including multi-provider backhaul networks Multi-technology operation leverage mechanisms from non-MPLS access infrastructures

MPLS OAM and Protection

Operations, Administration and Management (OAM) capabilities of IP/MPLS mobile backhaul networks

MPLS for Backhaul: OAM Requirements

OAM needed for reactive & proactive network maintenance
Quick detection and localization of a defect Proactive connectivity verification and performance monitoring

OAM tools have a cost and revenue impact to carriers

Reduce troubleshooting time and therefore reduce OPEX Enable delivery of high-margin premium services which require a short restoration time

Service Level
e.g ATM OAM, MAC-Ping

VLL / PW Level
e.g VCCV, PW status

Top level requirements

Provide/co-ordinate OAM at relevant levels in IP/ MPLS network Proactive and reactive mechanisms, independent at all levels
45

Tunnel LSP Level

e.g LSP ping

OAM and Service Assurance: Mobile Backhaul

Test Service Latency, Jitter, Packet Loss and Round-trip Delay Monitor Alerts for Potential SLA Violation Calculate SLA Performance Metrics

Operator GUI
OAM Notification

Schedule a Suite of Tests at Service Activation or Time of Day Automate On-Demand Test Suites from Fault Notification

2G
BTS

OSS

OAM Notification (flat file)

MPLS RAN
3G
Node B

MTSO PE L2 AC

L2 AC Cell-site PE

Pseudowires

Tunnel LSP

4G
eNB, BS

46

Service-Aware OAM Toolkit

Cell Site
2G
BTS VLL / PW Level
e.g BFD, VCCV, PW status

Service Level
e.g ATM OAM, SDP-Ping

3G
Node B

MPLS Access

MPLS Aggregation
Pseudowires Tunnel LSP

4G
eNB, BS

Hub
Tunnel / LSP Level
e.g LSP Ping & Traceroute

MTSO

Quickly isolate and troubleshoot faults to reduce MTTR Tool set for reactive & proactive network operation and maintenance
Defect detection, proactive connectivity verification, and performance monitoring Provide/co-ordinate OAM at relevant levels in IP/MPLS network Services Level: Eth CFM, Eth EFM, ATM, FR loopback, SAA Tunnel LSP Level: LSP ping and LSP Traceroute Pseudowire Level: PW Status, VCCV-BFD, VCCV-Ping, mapping to Ethernet, TDM, ATM notifications MPLS is currently being extended to provide additional packet transport capabilities (MPLS-TP) for performance monitoring, path segment monitoring and alarm suppression 47

LSP Ping

LSP Ping is MPLS specific variation of traditional ICMP ping/traceroute ad hoc tool
Ping is simple e2e loopback Traceroute uses TTL to incrementally verify path

Ping paradigm useful for craftsperson initiated testing

TELNET/CLI

48

LSP Ping is augmented with a number of TLVs processed by the receiver to extend functionality As LSP is unidirectional, and Ping is bi-directional, LSP Ping is augmented with options for distinguishing real problems from return path problems

Bidirectional Forwarding Detection (BFD)

Simple, fixed-field, hello protocol

Easily implemented in hardware Very useful as a fault-detection mechanism

49

Nodes transmit BFD packets periodically over respective directions of a path If a node stops receiving BFD packets some component of the bidirectional path is assumed to have failed Applicable to tunnel end-points

Virtual Circuit Connection Verification (VCCV)

2G 3G 4G
BTS Node B

PE1
Attachment Circuit

PSN
Pseudowire

PE2
Attachment Circuit

4G-3G-2G A GW/ HBSC/RNC Complex

eNB, BS

Mechanism for connectivity verification of PW Multiple PSN tunnel types

MPLS, IPSec, L2TP, GRE,

Motivation
One tunnel can serve many pseudo-wires MPLS LSP ping is sufficient to monitor the PSN tunnel (PE-PE connectivity), but not PWs inside of tunnel

Features
Works over MPLS or IP networks In-band CV via control word flag or out-of-band option by inserting router alert label between tunnel and PW labels Works with BFD, ICMP Ping and/or LSP ping
50

PW Status Signaling
AC defect PW status: AC RX fault AC defect

2G 3G 4G

BTS Node B

PE1
Attachment Circuit

PSN
Pseudowire

PE2
Attachment Circuit

4G-3G-2G A GW/ HBSC/RNC Complex

eNB, BS

PWs have OAM capabilities to signal defect notifications:

Defect status mapped between AC and PW in the PE PW status signaling propagates defect notifications along PW - Extension to T-LDP signaling

51

PW Status Signaling: Multi-segment PWs

2G
BTS

PW Status
MPLS Access
Node B

MPLS Aggregation
Pseudowires

3G

S-PE

Tunnel LSP

T-PE

4G
eNB, BS

Hub
T-PE

MTSO

Cell Site

PW status signaling also works for MS-PWs S-PEs:

Transparently pass remote defect notifications Generate notifications of local defects
52

MPLS Network Reliability

Both node level and network level recovery are required
3G
Node B
Ethernet

active standby MPLS RAN

A GW/ RNC

4G
eNB, BS

ATM (IMA)

Node Level Recovery Non-stop routing for ALL protocols (LDP, OSPF, IS-IS, BGP, multicast, PIM-SM) Non-Stop Service for ALL services (VPLS, VLL, IP-VPN, IES, multicast)
53

Network Level Recovery Dual-homing w/o RSTP MPLS FRR MPLS Standby Secondary Sub 50 ms restoration End-to-end path protection MPLS extensions to include additional approaches

Network Level Redundancy for PWs

AC redundancy protocol drives forwarding state of PWs/PEs Active/standby state of LAG/APS sub-groups reflected in PW status

3G
Node B
Ethernet

active
PW status
A GW/ RNC ATM (IMA)

4G
eNB, BS

MPLS RAN standby

Forwarding direction determined by PW state

AC redundancy: MC APS MC - LAG

Protects against PE and AC failures

PE configured with multiple pseudowires per service with multiple endpoints Local precedence indicates primary PW for forwarding if multiple PWs are operationally UP PW status exchanged end-to-end to notify PEs of operational state of both PWs & ports / attachment circuits (PW Status Notification).
54

draft-ietf-pwe3-pw-redundancy & draft-ietf-pwe3-redundancy-bit

Packet Synchronization and Timing

The Need for Synchronization in Mobile Networks

RNC RNC

NobeB

1: Radio Framing Accuracy

NodeB

Mobile Core Network(s)

eNB or BS

A GW

2 : Handoff Control
eNB or BS

3 : Backhaul Transport Reliability

Synchronization is vital across many elements in the mobile network In the Radio Access Network (RAN), the need is focused in three principal areas
56

Radio Framing Accuracy

In Time Division Duplexing (TDD), the base station clocks must be time synchronized to ensure no overlap of their transmissions within the TDD frames
Ensuring synchronization allows for tighter accuracies and reduced guard-bands to ensure high bandwidth utilization

In Frequency Division Duplexing (FDD) centre frequencies must be accurate for receivers to lock
57

Handoff Control For Reliable Mobility Performance

Synchronization is vital to ensure service continuity (i.e successful handoff) Studies have shown significant reduction in call drops when good synchronization is in place; enhanced QoE
58

Backhaul Transport Reliability

Backhaul network
eNB/BS/ NodeB/BTS

X
TCP end-to-end windowed transmission

A GW/ RNC/ BSC

Wander and Jitter in the Backhaul and Aggregation Network can cause underflows and overflows Slips in the PDH framing will cause bit errors leading to packet rejections Packet rejections lead to retransmissions and major perceptible slow down in TCP windowed sessions
59

Clock distribution methods

Physical layer clock
Using synchronous TDM interfaces, e.g. PDH/SDH Using synchronous Ethernet as per G.8261/G.8262, and G. 8264 for ESMC/SSM External Timing Interface

GPS synchronization Clock distribution over packet network

IEEE 1588-2008 ITU-T Q13/SG15 currently developing an IEEE Std 1588-2008 "telecom profile" for frequency distribution NTP The IETF is currently developing NTPv4*

Adaptive & Differential Clock Synchronization Multiple methods might be deployed in a network
*Note: NTPv3 requires equipment with high quality oscillators

60

MPLS Mobile Backhaul Initiative MMBI

MMBI Scope
MPLS technology to transport mobile traffic (user plane and control plane) over access, aggregation and core networks 4G (LTE), 3G, 2.5G and 2G networks, including evolution RAN and Core equipments with range of physical interfaces (e.g. FE, GE, E1/T1, STM1/OC-3, DSL, etc.) and technologies (PDH, SDH/SONET, ATM and ATM/IMA, PPP, FR, Ethernet, etc.), either directly attached or through an intervening access network Different kinds of access transmission technologies: pt-to-pt access (xDSL, microwave, P2P Fiber), pt-to-mp access (GPON) Address coexistence of legacy and next generation mobile equipment in the same network infrastructure. Support a smooth migration strategy for network operators as newer TNLs (Transport Network Layers) are introduced and legacy TNLs are phased out
62

MMBI Scope (continued)

MPLS facilities in Access and/or Aggregation networks leased from a third party, and which may be shared by more than one mobile operator Converged access/aggregation network supporting both wireline, e.g. residential and enterprise, and wireless services. QoS for support of distinct service types (e.g. real-time services and associated delay and jitter requirements) Support for clock distribution to the base stations, including frequency, phase and time synchronization Resiliency capabilities, including failover times appropriate for wireless backhaul networks. E.g. dual attachment at the BSC/ RNC and methods for failover. OAM mechanisms

63

Multiple TNLs Successive Generations of Mobile Architecture

Network GSM/GPRS/EDGE (2G/2.5G) UMTS R3, R99/R4 R99/R5, R6, R7 CDMA 1x-RTT CDMA 1x EV-DO LTE IS-2000 IS-856 R9, R10 Specification Transport Network Layer (TNL) TDM, IP* ATM ATM IP HDLC or TDM IP IP

64

*Note: some 2G and 2.5G equipment can be upgraded to use an IP TNL

MMBI Architecture and Use Cases

Deployment Scenarios -- Location for MPLS functions is intended to be flexible
MPLS interworking functions could be located either:
In the edge node, or in the access node, or in the access gateway or directly integrated into the base station.

TNL (Transport Network Layer) Scenarios Support for a range of access technologies at base stations and controller elements
Case 1: TDM TNL
Base stations and controller elements communicating using TDM bit streams

Case 2: ATM TNL

Base stations and controller elements communicating using ATM cells

Case 3: IP TNL
Base stations and controller communicating using IP packets

Case 4: HDLC TNL

Base stations and controller elements communicating using HDLCencoded bit streams (e.g. CDMA)
65

Typical 2G and 3G RAN Topology

Star topology enabling communication from BS to Controller and from Controller to BS Centralized topology
66

Typical LTE RAN Topology

Star topology enabling communication from BS to aGW and communication from aGW to BS. Neighboring any-to-any topology enabling communication between BSs Flat topology
67

MMBI Reference Architecture 2G/3G

68

Generic TNL Protocol Stack 2G/3G Architecture: Example of SS-PW Deployment

TNL TNL
TNL PW

LSP L2 L1 L1 L1

LSP L2 L1

TNL PW LSP L2 L1 L2 L1

TNL LSP LSP L2 L1 L2 L1 LSP LSP L2 L1

TNL PW

TNL

L1

L1

L1

MPLS network PE BS
TDM CSG ATM Ethernet

Access network Access Node

P Aggregation P network MPLS Node MPLS Node

PE TNL PW MASG TDM

ATM Ethernet

RC

69

PW extends from PE to PE Each TNL Type supported by corresponding TNL PW In deployment scenario shown, PW extends from Cell Site Gateway (CSG) to Mobile Aggregation Site Gateway (MASG)

Generic TNL Protocol Stack 2G/3G Architecture: Example of MS-PW Deployment

TNL TNL
TNL PW

TNL PW LSP L2

LSP L2 L1 L1 L1 L1

TNL PW LSP LSP L2 L2

TNL TNL PW TNL PW LSP LSP L2 L1

TNL

L1

L1

L1

L1

L1

MPLS network
T-PE BS
TDM CSG ATM Ethernet

Access network Access Node

T-PE S-PE Aggregation network TNL PW MPLS MASG TDM

ATM Ethernet

RC

70

PW extends from T-PE to T-PE; switched at S-PE Each TNL Type supported by corresponding TNL PW In deployment scenario shown, PW extends from Cell Site Gateway (CSG) to Mobile Aggregation Site Gateway (MASG)

MMBI: Timing deployment scenarios

Access
BTS / Node B CSG
Access Gateway
TNL

Aggregation
BTS / Node B MASG
Access Node BNG

MSC 2G 2 G -3 G BS C / RNC Complex A A Gb Core mobile network Gb Iu - PS SGSN 2G SGSN 3G MSC 3G / MPLS Iu-CS

Edge Node

TNL

BTS / Node B

PRC via GPS

Access network xDSL, microwave, Leased Line, GPON, Optical Eth

Aggregation network

Iu - CS Iu - PS

(a 1 ) (a2 ) (a3 ) (a4 )

PHY clock PKT clock

(b )

(c)

(d )

71

IP transformation in mobile networks with evolution to LTE

CS Core

TODAY
Backhaul (TDM/ATM)
Node B RNC SGSN GGSN

PS Core

1
Radio intelligence moving to eNodeB

2
Backhaul transition to IP/ Ethernet

3
RNC bearer mobility evolves to the SGW RNC control distributed into the MME/eNB

4
MCS voice and SGSN packet mobility evolves into the SGW SGSN control evolves into the MME

5
CS and PS evolve into a unified all-IP domain

6
Best effort to e2e QoS

7
Internet

LTE
Backhaul (IP/Ethernet)
MME PCRF

Multimedia Services

eNB

SGW

Service and mobile aware all-IP network

PDN GW

72

LTE Evolved Packet System (EPS) Backhaul (IP TNL Application)

UE EUTRAN eNB
X2 S10

EPC HSS MME

S6a S11

Applications IMS PCRF

S5/S8 Gx SGi Rx

Apps

S1-MME

eNB

S-GW
S1-U S5

P-GW

PDN

The Evolved Packet System consists of the following sub-systems:

User Equipment (UE) which includes specialized security cards often identified as part of the EUTRAN (detail not shown) Evolved UTRAN (EUTRAN) which consists of the evolved Node B (eNB) Evolved Packet Core (EPC) which includes the following nodes: Serving Gateway (S-GW) which serves as a mobility anchor for inter-eNB handover PDN Gateway (P-GW) which is the cross-technology mobility anchor in the EPS The Mobility Management Entity (MME) which handles authentication and signaling for connection and mobility management The Policy and Charging Rules Function (PCRF) supports per session QoS and associated billing Applications include IMS as well as non-IMS UEs signal directly to the applications HSS: Home Subscriber Server 73

Evolved Packet Core: Overview of components and functionality

eNodeB: all radio access functions
Radio admission control Scheduling of UL and DL data Scheduling and transmission of paging and system broadcast IP header compression (PDCP) Outer-ARQ (RLC)
Policy Decisions PCRF

Policy, Charging & Rules Function

Network control of Service Data Flow (SDF) detection, gating, QoS & flow based charging Dynamic policy decision on service data flow treatment in the PCEF (xGW) Authorizes QoS resources

PDN Gateway
IP anchor point for bearers UE IP address allocation Per-user based packet filtering Connectivity to packet data network

Mobility Management Entity

Authentication Tracking area list management Idle mode UE reachability S-GW/PDN-GW selection Inter core network node signaling for mobility between 2G/3G and LTE Bearer management functions

Serving Gateway
Local mobility anchor for inter-eNB handovers Mobility anchoring for inter-3GPP handovers Idle mode DL packet buffering Lawful interception Packet routing and forwarding

74

MMBI Reference Architecture - LTE

Flat Topology RANs using IP TNL:
Network HSPA+ flat LTE Specification 3GPP R7 3GPP R8 TNL IP

MPLS provides two solutions that can be applied to combination of any-to-any and star topologies:
Layer 2 VPNs e.g. VPLS Layer 3 VPNs e.g. BGP IP/VPNs RFC 4364

75

MMBI Reference Architecture VPLS Use Cases

Access
Cell SIte Gateway (CSG)

Aggregation
Mobile Aggregation Site Gateway (MASG)

Core

BS1
S1
IP TNL

CSG1

Edge Node

aGW
S5/S8a S3/S4 IP/MPLS Core network

Access network
CSG2

Access Node

SGSN PDN GW

BS2
S1
IP TNL

Edge Node

Aggregation network

IP TNL

S1 S3/S4 S6a

S5/S8a S6a

BS3
S1
IP TNL

CSG3

Edge Node

HSS

Access network

L2VPN MPLS transport network solutions

CSG1 CSG2 CSG3 CSG1 CSG2 CSG3 CSG1 CSG2 CSG3 CSG1 CSG2 CSG3

aGW
MPLS PE function could be integrated into the aGW (MME GW, S - GW, ASN GW)

Ethernet Ethernet VPLS Full mesh Spoke PWs

VPLS

VPLS

VPLS
Eth PW VSI

H - VPLS

H-VPLS

Note: BS supports Ethernet interface. One Cell Site Gateway can connect multiple BS.

76

MMBI Reference Architecture L3VPN Use Cases

Access
Cell SIte Gateway (CSG)

Aggregation
Mobile Aggregation Site Gateway (MASG)

Core

BS1
S1
IP TNL

CSG1

Edge Node

aGW
S3/S4 S5/S8a IP/MPLS Core network

Access network
CSG2

Access Node

SGSN PDN GW

Edge Node

BS2
S1
IP TNL

Aggregation network

IP TNL

S1 S3/S4 S6a

S5/S8a S6a

BS3
S1
IP TNL

CSG3

Edge Node

HSS

Access network

L3VPN MPLS transport network solutions

CSG1 CSG2 CSG3 CSG1 CSG2 CSG3 CSG1 CSG2 CSG3

aGW

IP IP L3VPN

L3VPN

MPLS PE function could be integrated into the aGW (MME GW, S - GW, ASN GW)

L3VPN
L3VPN

MPLS

VRF Note: BS supports Ethernet interface. One Cell Site Gateway can connect multiple BS.

77

Abstract Test Suite for TDMoMPLS

TDMoMPLS
46 Test Cases
Additional 11 Synchronization Test Cases

The Abstract Test Suite for TDM Services over MPLS describes test procedures based on the requirements for encapsulating TDM signals over MPLS networks and distributing timing using pseudo-wires over a MPLS network. Test cases in this specification are defined for T1, E1, T3 and E3 services.
An overview of the different groups of requirements that compose the TDM circuit emulation
78 Services over MPLS is provided as follows: Packet format and encapsulation layer Usage of optional RTP header Structure-agnostic emulation Structure-aware emulation Packetization and depacketization TDMoMPLS defects Performance monitoring Synchronization distribution and performance (Normative Annex)

Abstract Test Suite for ATMoMPLS

ATMoMPLS
Draft Currently 50 Test Cases

The Abstract Test Suite for ATM over MPLS describes test procedures based on requirements for encapsulating Asynchronous Transfer Mode (ATM) over MPLS networks.
An overview of the different groups of requirements that compose the Abstract Test Suite for ATMoMPLS is provided as follows:
Packet format and encapsulation OAM - Fault & Performance management QOS Mapping Synchronization (ref: ATS for TDMoMPLS Annex S)
79

Future Certification Test Suite Development Ethernet over MPLS IP over MPLS

80

Certification Benefits
Service Provider community Vendor meets requirements Potential savings of resources Vendor community Marketing tool Shortening test cycle Carefully written test cases, better specifications User community Purchase equipment with confidence

81

MPLS in Mobile Backhaul

Summary of Success Factors

MPLS in Mobile Backhaul: Critical

Success Factors
Backhaul transformation is essential for 2G/3G (scalability and cost reduction) and evolution to a LTE all IP flat architecture Co-existence of multiple transport options (ATM, TDM, Ethernet) for investment protection Carrier Grade IP/MPLS services
High Availability Fast reconvergence

Efficient End-to-End Management and OAM for rapid mass deployment Scalability to large numbers of cell sites Base Station synchronization
Carrier frequency accuracy of 50 PPB for LTE, WiMAX, GSM/W, CDMA Need to preserve synchronization & timing with Carrier Ethernet transport
83

Focus from the Broadband Forum

Rapid growth in mobile backhaul bandwidth demand
Scaling the backhaul in TDM way for all traffic is expensive Industry is shifting towards IP based networks
Can migrate entire mobile RAN OR Hybrid model - Use MPLS for the data traffic and voice remains on TDM

IP/MPLS offers many benefits and has been deployed globally in mobile core. Similar drivers apply to backhaul. Standards for backhaul transport - leaning towards IP In recent years, the Broadband Forum has published implementation agreements to facilitate the migration of ATM and TDM to MPLS-based infrastructure Broadband Forum aims to complement the cost benefits of Ethernet with the proven track record of MPLS for building converged, reliable and QoS-aware mobile grade infrastructure.
84

Broadband Forum Mobile Backhaul work in progress

Technical Specifications for MPLS Based Mobile Backhaul Networks for LTE (WT-221) Technical Specifications for MPLS Based Mobile Backhaul Networks for 2G & 3G (WT-222) Equipment Requirements for MPLS over Aggregated Interfaces e.g., MPLS over Ethernet LAG (WT-223) MPLS in Carrier Ethernet Networks network architecture for providing carrier Ethernet services (WT-224) Abstract Test Suite for ATM over MPLS Certification testing (WT-225)

85

Related Standards Organizations and Consortiums

3GPP: http://www.3gpp.org Broadband Forum: http://www.broadband-forum.org IEEE: http://www.ieee.org IETF: http://www.ietf.org ITU-T SG 15: http://www.itu.int/ITU-T/studygroups/com15/index.asp Metro Ethernet Forum (MEF): http://metroethernetforum.org Next Generation Mobile Network Initiative (NGMN):
http://www.ngmn.org

WiMAX Forum: http://www.wimaxforum.org

86

Thank you for attending the MPLS in Mobile Backhaul Tutorial

The Broadband Forum is a non-profit corporation organized to create guidelines for broadband network system development and deployment. This Broadband Forum educational presentation has been approved by members of the Forum. This Broadband Forum educational presentation is not binding on the Broadband Forum, any of its members, or any developer or service provider. This Broadband Forum educational presentation is subject to change, but only with approval of members of the Forum. This educational presentation is copyrighted by the Broadband Forum, and all rights are reserved. Portions of this educational presentation may be copyrighted by Broadband Forum members or external sources.

For more information, visit us at http://

www.broadband-forum.org

Abbreviations
2G Second generation mobile network 3G Third generation mobile network 4G Fourth generation mobile network AG Access gateway aGW Access gateway ASN Access service node BS Base station BSC Base station controller BTS Base transceiver station CDMA Code division multiple access CS Circuit switched CSG Cell site gateway EDGE Enhance data rates for GSM evolution eNB - 4G/LTE base station eNode B 4G/LTE base station EPC Evolved packet core EUTRAN Evolved UTRAN EV-DO Evolution data optimized FEC Forwarding equivalence class FRR Fast re-route GGSN Gateway GPRS support node GPRS General packet radio service GSM Global system for mobile communications GW Gateway HSPA High speed packet access HSS Home subscriber server LSP Label switched path LTE Long term evolution MASG Mobile aggregation site gateway MGW Message gateway MMBI MPLS in mobile backhaul initiative MME Mobility management entity MPLS Multiprotocol label switching MPLS-TP MPLS Transport Profile MSC Mobile switching center MTSO Mobile telephone switching office Node B Base station transceiver with UMTS/WCDMA PCRF Policy and charging function PDN Packet data network PDSN Packet data serving node P-GW PDN gateway PS Packet switched PW Pseudowire RAN Radio access network RNC Radio network controller RSVP Resource reservation protocol SGSN Serving GPRS support node S-GW Serving gateway TE Traffic engineering TNL Transport network layer UE User equipment UMB Ultra mobile broadband UMTS Universal mobile telecommunications system VLAN Virtual local area network VPN Virtual private network WAC WiMAX wireless access controller WiMAX Worldwide interoperability for microwave access

88