Sie sind auf Seite 1von 58

Cisco ASR9000 Router Systems Architecture

Lim Fung, CTG Technical Marketing


Session ID 20PT
limfung@cisco.com
Service Edge Foundation: ASR 9000 System

o Optimized for Aggregation of

o Designed for Longevity & TCO:

o Based on IOS-XR & Cisco PRIME for

o Enables of
Business & Residential Services for both
Fixed & Mobile Networks

o Advanced

o Industry Leading
with Cisco nV
Technology

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2
Cisco ASR 9000 Functional Evolution
Comprehensive Edge Functionality

Application
Network Virtualization
Market Functionality

Virtualization
Mobile (nV)
Backhaul on
High Scale
ATM & CEoPS
Ethernet
Subscriber
IP RAN Backhaul Awareness
For Ethernet & TDM
Advanced
Rich L3 VPN IPv6
Data Center Layer 2
Services & Services
PE & Carrier
Legacy
Interconnect Ethernet
Interfaces
Broadcast & Advanced
On-Demand Videoscape
Video Delivery Features

Available 2H 2011 2012 2012+


BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 3
Cisco ASR 9000 Portfolio Evolution
Uncompromising Density Across a Scalable Portfolio

2012
2H
TODAY
2011
9000v
# of Slots # of Slots 22 Slot 10 Slot 10 slots6 slots 6 Pizza
slots Box
Satellite
Max. LinecardsMax.
per Linecards per 8 LC + 2 RSP
Chassis 20 LC 8 LC 4 LC 4 LC 2
+ IO
2 RSP
Slots Fixed Ports
Chassis
Max. Linecard Max. Linecard Bandwidth 120 Gbps
240 120Modular
240 Gbps + 44xGE +
360 Gbps 360 Gbps 360 Gbps
Bandwidth Max. Slot Bandwidth 180 Gbps
440 180 4x10GE
440 Gbps 4x10GE
Max. Slot Bandwidth 1.2 Tbps 440 Gbps 440 Gbps
Chassis Bandwidth 2.8 Tbs
7.0 1.4 Tbs
3.5
Chassis Bandwidth 48 Tbps 7.0 Tbps 3.5 Tbps 120 Gbs 80 Gbs

ASR 9000v

ASR 9922 ASR 9010 ASR 9006 ASR 9001

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 4
Hardware Architecture
Chassis, RSP, Switch Fabric and Linecards

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 5
ASR 9000 System Architecture
“At-a-Glance”
“8+1” CPU for control plane
Line Card
Fully Distributed
Architecture for High RSP
Performance and High Multi-
dimensional Control Plane
Scale CPU
CPU BITS/DTI
 Data forwarding is fully FIA
distributed on the line cards
FIC

 Control plane split among RSP


and LC CPU (same type of CPU as
RSP)
 L2 protocols, BFD, CFM, Netflow
runs on the LC CPU for high scale

IOS-XR: True Modular OS for HA


and Operational Simplicity
 Micro-kernel based, true modular OS Switch Fabric
 High availability and System stability
 SW patch granularity for operational simplicity Active-Active Intelligent Switch Fabric
Guarantee “0” packet loss during RSP failover
Advanced internal system QoS, Intelligent
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 6
multicast replication
ASR 9010 and ASR 9006 Chassis
Identical HW components across two chassis*
Front-to-
Integrated cable back airflow
management
with cover

System fan trays Side-to-back


airflow
RSP (0-1)
Line Card
(0-3) Line Card
(0-3, 4-7)

RSP (0-1)
System fan trays

Air draw

cable Six Modular


management Power Supplies
Three Modular
Power Supplies
* Fan tray is different
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 7
Power and Cooling
Existing Power Supply and Fan are ready for 400G/slot

Fans unique to chassis


Variable speed for
ambient temperature variation
Redundant fan-tray
ASR 9010 Fan Tray ASR 9006 Fan Tray  Low noise, NEBS and OSHA compliant

DC Supplies

A
B 2.1/1.5 kW 6 & 10 slot use same power supplies
A Single power zone
B 2.1 kW
All power supplies run in active mode
Power draw shared evenly
AC Supplies
Power Supply 50 Amp DC Input or 16 Amp AC
for Easy CO Install
A 3 kW
B 3 kW

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 8
RSP Engine
 Performs control plane and management functions
 Dual Core CPU processor with 4GB or 8GB DRAM
(4GB8GB is not field upgradable)
 2MB NVRAM, 4GB internal bootdisk, 2 external compact flash slots
 Dual Out-of-band 10/100/1000 management interface
 Console & auxiliary serial ports
 Hard Drive: 70G HDD

Status light
Console Port BITS ALARM
Compact Flash Status LED
Management AUX Port Slots
Ethernet
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 10
Ethernet Line Card Family
Shipping  Common HW ASIC and HW architecture
 Identical SW features
 Line card Memory options for QoS scale

A9K-40G A9K-4T A9K-8T/4 A9K-2T20G A9K-8T A9K-16T/8

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 11
Line Card Architecture – Hardware Components
CPU (same as RSP)
Program HW forwarding tables
NP: Network Processor Distributed Control planes
Main forwarding ASIC SW switched packets
L2 & L3 forwarding, Inline Netflow
features (QoS, ACL, etc), CPU
control plane policing, PHY NP0
mcast replication, etc
PHY NP1
10Gbps bi-directional with B0
features applied FIA0 FIA: Fabric Interface ASIC
PHY NP2 Provide non-blocking data
B1 connection to switch fabric
Internal system queues/VoQ
PHY NP3 Intelligent mcast replication

PHY NP4

10G PHY for one 10G


PHY NP5 B0
B: Bridge FPGA
port, or 10x1G port FIA1 Provide non-blocking data
PHY NP6 B1 connection between NP and FIA
Internal System queues
PHY NP7 Intelligent mcast replication

Example: A9K-8T Note, Bridge FPGA provide non-blocking


connection between NP and the FIA. Functionally it
does the HW conversion due to different interface
format on NP and FIA. It’s part of the switch fabric
connection. To make it logically simple, it will be
removed from the remaining slides.
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 12
Line Card Memory Options
Different Queue Scale for Different Deployments
High
 3 memory options for each line card: Extended (or high queue),
Base (medium queue), Low (low queue)* Medium

Different memory option has different QoS queue/policer scale, L2 Low


sub-interface scale and ACL scale
 All other system wide scale is the same across different type of
the line cards, including FIB, MAC address, Bridge-domain, L3
sub-interface, VRF, etc

 All line cards have the same HW  Identical features

 Mixed different type of line cards are supported on the same


chassis with same system wide scale and identical features
* A9K-16T/8 only have “B” option. It doesn’t have “E” or “L”
option as of the 4.1.0 release

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 13
L/B/E Line Cards – What’s the Difference?
Same lookup memory size across different type of line Different memory size for different QoS
cards  mix-and-match LCs, same system level scale queuing/policing, L2 EFP and ACL scale

STATS MEMORY
FIB MAC
LOOKUP FRAME MEMORY
Forwarding ASIC
MEMORY
-
TCAM
NP complex

 Each NPU has Four Main Associated memories: TCAM , Search/Lookup memory , Frame/buffer
memory and statistics memory
–TCAM is used for VLAN tag, QoS and ACL classification
–Lookup Memory is used for storing FIB tables, Mac address table and Adjacencies
–Stats memory is used for all interface statistics, forwarding statistics etc
–Frame memory is buffer memory for Queues
 E/B/L line card have different TCAM , Stats and Frame Memory size, which give different scale number
of the QoS queues and L2 sub-interfaces per line card
 Lookup Memory is the same across line cards  why?
–To support mix of the line cards without impacting the system wide scale including routing,
multicast, MAC address, L3 interface, MPLS label space scale

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 14
SIP/SPA – Non-Ethernet Support
SPA support list:
http://www.cisco.com/en/US/partner/prod/collateral/routers/ps9853/data_sheet_c78-573452.html

Strong QoS Scalability


• 128+K Queues, • Distributed control
• 128+K Policers and data plane; High Availability
• H-QoS 20G; 4 Bays
• IC-Stateful Switch
• Color Policing • L3 i/f, route, session, Over capability,
protocol – scaled up
for MSE needs • MR-APS
• IOS-XR base for
high scale and
reliability
Powerful and
Flexible QFP
Processor
• Flexible ucode Architecture
for Feature Richness SPA Support:
• L2 + L3 Services: FR, PPP, ‒ChOC-12: T1 / T3, MLPPP, LFI, IC-SSO, MR-APS
HDLC, MLPPP, LFI, L3VPN,
‒ChOC-3/STM1 + ChOC-12: DS0 / STM1 +
MPLS, Netflow, 6PE/VPE
ChOC-48: DS3 / E3 / STM4
A9K-SIP-700 ‒POS: OC3/STM1, OC-12/STM4, OC-
48/STM16, OC-192/STM64

SPA Roadmap (2011):


Ch T1/E1, Ch T3/E3, CEoPs, ATM
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 15
Switch Fabric Overview
 Active-active load balancing: Unicast: per-packet load balancing, Multicast: per (S,G) load balancing
 Arbiter for fabric access control. Arbiter is in active/standby mode, which is controlled by low level
hardware signalling
 Frame format over fabric: super-frame, it can aggregate multiple small packet into a big sup-frame to
improve the fabric throughput

Crossbar 23Gbps per fabric channel


Fabric
ASIC

Crossbar FIA0
Fabric
ASIC

Arbiter FIA1
FIA RSP0
Dual-FIA
8xNPs
Crossbar Linecard
Single-FIA Fabric
4xNPs ASIC
Linecard
Crossbar
Fabric
4x23Gbps =92Gbps with dual RSP ASIC 8x23Gbps =184Gbps with dual RSP
2x23Gbps=46Gbps with single RSP 4x23Gbps=92Gbps with single RSP
Arbiter

RSP1
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 16
System Internal Bandwidth A9K-8T/4
~60Gbps raw bandwidth
NO bottleneck inside the system A9K-16T/8-B
~120Gbps raw bandwidth
Use A9K-8T line card as example

PHY CPU Crossbar


NP0 Fabric
ASIC
PHY
NP1 Crossbar
B0 Fabric
PHY FIA0 ASIC
NP2
B1
PHY Arbiter
NP3
RSP0
PHY
NP4 Crossbar
Fabric
PHY ASIC
NP5 B0
PHY
FIA1 Crossbar
NP6 B1 Fabric
ASIC
PHY NP7 Arbiter
RSP1

30Gbps and 25M pps 15Gbps bi- 30Gbps bi-


(combined ingress and egress) directional directional Each FIA has one fabric channel
60Gbps bi- which is 23 Gbps bi-directional, to
30Gbps bi-
directional each of the switch fabric ASIC
directional
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 17
4xNPs Line Card Family

A9K-4T-E/B/L A9K-2T20G-E/B/L

PHY 3 NP0 PHY NP0

PHY 2 NP1 PHY NP1


FIA FIA
PHY 1 NP2 NP2

PHY 0 NP3 NP3

A9K-8T/4-E/B/L A9K-40G-E/B/L
PHY 3
PHY 7
NP0 NP0
PHY 2
PHY 6
NP1 NP1
FIA FIA
PHY 1
PHY 5
NP2 NP2
PHY 0
PHY 4 NP3 NP3

Oversubscribed line card Up to


60Gbps (~57Gbps) bandwidth
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 18
8xNPs Line Card Family

A9K-8T-E/B/L A9K-16T/8-B
PHY
PHY NP0 PHY NP0
PHY
PHY NP1 PHY NP1
FIA0 PHY
FIA0
PHY NP2 PHY NP2
PHY
PHY NP3 PHY NP3
PHY
PHY NP4 PHY NP4
PHY
PHY NP5 PHY NP5
FIA1 PHY
FIA1
PHY NP6 PHY NP6
PHY
PHY NP7 PHY NP7

Oversubscribed line card


Up to 120Gbps (~117Gbps)
bandwidth

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 19
Packet Forwarding Architecture
Distributed Forwarding, Multicast Forwarding, EVC Architecture

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 20
IOS-XR Two-Stage Packet Forwarding
Fully Distributed Forwarding on Line Cards
 Each line card has independent AIB only
for local interfaces
Packet is forwarded to the egress NP  Each line card has independent Interface
based on the information in the DB for local interfaces
NP/fabric header
 Both Ingress and Egress FIB – allows
forwarding features to be independently
applied on LCs

CPU CPU
PHY NP0 NP0 PHY
2
PHY NP1 NP1 PHY
FIA FIA
PHY NP2 NP2 PHY
Switch
Fabric
PHY NP3 Ingress LC Egress LC NP3 PHY
1

Ingress NP look up  Egress NP look up 


Get egress NP information Get egress logical port, VLAN,
(added into the NP/fabric MAC, ADJ information, etc for
header), apply ingress features packet rewrite, apply egress
features
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 21
Multicast Packet Forwarding Efficiency
Line rate
Intelligent Multicast Replication Scalable
Simple

1 Fabric Replication  2 FIA Replication  replicate 3 NP Replication  replicate


replicate single copy to single copy to each NP which single copy per each
each LC which has IGMP has IGMP join, based on MGID receiver based on multicast
join, based on FGID table table in FIA FIB table
in switch fabric
MFIB
IGMP joins
CPU 3
NP0 PHY
MGID NP1 PHY
CPU FIA 2
IGMP joins
PHY NP0 NP2 PHY
FGID
PHY NP1 NP3 PHY
1 LC2
FIA
PHY NP2
Switch
Multicast Fabric CPU
Source PHY NP3 LC1 NP0 PHY

NP1 PHY
FIA
FGID – Fabric Group ID NP2 PHY
MGID – Multicast Group ID
MFIB – Multicast Forwarding Information Base NP3 PHY
LC3
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 22
Intelligent Multicast Replication
Switch Fabric and Egress LC Replication
2 FIA Replication  replicate
single copy to NPs which
1 Fabric Replication  receive IGMP join, based on NP Replication  replicate
4
replicate single copy to MGID table in FIA copy per receiver based on
LCs which receive IGMP multicast FIB table
3 Bridge Replication  similar
join, based on FGID table as FIA replication, single copy
in switch fabric to NP MFIB
1 0000000000 CPU
IGMP joins
4
2 0000000001 NP0 PHY
FGID=3 MGID
MGID
3 0000000011
hit 3 NP1
2 B0 PHY
CPU …
IGMP joins FIA
PHY NP0 N 1111001111 B1 NP2 PHY
1 00 Replicate to the first
3 FGID
PHY NP1 FPOE
B0
Table2 MGID 2 hit 01 NP3
Bridge only PHY
1 LC2
IGMP joins FIA 3 10
PHY 1Kx10
NP2 bitmap representing
B1 Switch …
Multicast all combination of the Fabric CPU
Source PHY NP3 linecards
egress N 10 NP0 PHY
MGID Table in FIA NP1
B0 PHY
FIA represent one
Each entry
FGID – Fabric Group ID NP2
mroute, 2 bits indicating
B1 the PHY
MGID – Multicast Group ID down stream ASICs
MFIB – Multicast Forwarding Information Base NP3 PHY
LC3
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 23
ASR 9000 EVC Infrastructure

VLAN tag local L3 SubI/F


significant Routing

EoMPLS PW
(H-)VPLS
Bridging
EoMPLS PW
Flexible VLAN
tag classification IRB
Flexible VLAN
tag rewrite X EoMPLS PW

Flexible IRB
Bridging
Ethertype (.1Q, X
QinQ, .1ad) Routing and Bridging

L2 or L3 sub-interfaces
(802.1q/qinq/.1ad) Flexible service mapping and multiplexing. Support all standard based
services concurrently on the same port:
2 Regular L3, L2 interface/sub-interface
Integrated L2 and L3 – IRB/BVI
Mixed L2 and L3 sub-interfaces on the same port
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 24
Flexible VLAN Tag Classification
RP/0/RSP0/CPU0:PE2-asr(config)#int gig 0/0/0/4.100 l2transport Double tag
RP/0/RSP0/CPU0:PE2-asr(config-subif)#encapsulation ? Single tag
default Packets unmatched by other service instances Multiple tag
dot1ad IEEE 802.1ad VLAN-tagged packets
Range of tag
dot1q IEEE 802.1Q VLAN-tagged packets
.1q and/or .1ad
untagged Packets with no explicit VLAN tag
Loose or exact match

RP/0/RSP0/CPU0:PE2-asr(config-subif)#encapsulation dot1q 100-200,205 ? Untagged

comma comma Default tag


exact Do not allow further inner tags

RP/0/RSP0/CPU0:PE2-asr(config-subif)#encapsulation dot1q 100 second-dot1q 10-20,35 ?


comma comma
exact Do not allow further inner tags

RP/0/RSP0/CPU0:PE2-asr(config-subif)#encapsulation dot1ad 20 dot1q 10-20 ?


comma comma
exact Do not allow further inner tags

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 25
Flexible VLAN Tag Rewrite
RP/0/RSP0/CPU0:PE2-asr(config)#int gig 0/0/0/4.100 l2transport
Pop tag 1 or 2
RP/0/RSP0/CPU0:PE2-asr(config-subif)#rewrite ingress tag ? Push tag 1 or 2
pop Remove one or more tags
push Push one or more tags Tag translation
translate Replace tags with other tags 1-1

RP/0/RSP0/CPU0:PE2-asr(config-subif)#rewrite ingress tag pop ? 1-2


1 Remove outer tag only 2-1
2 Remove two outermost tags
2-2
RP/0/RSP0/CPU0:PE2-asr(config-subif)#rewrite ingress tag push ?
dot1ad Push a Dot1ad tag
dot1q Push a Dot1Q tag

RP/0/RSP0/CPU0:PE2-asr(config-subif)#rewrite ingress tag push dot1q 100 ?


second-dot1q Push another Dot1Q tag
symmetric All rewrites must be symmetric

RP/0/RSP0/CPU0:PE2-asr(config-subif)#rewrite ingress tag translate ?


1-to-1 Replace the outermost tag with another tag
1-to-2 Replace the outermost tag with two tags
2-to-1 Replace the outermost two tags with one tag
2-to-2 Replace the outermost two tags with two other tags

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 26
L2VPN P2P

EFP configuration example


L2VPN P2P service configuration example
Interface gig 0/0/0/1.101 l2transport
encapsulation dot1q 101 second 10 l2vpn
rewrite ingress pop 2 Symmetric xconnect group cisco
p2p service1  local connect
Interface gig 0/0/0/2.101 l2transport interface gig 0/0/0/1.101
encapsulation dot1q 101 interface gig 0/0/0/2.101
rewrite ingress pop 1 Symmetric p2p service2  VPWS
interface gig 0/0/0/3.101
Interface gig 0/0/0/3.101 l2transport neighbor 1.1.1.1 pw-id 22
encapsulation dot1q 102-105 p2p service3  PW stitching
rewrite ingress push dot1q 100 Symmetric neighbor 2.2.2.2 pw-id 100
neighbor 3.3.3.3 pw-id 101

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 27
L2VPN Multi-Point

L2VPN MP service configuration example

EFP configuration example l2vpn


bridge group cisco
Interface gig 0/0/0/1.101 l2transport bridge-domain domain1  local bridging
encapsulation dot1q 101 Interface gig 0/0/0/1.101
rewrite ingress pop 1 Symmetric split-horizon group  no bridging among same SHG
Interface gig 0/0/0/2.101
Interface gig 0/0/0/2.101 l2transport split-horizon group
encapsulation dot1q 101
rewrite ingress pop 1 Symmetric bridge-domain domain2  VPLS
Interface gig 0/0/0/1.101
Interface gig 0/0/0/3.101 l2transport Interface gig 0/0/0/2.101
encapsulation dot1q 102 vfi cisco
rewrite ingress push dot1q 100 Symmetric neighbor 192.0.0.1 pw-id 100
neighbor 192.0.0.2 pw-id 100

bridge-domain domain3  H-VPLS


Interface gig 0/0/0/1.101
neighbor 192.0.0.3 pw-id 100  spoke PW
vfi cisco  for core PWs
neighbor 192.0.0.1 pw-id 100  core PW
neighbor 192.0.0.2 pw-id 100

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 28
Mixed L2 and L3 on the Same Port

L2 trunk port, use SVI for L3


L2 trunk with
SVI for L3 interface gig 1/2
switchport
switchport mode trunk
SVI SVI switchport trunk allow vlan 50-1000

Interface vlan 50
ip address 1.1.1.1 255.255.255.0
7600/6500

Native L2 + L3 port
Native L2 and L3 sub-interface on the
same port

interface gig 0/0/0/1.50


encapsulation dot1q 50
ip address 1.1.1.1 255.255.255.0
ASR 9000
Interface gig 0/0/0/0/1.51 l2transport
encapsulation dot1q 51
Native L2 and L3 sub-interface support on the rewrite ingress tag pop 1 Symmetric

same physical port l2vpn  define L2 service


No such limitations of the L3 features on the SVI bridge group test
<snip>

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 31
ASR 9000 L3 “At-a-Glance”
Extend IOS-XR L3/MPLS to the ASR9000

IOS-XR routing and


MPLS  Widely
deployed, proven
stability and feature rich

Distributed inline Netflow  Built-in HA 


1M entries/LC , 100Kpps NSF/GR & NSR
/LC, flexible sampling and & SSO
IPv4/IPv6/MPLS feature
support Mature IOS-XR
L3 Routing &
MPLS SW
Infrastructure
Distributed control plan 
High Multi-dimensional control
plane scale, for example 5000
IPv6 ready  BGPs + 10,000 BFDs + etc
Dual stack, 6PE/6VPE,
high scale, line-rate IPv6 Hierarchical FIB
forwarding performance structure and Fast FIB
programming 
Prefix independent fast
network convergence

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 33
L3 Control Plane Overview

BGP OSPF
LDP RSVP-TE
Static
ISIS EIGRP

LSD RIB RP

ARP
FIB Adjacency
SW FIB
AIB LC NPU

AIB: Adjacency Information Base


RIB: Routing Information Base
LC CPU FIB: Forwarding Information Base
LSD: Label Switch Database
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 34
L3 Forwarding – Hierarchical Data Structure
FIB and ADJ Tables Overview

0 1 2 3 . . . … n
BGP PIC
VRF table
TE-FRR PIC
Link bundle PIC

PIC: Prefix independent convergence


Search Tree LAG: Link aggregation group
LDI: Load information

OutI/F
adj
LAG OutI/F
Recursive
Leaf Table NR Prefix adj
Prefix Leaf
Leaf Table
(FIB table) Table
Protected
LAG OutI/F
TE adj

NR LDI 0
Recursive
LDI/ADJ table LDI NR LDI 1
… Backup
OutI/F
NR LDI N TE adj

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 35
Cisco ASR 9000 L2 Behavior
It does FULL L2, but not a classic switch
ASR 9000 support full L2 service (multi-point, point-to-point, E-Tree
native L2 or L2 over MPLS). It’s fully MEF certified.
However, the behavior and configuration is quite different than
traditional L2 switch
 By default, it’s Router, it doesn’t do any bridging function unless
you configure it specifically
 There is no “switch-port” concept. All L2 features are done with
“EVC” SW infrastructure
 There is no global VLAN concept. All VLAN is local port
significant. By default VLAN 10 on port A doesn’t talk to VLAN 10
on port B. It require “bridge-domain” configuration to bridge
port/VLAN together
 By default, STP is not enabled on any L2 port unless you
“explicitly” configure it under STP process

NO global VLAN (no 4K limit)


Per-VLAN features, more flexible, more secure, more scale
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 36
ASR 9000 L2 “At-a-Glance”
Built on New Cisco EVC SW Foundation

Flexible Cisco “EVC” Carrier


Ethernet SW infrastructure 
VLAN tag matching,
manipulation, service
mapping
Distributed control plan
 High Multi-
dimensional L2 service
scale, VLAN, PW,
Bridge-domain, VPLS,
Standard compliant, Cisco “EVC” MAC address scale, etc
MEF certified, Carrier Ethernet
802.1q/qinq/.1ad/.1ah
EoMPLS, H-VPLS/VPLS Foundation
supported, L2 feature rich
E-OAM: CFM, Y.1731, Link
OAM

Distributed HW based
MAC learning,
aging/flushing, 4-5Mpps
Rich L2 fast
convergence
features

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 37
ASR 9000 MAC Learning Overview
 Distributed HW based MAC Learning
–MAC learning /aging/flushing is fully distributed to the NP, independently
–Each NP can learn around 4-5 Millions MAC addresses per second in hardware
 Data-plane MAC table synchronization
–MAC address are synchronized across all NPs in the entire system, regardless
of the bridge-domain or bridge port configuration.
–MAC address synchronization is achieved by special MAC notification
messages which is implemented in the data-plane microcode

CPU CPU
PHY NP0 NP0 PHY
PHY NP1 NP1 PHY
FIA FIA
PHY NP2 NP2 PHY
Switch
Fabric
PHY NP3 NP3 PHY

MAC learning/aging/flushing is done by hardware


and fully distributed on each NP independently
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 38
ASR 9000 Scalable System Architecture

 Control plane split among RSP and LC “8+1” CPU for Ultra-High multi-
CPU (same type of CPU as RSP) dimensional control plane scale
 L2 protocols, BFD, CFM, Netflow runs
on the LC CPU for high scale
Scale examples
Line Card Multi-dimensional scale
FIB 1.3M (v6 use two entries)
RSP MAC address 512K
L2 interfaces 64K
Pseudowires 64K
CPU
CPU BITS/DTI
Bridge-domain/VFI 8K

FIA
EFPs per BD 16K

FIC L3 interfaces, VRF 8K

CFM MEP/MIP 32K/LC

Netflow 1M entries/LC, 100K pps/LC

BFD 1250/LC (with 150msec


hello timer), minimal hello
timer is 15msec

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 39
HA and Fast Convergence Business L3 VPN
Business L2 VPN (E-
Residential
Data/Voice
Line/E-LAN/E-Tree) Residential
Mobile backhaul IPTV/VoD
IP/MPLS
Service layer resiliency,
2G/3G RBS
Access
orL2/L3
link)Access
service termination point (node fail., service is down
(pre)aggregation
and needCelltoSitere-route
Gateway L2/L3 Link Bundle
 L2: PW redundancy, L3: BGP PIC, Multicast: MoFRR
Residential

 Access dualEthernethome: Node REP-AG/MST-AG, Rapid-PVST/PVST-AG, MC-LAG, G.8032,

Flexible Link (not supported), HSRP/VRRP


STB IP/Service Edge
 State sync between primary and backup service node: ANCP, IGMP snooping,
Business Ethernet Node
DHCP/ARP/IGMP (in future), etc
Corporate IP/MPLS
Distribution
Node
L2 and L3 transport layer resiliency, transit link or transit node fail, L2 or L3 transport
Residential

protocol re-converge. Service layer is not aware


 L2: MST, G.8032,
DSL Node REP(not supported), PVST(not supported)
STB

 L3: IGP/BGP, TE/FRR(link, node,


Business
path protection), IP/FRR (ISIS per-link and per-prefix
Pre-Aggregation/
aggregation node
, OSPF per-link, OSPF per-prefix IP/FRR
Corporate

 Multicast: PIM, P2MP-TE/FRR


Residential PON Node

Link layer resiliency: transport and service layer is not aware, for link protection only
Link Bundle (active-active, 1:1 backup, m:n backup)
STB

Resiliency infrastructure: distributed BFD, distributed EFD, HW based LoS detection,


Business

IPoDWDM FEC/EFC & proactive protection, Hierarchical Forwarding table structure and
Corporate

in-place modification, Fast programming FIB table


System HA: IOS-XR Modular OS, Micro-kernel, RSP failover, SMU, ISSU(4.2.1), Process
restart. All protocols are SSO, all protocol support NSF/GR, OSPF/ISIS/LDP/BGP support
NSR. PIM support NSF
BRKSPM-2604_c1 and
© 2010 Cisco and/oris NSRAll rights
its affiliates. compliant
reserved. Cisco Confidential 40
Feature Architecture
Quality of Service, MoFRR, Vidmon, New Features

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 41
Switch Fabric Bandwidth Access Overview
Intelligent Fabric and Internal System QoS
 3 strict priority scheduling/queueing
 Back pressure and virtual output queue
 Multicast and Unicast separation
(separated queues and fabric plane)
RSP0
Crossbar
Fabric 5: credit return
ASIC
1: Fabric Request
Crossbar
Ingress LC Fabric Egress LC
ASIC

Arbiter
FIA FIA
2: Arbitration

Crossbar
Fabric
ASIC
3: Fabric Grant
Crossbar
4: load-balanced Fabric
ASIC
transmission
across fabric links Arbiter

RSP1

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 42
End-to-End System QoS Queuing
End-to-End priority (P1,P2, Best-effort) propagation 
Guarantee bandwidth, low latency for high priority traffic
at any congestion point
3 strict priority level across all internal HW components

Ingress side of LC Egress side of LC

CPU CPU 4
PHY NP0 NP0 PHY
3
PHY NP1 2 NP1 PHY
FIA FIA
PHY NP2 NP2 PHY
Switch
1 Fabric
PHY NP3 NP3 PHY
3
2
1 Virtual Egress FIA 4
Ingress (sub-)interface Output Queues Egress (sub-)interface
QoS Queues Queues QoS Queues
Implicit Configuration
Configure with Two strict high priority + Configure with
Ingress MQC Normal priority Egress MQC
4-layer hierarchy 4-layer hierarchy
Two strict high priority + Two strict high priority +
Normal priority Normal priority

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 43
Backpressure and VoQ Mechanism
VoQ Scale: Each Egress NP congestion   backpressure to ingress FIA 
FIA has P1/P2/BE Packet is en-queued in the dedicated VoQ 
queue set for every
NP and RSPs in the No impact of the packet going to different egress NP 
entire system
No head-of-line-block issue

Backpressure: egress NP  egress FIA


 fabric Arbiter  ingress FIA  VoQ

Ingress side of LC1 Egress side of LC2

CPU 1
10Gbps CPU
PHY NP0 NP0 PHY 2
5Gbps
PHY NP1 NP1 PHY
5Gbps
FIA FIA
PHY NP2 NP2 PHY 3
Switch
Fabric
PHY NP3 NP3 PHY

Packet going to different egress NP put into different VoQ set 


Congestion on one NP won’t block the packet going to different NP
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 44
Port QoS Overview
User configure port level QoS via MQC
CPU Q NP0
CLIs PHY
QoS function is done by special Queuing
HW chip within the NP complex Q NP1 PHY
Different memory options have different FIA
Q NP2 PHY
scale
Q NP3 PHY

 High scale
–Up to 3 Million queues per system (with E linecard)
–Up to 2 Million policers per system (with E linecard)
 Highly flexible: 4 layer hierarchy queuing/scheduling support
–Four layer scheduling hierarchy Port, Subscriber Group,
Subscriber, Class
–Egress & Ingress, shaping and policing
 Three strict priority scheduling with priority propagation
 Flexible & granular classification, and marking
–Full Layer 2, Full Layer 3/4 IPv4, IPv6
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 45
QOS Configuration Basics

 IOS XR MQC CLI


 Attachment Points
‒Main/physical Interface: MQC applied to a physical port will take effect for
traffic that flows across all sub-interfaces on that physical port
‒L3 sub-interface
‒L2 sub-interface (EFP)
‒You can have either port-based or sub-interface based policy
on a given physical port, but not both at same time

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 46
QoS Classification Criteria
 Very flexible L2/L3 field classification on L2 interfaces
Inner/outer cos
Inner/Outer vlan
DEI
Outer EXP
DSCP/TOS
TTL, TCP flags, source/destination L4 ports
Protocol
Source/Destination IPv4
Source/Destination MAC address
Discard-class
Qos-group
match all/match any

 Max. 8 match statements per class


Note: a given match statement can have multiple entries (i.e COS 1,2,3)

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 47
Marking Details
Sample configuration for the marking

class CLASS-UNTAGGED-PD
 “settable” packet fields: set cos 2
set dscp 21
DSCP/Precedence
police rate 10240000 bps burst 320000 bytes peak-rate 20480000
EXP imposition bps peak-burst
conform-action set cos 2
EXP topmost conform-action set prec 2
exceed-action set cos 1
COS inner/outer exceed-action set dscp 8
qos-group violate-action set cos 0
violate-action dscp 0
discard-class

 ASR9K supports maximum of 2 fields per class-map. The


same 2 fields can be placed in any combination below
- 2 sets per police-conform/exceed/violate
- 2 sets without policing

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 48
Policing Details
 RFC 2698 supported (2r3c) and  64k policers per NPU (shared
1r2c for ingress/egress) on extended
color blind mode linecards
 Ingress & egress policing  Policer actions supported:
supported ‒transmit
 General Rule: Policing required ‒drop
on priority queues. ‒set (implicitly behaves like
Priority level 2 classes can also set and transmit)
accept shaping instead of policing.
‒each color can have two set
 Granularity of 64Kbps actions:
supported.
 2-level nested policy maps
Policy-map parent
supported Class class-default
Note: policers at parent and child Police rate 10 Mbps peak-rate 20 mbps
work independently conform-action set dscp af12
conform-action set cos 2
exceed-action set dscp af13
exceed-action set cos 3
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 49
4 Layer Hierarchy QoS Queuing Overview

L1 L2 L3 L4
Port Subscriber Subscriber Class
Level group Level Level Level

L1 level is implicitly assumed

Hierarchy levels used are


determined by how many
S-VLAN EFP

Class
C-VLAN
Class Class
nested levels a policy-map is
Class configured for and applied to a
C-VLAN
Class Class given sub-interface
Port

Max 8 classes per subscriber


S-VLAN EFP

Class
C-VLAN
Class Class level
Class
C-VLAN
Class Class

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 50
Shared Policy Instances (SPI)
subI/F
Policy-map X subI/F 100Mbps VLAN Single
VLAN Shared
shaping 100Mb 101 queue,
101 Policy Combined
Applied to both sub-interfaces subI/F 100Mbps
subI/F Instance
Creating two queues, each 100Mbps VLAN
VLAN
queue is shaped to 100Mbps 102
102
Without SPI With SPI

 Enable distinct forwarding entities on the same port to use the exact same
policy instance in order to share a common SLA enforcement
 Support 3 and 4 layer hierarchies
 Lightweight implementation with extension to existing MQC
 Require a new key-word to the service-policy comand:
service-policy output/input <name> shared-policy-
instance <name>
 Require that both EFPs/SubI/Fs have to reside on the same port
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 51
3-Layer H-QoS – CLI Examples (1)
Example 1 – policy-map on subinterface

L1 L2 L3 L4
Port Default L2, Parent Policy on Child policy (child of policy-map parent (configures L3 layer)
L2 (EFP) or L3
scheduler not Parent) with user- class-default
subint. class-
not configurable defined classes &
configurable
default or physical
class-default
shape average x
port /w user-
(XR 4.0.1) defined classes …
service-policy child

policy-map child (configures L4 layer)


class-1
priority level x
class-2
bandwidth remaining percent x

int GigE 0/1/2/3.10 l2transport


[L3] [L4]
encapsulation dot1q 10
Shape PQ
service-policy output parent
CBWFQ
int GigE 0/1/2/3.20
Ipv4 address … Class
•N/A •N/A •Shape •Priority Level 1
•Priority Level 2
C-VLAN
•bandwidth, encapsulation dot1q 20 L3 Sub-int Class
•bandwidth •Shape,
•bandwidth or service-policy output parent
remaining
bandwidth remaining
ratio •(W)RED Class
•Police
C-VLAN
•Set (marking) L2 Sub-int Class

Note: Example applies to L3 and L2 VLAN subinterfaces


BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 52
3-Layer H-QoS – CLI Examples (2)
Example 2 – policy-map on physical interface

L1 L2 L3 L4
Port Default L2, Parent Policy on Child policy (child of
scheduler not L2 (EFP) or L3 Parent) with user- policy-map parent (configures L3 layer)
subint. class-
not configurable defined classes & class VLAN10 (class-map match on dot1q tag 10)
default or physical
configurable port /w user- class-default
shape average x
(XR 4.0.1) defined classes

service-policy child

class VLAN20 (class-map match on dot1q tag 20)


shape average x

service-policy child

policy-map child (configures L4 layer)


class-1
priority level x [L3] [L4]
class-2 Shape PQ
bandwidth remaining percent x CBWFQ

int GigE 0/1/2/3 Class


•N/A •N/A •Shape •Priority Level 1
•Priority Level 2
C-VLAN
•bandwidth, service-policy output parent L2 Sub-int Class
•bandwidth •Shape,
•bandwidth or
remaining
bandwidth remaining int GigE 0/1/2/3.10 l2transport
ratio •(W)RED Class
•Police encapsulation dot1q 10 C-VLAN
•Set (marking) L2 Sub-int Class

int GigE 0/1/2/3.20 l2transport


Note: Example applies to L2 VLAN subinterfaces only, since
encapsulation dot1q 20
match VLAN is not supported for L3 interfaces

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 53
“Video Aware” Edge Router
High Bandwidth Scale + High Quality

Transparent Caching

VOD, Internet Caching & Flexible Ensured Transparent


Streaming Multiple Experience Caching
applications – Integration of
scalable and Error repair at ASR 9000Cache
Internet CDS-TV
Feature
adaptable edge Capabilities
Inline Video Monitoring architecture Applications Ultra-Dense VoD, TV,
Internet Streaming, Error
TV Cache
Repair, NPS*, CGN*, SBC*
Bandwidth 30-40 Gbps streaming capacity
High Density for VoD ~3 Gbps cache fill rate
Bandwidth Requirements Video Probe
Compatibility Works with all CDS appliances
Concurrent Up to 10,000 SD equivalent
Streams
Best-in-Class Multicast Content 3.2 TBytes at FCS - Modular
Personalized Content Cache Design
Replication and scale
Experience Choices Environmental NEBS / ETSI compliant
Virtual personal VoD, Online,
Best-in-Class High quality: channels User generated
System QoS, HA, Fast Personalized ads content
convergence (MoFRR)
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 54
Multicast Network HA
Truly Resilient Multicast by ASR 9000 MoFRR
Multicast Only Fast Re-Route
Source
 ASR 9000 MoFRR Overview
–Tail end (Receiver) PE send PIM join on both of its
redundant uplinks to receive identical streams over
disjointed network paths: primary and backup
– HW monitor the video flows on the primary path

Protection Domain
– Automatic Switch over to back up path based on
configurable criteria (hard coded 30msec in phase 1)
 Key Differentiators
Naturally
– Only need to be enabled on the last hop Router for disjoint
operational simplicity
– Fast Convergence: <50msec (1000 channels tested) RU1 RU2
convergence time for source-to-receiver path (link and
node) protection
– Native IP multicast solution without the complexity of
MPLS P2MP TE/FRR (but can be integrated with TE) R1
– Pro-active protection by using Vidmon metric as trigger
–Towards lossless Video transport solution
MoFRR Router
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 55
MoFRR – A Simple CLI Example
Configuration on receiver PE RP/0/RSP0/CPU0:receiver#show mrib route 232.1.1.1 1.3.13.100 detail
<snip>
ipv4 access-list mofrr-acl-group1
(1.3.13.100,232.1.1.1) Ver: 0x383a RPF nbr: 10.0.102.2 Flags: MoFE MoFS, FMA: 0x50130f98
20 permit ipv4 any 231.1.0.0 0.0.255.255 Up: 04:55:57
30 permit ipv4 any 232.1.0.0 0.0.255.255 MOFRR State: Inactive Sequence No 1
Incoming Interface List
router pim TenGigE0/0/0/0.1 Flags: A2, Up: 00:03:11  MoFRR backup interface
TenGigE0/0/0/1.1 Flags: A, Up: 04:00:09  MoFRR primary interface
address-family ipv4
Outgoing Interface List
mofrr mofrr-acl-group1 TenGigE0/0/0/7.13 Flags: F NS LI, Up: 04:55:57

#show mfib hardware route mofrr location <loc>


End-to-End path
50 msec protection
MoFRR primary path

receiver
source

Receiver PE Source PE
MoFRR ONLY need to be enabled
on last-hop Router, but can detect MoFRR backup path
any failure points along the
forwarding path

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 56
What’s “Inline” Video Monitoring?
Monitor the Video flow quality on the transport port. It’s just another feature like
QoS/ACL which you apply to the normal interface

ACL
ipv4 access-list my_acl:
10 permit udp any eq 4000 any eq 4000
!
class-map type traffic match-any my_class
match access-group ipv4 my_acl
end-class-map
!
policy-map type performance-traffic my_policy Class-map
class type traffic my_class
monitor parameters
interval duration 10
history 10
timeout 2
!
monitor metric ip-cbr
rate layer3 packet 100 pps
!
Policy-map
react 1 packet-rate
threshold type immediate As simple as this!
threshold value gt 200.0
action syslog
Now it’s working binding
alarm severity warning
alarm type discrete
!
end-policy-map
!
Interface
interface GigabitEthernet0/0/0/8
ipv4 address 10.1.1.1 255.255.255.0
service-policy type performance-traffic input my_policy
!

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 57
Video Trap and Clone CAPEX: No need for DPI
For Deep Analysis probe deployment all
over network
OPEX: Leverage the shared,
“expert” analysis
equipment in the NOC

Video Ops

Regional Backbone
Regional Network
Headend
Video Flow ASR9000 CRS-1
trapped and
cloned

ASR9000
Hub
ASR9000

CRS-1

 In-line monitoring Trap or Customer calls in and opens trouble ticket


 Service personnel trap the Video flow and clone it
 Video Flow transported to Video Operations Site for detailed codec level
Analysis / Troubleshooting
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 59
SW/HW Architecture Overview
Features on RP CPU:
Where to Implement the Features Routing, MPLS, Multicast
control plane, HSRP,
Features on LC CPU: VRRP, link bundle, etc
BFD, OAM, STP,
Netflow, ARP, ICMP, etc
Egress Features on FIA:
Ingress Features on System QoS queuing,
FIA: System QoS - VoQ Multicast replication

CPU CPU CPU


PHY NP0 NP0 PHY
2
PHY NP1 NP1 PHY
FIA FIA
PHY NP2 NP2 PHY
Switch
Fabric
PHY NP3 Ingress LC Egress LC NP3 PHY
1

Ingress NP look up  Switch Fabric: Egress NP look up 


Get egress NP information for Multicast replication Get egress logical port, VLAN,
packet forwarding QoS scheduling and MAC, ADJ information, etc for
Fabric access packet rewrite
Apply ingress port features: ACL, Arbitration
QoS, uRPF, SPAN, Vidmon, etc Apply egress port features: ACL,
QoS, Multicast replication, etc

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 60
Cisco ASR 9000 Summary

Most Scalable,
Best in Class L2
Lowest-Power
+ L3, Carrier
Carrier Ethernet
Ethernet, &
System in the
MSE Services
Industry

Optimized for
Nonstop
Video Services
Availability with
over Converged
IOS-XR Modular
Wireline +
OS
Wireless NGNs

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 61
Complete Your Session Evaluation

 Please give us your feedback!!


Complete the evaluation form you were
given when you entered the room
 This is session 5.2

Don’t forget to complete the overall


event evaluation form included in
your registration kit

YOUR FEEDBACK IS VERY


IMPORTANT FOR US!!! THANKS

BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 62
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 63

Das könnte Ihnen auch gefallen