Beruflich Dokumente
Kultur Dokumente
ASR9K Chassis
Architecture
RSP
Fabric
ASR9K Overview
Linecard
Life of a Packet
Power Management
Cisco Confidential
Cisco Confidential
ASR 9000
The (R)evolution Begins!
Minimize Operational
Expense
Simplicity
Power Reduction
Industry Leading Watts/Gbps
Pay as You Grow Power
Minimal Carbon Footprint
Carrier Class
Resilient
Purpose
Built
Green
Video
Optimized
* Please refer to Road Map
for time line of feature
support
Integrated Video
Cisco Confidential
IOS-XR Modular OS
Absolute HW Redundancy
Broad Network Resiliency
Schemes
Built to Last
6.4Tbps Capable System
Engineered for Nx100G
Superior H-QoS/Scale
Simplicity
Cisco Confidential
Resilient
Routing
Composite
MPLS
Multicast
RIP
BGP
OSPF
ISIS
Applications Architecture
IS-IS
Distributed Middleware
QoS
Manageability
Host
Composite
Security
Forwarding
Base
Multicast
BGP
MAC
OAM
MAC
OAM
MAC
Admin
VLAN Subs
Line Card
LC1
VLAN Subs
LC2
VLAN Subs
LCn
Cisco Confidential
Purpose
Built
Now
200G
Card
Mobility
Business Internet
Business IP WAN
Consumer Internet
Consumer IPTV/CATV
25,000
Dual Fia
10 slots
6 slots
22 Slots
8 LC + 2 RSP
4 LC + 2 RSP
20 LC + 2 RSP
Linecard Density
200
80
Gbps
40 Gbps
200
80
Gbps
40 Gbps
80 Gbps
400 Gbps
400 Gbps
Gbps
180
400
180 Gbps
550 Gbps
6.4
2.8 Terabits
3.2
1.4 Terabits
20 Terabits
Cisco Confidential
Viking History
Viking was initially conceptualized as an L2 aggregation switch
with the Gladiator chassis (with Gracchus and Marcus line cards)
in the Metro Ethernet Market with Goryeo taking the routing role
fitting into the SP edge.
When Goryeo was found to be no longer an advantageous
investment, Viking adapted to SP edge market.
This posed changes both in the chassis requirement when Red
October (with Ryan, Ramius and Mancuso line cards) was
conceptualized and also in the multitude of feature and scale
requirements.
Cisco Confidential
ASR9K Overview
ASR9K Chassis
Architecture
RSP
Fabric
ASR9K Chassis
Linecard
Life of a Packet
Power Management
Cisco Confidential
Chassis Overview
ASR-9000 10-slot system
10 slots: 8x linecards + 2x RSP
Half-rack: 17.38w x 36.75h x 28d
Bandwidth (initial)
400Gbps backplane
180Gbps fabric 400G
40G/80G linecards N-100G
Cisco Confidential
10
Cisco Confidential
11
LC
Feed A
Feed A
Feed B
Feed A
Feed B
Feed A
Feed B
Feed A
Feed B
Feed A
Feed B
PS 0
PS 1
PS 2
PS 3
PS 4
PS 5
Feed B
LC
LC
RSP
RSP
LC
LC
Fans
Fans
Shelf 1 (bottom)
Viking Hardware Overview
Cisco Confidential
12
LC
Feed A
Feed A
Feed B
Feed B
Feed B
PS 1
PS 2
PS 3
PS 4
PS 5
Feed A
PS 0
LC
LC
RSP
RSP
LC
LC
Fans
Fans
Shelf 1 (bottom)
Viking Hardware Overview
Cisco Confidential
13
Feed A
Feed B
AC PS
3kW
AC PS
3kW
AC PS
3kW
Shelf 1 (bottom)
S
Y
S
T
E
M
L
O
A
D
Feed A & B
DC PS
2kW
Feed A & B
DC PS
2kW
Feed A & B
DC PS
2kW
Feed A & B
DC PS
2kW
Shelf 1 (bottom)
Feed B
AC PS
3kW
Feed A
Shelf 0 (Top)
S
Y
S
T
E
M
L
O
A
D
14
Front-to-back airflow
750W cooling per LC slot
FCS cards significantly less
Cisco Confidential
15
Chassis Overview
ASR-9000 6-slot system
6 slots: 4x linecards + 2x RSP
rack: 17.38w x 17.35h x 28d
Bandwidth
400Gbps backplane
180Gbps fabric 400G
40G/80G linecards Nx100G
Cisco Confidential
16
Cisco Confidential
17
Feed A
PS 0
Feed B
PS 1
Feed C
PS 2
LC
LC
LC
LC
RSP
RSP
Fans
Fans
Cisco Confidential
18
Feed A
Feed B
Feed A
Feed B
Feed A
Feed B
PS 0
PS 1
PS 2
LC
LC
LC
LC
RSP
RSP
Fans
Fans
Cisco Confidential
19
per-component values
9006 FanTray
9010 FanTray
RSP
4xNP linecard
8xNP linecard
TOTALS
Qty
0
2
2
4
4
Typical
(25C)
Max (40C)
Ext. Temp
(55C)
Typical
(25C)
Max
(40C)
Ext. Temp
(55C)
100
275
375
200
300
600
400
600
1200
175
205
235
350
410
470
310
320
350
1240
1280
1400
565
575
630
2260
2300
2520
4250
4590
5590
To use: select 2 fan trays based on the chassis type. Enter the number of cards and RSPs
configured.
Max power values are tested values with full wire-rate traffic running on all ports, and worst-case
feature sets.
Note that it's the NUMBER OF NPs that matters, NOT the number of ports.
Specific example: the 8-port card with 4 NPs uses far far less power than the 8-port card with
8xNPs
Deployed "real world" systems are likely (but not guaranteed) to draw 10-33% less power than these numbers.
Viking Hardware Overview
Cisco Confidential
20
ASR9K Overview
ASR9K Chassis
Architecture
RSP
ASR9K System
Architecture
Fabric
Linecard
Life of a Packet
Power Management
Cisco Confidential
21
NPU
NPU
NPU CPU
MAC
MAC
CPU
MAC
BITS/DTI
FIC
NPUNPU
MAC
FIC
NPU
CPU
BITS/DTI
FIC
NPU
NPU
FIC
NPU
NPU
CPU
MAC
MAC
NPU
MAC
FIC
NPU
FIC
NPU
MAC
NPU
Cisco Confidential
22
IOS XR Based
Sharing same XR release and L3 feature set with CRS-1
Carrier Class infrastructure
Offering S/W modularity, HA, Restartability, Fault Containment, NSF/SSO,
SMU, ISSU
Cisco Confidential
23
Switch Fabric
Switch
Fabric
Route
Processor
Route Processor
Distributed
Forwarding Line
Card
Distributed
Forwarding Line
Card
Distributed
Forwarding Line
Card
Cisco Confidential
24
Octopus
CPU
8641D
Punt Path
RSP1
Punt Path
System
Timing
Octopus
Legend
CPU
8641D
Punt Path
Timing Plane
Data Plane
Punt Path
2 Santa
Cruz
GE
Switch
Bellagio 2
System
Timing
2 Santa
Cruz
Arbitration Plane
GE
Switch
Bellagio 2
Control Plane
Punt Path
Backplane
10Px
SFP
10Px
SFP
10Px
SFP
NP3
NP3
NP3
10G PHY SFP
10Px
SFP
NP3
NP3
NP3
NP3
4x10GE
Mancuso
LC
GE
PHY
Octopus
CPU
8641
BRG
BRG
NP3
CPU
8641
BRG
BRG
GE
PHY
Octopus
BRG
CPU
8641
8x10GE
Ramius
LC
GE
PHY
Octopus
40x1GE
Ryan LC
BRG
NP3
NP3
NP3
NP3
10G
PHY
XFP
10G
PHY
XFP
10G
PHY
XFP
10G
PHY
XFP
Cisco Confidential
20x1GE
Thor LC
GE
PHY
Octopus
CPU
8641
SERP
SERP
CPP
CPP
PLIM ASIC
10Px
SFP
10Px
SFP
25
C PU
8 64 1 D
Oct opus
RSP 1
Legend
C PU
8 641 D
Oc topus
Data Plane
P unt Path
Sy s t e m
Timing
2 Santa
C ruz
GE
Switc h
B ella gio 2
Sy s te m
T im ing
2 Sa nta
Cr uz
GE
Switc h
B e llagio 2
Control Plane
Bac kp l an e
40 x 1 GE
Ryan LC
FPGA
O ctopus
GE
PHY
8 x 10 GE
CPU
8641
LC
FPGA
FPGA
Octopus
Ramius
GE
PHY
4 x 10 GE
CPU
8641
LC
O ctopus
Mancuso
20 x 1 GE
GE
PHY
Octopus
Thor LC
CPU
8641
FPGA
FPGA
GE
PHY
Trident Trident
FPGA
CPU
8641
FPGA
Trident Trident
FPGA
CPP
CPP
Cisco Confidential
10GE XFP
10GE XFP
10GE XFP
10GE XFP
10GE XFP
10GE XFP
10GE XFP
10GE XFP
10 x
SFP
10GE XFP
10 x
SFP
10GE XFP
10 x
SFP
10GE XFP
10 x
SFP
10GE XFP
PLIM ASIC
SPA
SPA
SPA
SPA
26
ASR9K Overview
ASR9K Chassis
Architecture
RSP
ASR9K RSP
(Route Switch Processor)
Fabric
Linecard
Life of a Packet
Power Management
Cisco Confidential
27
RSP440
Processors
2 x 1.5GHz Freescale
8641D CPU
RAM (user
expandable)
Cache
L1: 32KB
L2: 1MB
Primary persistent
storage
4GB
16GB - SDD
Secondary persistent
storage (HD/SSD)
30GB - HDD
16GB - SDD
No
Yes
nV Cluster EOBC
ports
No
Switch fabric
bandwidth
8GB
RSP440
Cisco Confidential
28
2x 10/100/1000 Ethernet
Compact Flash
USB
BITS/DTI
Cisco Confidential
29
Cisco Confidential
30
Clock
Time
FPGA
Timing Domain
4GB MEM
HDD
CF card
Mgt Eth
CPU
8641D
Mgt Eth
Ether
Switch
Console
Aux
4G CF
Punt
FPGA
Long Beach
I/O FPGA
Front Panel
Viking Hardware Overview
Arbitration
Bellagio
Santa
Cruz 1
Alarm
NVRAM
Octopus
EOBC/
Control Plane GE
Santa
Cruz 0
Boot Flash
CPU Complex
Fabric Interface
Cisco Confidential
31
ASR9K Overview
ASR9K Chassis
Architecture
RSP
Fabric
ASR9K Fabric
Linecard
Life of a Packet
Power Management
Cisco Confidential
32
Cisco Confidential
33
Octopus
(LC)
Santa Cruz 0
Octopus
(LC)
Octopus
(LC)
Santa Cruz 1
Octopus
(LC)
Octopus
(LC)
Data
Bellagio
?
Octopus
(RSP)
Octopus
(RSP)
Arbitration
Cisco Confidential
34
RSP0
Octopus
(LC)
Santa
Cruz 0
Santa
Cruz 1
Bellagio
RSP1
Cisco Confidential
35
RSP0
Santa
Cruz 0
Octopus
Octopus
Santa
Cruz 1
Single-Octopus
40G Linecard
Dual-Octopus
80G Linecard
Bellagio
RSP1
Linecards are forwards/backwards compatible: fabric and backplane designed for 80G today
No changes to existing architecture, arbitration scheme stays the same
FCS fabric has enough switch fabric ports to support 80G/Linecard
Fabric and Backplane designed to support two Fabric Interface Devices seamlessly
Viking Hardware Overview
Cisco Confidential
36
Octopus
Santa
Cruz 0
Santa
Cruz 1
Bellagio
(unicast fabric plane)
Unicast traffic is sent across first available fabric link to destination (maximizes efficiency)
Each frame (or superframe) contains sequencing information
All destination octopus have re-sequencing logic
Additional re-sequencing latency is measured in nanoseconds
Viking Hardware Overview
Cisco Confidential
37
Octopus
C1
B2
A3
B1
A2
A1
Santa
Cruz 1
Bellagio
(multicast fabric plane)
Cisco Confidential
38
Cisco Confidential
39
Cisco Confidential
40
Octopus
(LC)
Santa Cruz 0
Octopus
(LC)
Santa Cruz 1
Octopus
(LC)
RSP0
Octopus
(LC)
Octopus
(LC)
Santa Cruz 0
Octopus
(LC)
Octopus
(LC)
Santa Cruz 1
Octopus
(RSP)
Octopus
(RSP)
RSP1
Cisco Confidential
41
Octopus
Octopus
Octopus
Octopus
80G
Octopus
Octopus
80G
80G
Santa Cruz 0
80G
Octopus
Octopus
Santa Cruz 1
RSP0
80G
Octopus
Octopus
Octopus
Octopus
80G
Octopus
Octopus
Santa Cruz 0
Octopus
Octopus
80G
Santa Cruz 1
40G
Octopus
(RSP)
RSP1
Octopus
(RSP)
40G
Cisco Confidential
42
Cisco Confidential
43
Packet 3
Packet 1
No superframing (1)
Packet 2
Packet 1
Packet 2
Packet 1
Packet 1
Max
MTU
Max
Superframe
Min Sufficient
for Superframe
Cisco Confidential
0 (Empty)
44
Cisco Confidential
45
Superframes
With 32 byte DC3 hdr + FPOE + error control + 8-bye alignment overhead, smaller pkts are
inefficient in the fabric. So unicast packets are grouped into Superframes < 2K bytes. Since there
could be huge combination of multicast destinations, multicast packets are neither put into
Superframes nor are arbitrated through the VOQ mechanism.
8 bytes
1st packet DC3 fabric
header inclusive
Min. 1068
bytes to
guarantee
line rate
perfmnce
3 FPOE bytes
(interpreted
by fabric)
Word0
Word1
Word2
Sequencing
information in
32-byte DC3
header
Nth packet
4 byte CRC covers
entire frame.
Pad with zero to align to 8 bytes
Cisco Confidential
46
0
1
14
15
SCZ
Octo
To-Fab
0
1
14
14
15
15
RSP0
0
1
15
0
1
14
14
15
15
RSP1
0
1
14
15
SCZ
Octo
To-Fab
Octo
To-Fab
SCZ
0
1
SCZ
Octo
To-Fab
First Line Card / Slot 0
Ingress Path
0
1
0
1
14
15
Cisco Confidential
48
ASR9K Overview
ASR9K Chassis
Architecture
RSP
Fabric
ASR9K Linecards
Linecard
Life of a Packet
Power Management
Cisco Confidential
49
Feature
Cisco Confidential
A9K-40GE-B
A9K-4T-B
A9K-4T/8-B
50
Cisco Confidential
51
STATS MEMORY
MAC
LOOKUP
MEMORY
FRAME MEMORY
TCAM
System level scale (unicast, multicast, MPLS label) adjacency and MAC
address) not affected by a mix of LCs
Viking Hardware Overview
Cisco Confidential
52
Low Queue
Medium Queue
High Queue
512K
512K
512K
1M/128K
1M/128K
1M/128K
32K
32K
32K
512K/128K
512K/128K
512K/128K
VRFs
4k
4k
4k
L3 Subif/Port
4k
4k
4k
Bridge Domains
8k
8k
8k
128k
128k
128k
4k
16k
32k
Queues
8/port
64k/32k
256k/128k
Policers
8k
128k
256k
MAC Addresses
IPv4 Routes (total/per VRF)
ARP entries
IPv6 Routes (total/per VRF)
MPLS Labels
EFPs (L2 sub-int)
Cisco Confidential
Different
Metric
Common
Capability Comparison
53
Cisco Confidential
54
Typhoon LC
Part Number
Target
Release
A9K-RSP440-SE
4.2.0
A9K-RSP440-TR
4.2.0
A9K-MOD80-SE
4.2.0
A9K-MOD80-TR
4.2.0
A9K-MOD160-SE
4.2.1
Part Number
Target
Release
A9K-24x10GE-SE
4.2.0
A9K-24x10GE-TR
4.2.0
A9K-2x100GE-SE
4.2.0
A9K-2x100GE-TR
4.2.0
A9K-1x100GE-SE
4.2.2
A9K-MOD160-TR
4.2.1
A9K-1x100GE-TR
4.2.2
A9K-MPA-2x10GE
4.2.1
A9K-36x10GE-SE
4.2.2
A9K-MPA-4x10GE
4.2.0
A9K-36x10GE-TR
4.2.2
A9K-MPA-8x10GE
4.3.1
A9K-MPA-20x1GE
4.2.0
A9K-MPA-1x40GE
4.2.3
A9K-MPA-2x40GE
4.2.1
Cisco Confidential
55
Netflow Support
Cisco Confidential
56
Licensable Features
L3 VPN Service Line Card License
Enables Provisioning of L3VPN Service Interfaces on the LC
Feature
Cisco Confidential
57
Do I need a License ?
Cisco Confidential
58
Cisco Confidential
59
Linecards
Codename
BW
Engine
Ryan
40 x GE
40G
4 x Trident NPU
Ramius
8 x 10GE
40G
4 x Trident NPU
Mancuso
4 x 10GE
40G
4 x Trident NPU
Thor
4 x SPA
20G
2 x CPP10 (Popeye)
Son-of-Thor
4 x SPA
40G
2 x CPP10 (Olive)
Odin
8 x 10GE
80G
8 x Trident NPU
Valhalla
16x10GE
80G
8 x Trident NPU
Comments
2:1 oversubscribed
RED OCTOBER
I/O
2:1 oversubscribed
Cisco Confidential
60
Cisco Confidential
61
Forwarding/Queueing
Trident Network Processor
Fabric Interface
Octopus
Cisco Confidential
62
2GB memory
CPU
8641D
Trident Memory
XFP
3
10GE PHY
XFP
7
10GE PHY
Trident 0
Trident Memory
XFP
2
10GE PHY
XFP
6
10GE PHY
Bridge
FPGA 0
Trident 1
Trident Memory
XFP
1
10GE PHY
XFP
5
10GE PHY
gigE
control
network
Octopus
RSP 0
Trident 2
Trident Memory
XFP
0
10GE PHY
XFP
4
10GE PHY
Bridge
FPGA 1
Trident 3
Network
Clocking
daughtercard
Viking Hardware Overview
Cisco Confidential
RSP 1
via backplane
63
2GB memory
CPU
8641D
Trident Memory
XFP
10GE PHY
Trident 0
Trident Memory
XFP
10GE PHY
Trident 1
Trident Memory
XFP
10GE PHY
10GE PHY
gigE
control
network
RSP 0
Bridge
FPGA 1
Trident 3
Network
Clocking
daughtercard
Viking Hardware Overview
Octopus
Trident 2
Trident Memory
XFP
Bridge
FPGA 0
RSP 1
via backplane
Cisco Confidential
64
2GB memory
Trident Memory
10x
GE SFP
Trident 0
Trident Memory
10x
GE SFP
gigE
control
network
RSP 0
Bridge
FPGA 1
Trident 3
Network
Clocking
daughtercard
Viking Hardware Overview
Octopus
Trident 2
Trident Memory
10x
GE SFP
Bridge
FPGA 0
Trident 1
Trident Memory
10x
GE SFP
CPU
8641D
Cisco Confidential
RSP 1
via backplane
65
Hardware Subsystem
8x10GE line rate Linecard : Odin
CPU memory
2GB flash
CPU
8641D
Trident Memory
XFP
10GE PHY
XFP
10GE PHY
Trident 0
Trident Memory
Trident 1
Trident Memory
XFP
10GE PHY
Trident 2
Raven
FPGA 0
Octopus 0
Trident Memory
XFP
10GE PHY
XFP
10GE PHY
XFP
10GE PHY
Trident 3
Trident Memory
Trident 4
Trident Memory
10GE PHY
Octopus 1
Trident 5
Trident Memory
XFP
RSP 0
gigE
control
network
Trident 6
Raven
FPGA 1
RSP 1
Trident Memory
XFP
10GE PHY
Trident 7
Network
Clocking
Cisco Confidential
via backplane
66
Hardware Subsystem
16x10GE 2:1 oversubscribed Linecard : Valhalla
CPU memory
2GB flash
XFP
10GE PHY
XFP
10GE PHY
XFP
10GE PHY
XFP
10GE PHY
XFP
10GE PHY
Trident Memory
Trident 0
Trident Memory
Trident 1
Trident Memory
XFP
10GE PHY
XFP
10GE PHY
Trident Memory
XFP
10GE PHY
Trident 3
Trident 2
XFP
10GE PHY
XFP
10GE PHY
XFP
10GE PHY
XFP
10GE PHY
Trident 5
XFP
10GE PHY
Trident Memory
XFP
10GE PHY
Trident 6
XFP
10GE PHY
Trident Memory
XFP
10GE PHY
Trident 7
CPU
8641D
Trident Memory
Raven
FPGA 0
Octopus 0
RSP 0
gigE
control
network
Trident 4
Trident Memory
Octopus 1
Raven
FPGA 1
RSP 1
Network
Clocking
Cisco Confidential
via backplane
67
Hardware Subsystem
CPU memory
CPU
8641D
Trident Memory
XFP
10GE PHY
Trident 0
Trident Memory
XFP
10GE PHY
Trident 1
Trident Memory
10x
GE SFP
gigE
control
network
RSP 0
Bridge
FPGA 1
Trident 3
Network
Clocking
daughtercard
Viking Hardware Overview
Octopus
Trident 2
Trident Memory
10x
GE SFP
Bridge
FPGA 0
RSP 1
via backplane
Cisco Confidential
68
2GB
flash
2GB memory
CPU
8641D
Trident Memory
XFP
10GE PHY
XFP
10GE PHY
XFP
10GE PHY
XFP
10GE PHY
XFP
10GE PHY
Trident 0
Trident Memory
Bridge
FPGA 0
Trident 1
Trident Memory
gigE
control
network
Octopus
RSP 0
Trident 2
XFP
10GE PHY
XFP
10GE PHY
XFP
10GE PHY
Trident Memory
Bridge
FPGA 1
Trident 3
daughtercard
Network
Clocking
RSP 1
via backplane
Cisco Confidential
69
Cisco Confidential
70
TM Control
Memory
DRAM
333MHz
DDR2/
RLDRAM2
Lookup
Tables
DRAM
333MHz
DDR2/
RLDRAM2
Counters
Statistics
Lookups
SRAM
(36x1)
300MHz
QDR
(72x1)
300MHz
Fabric Side
15 Gbit/s XAUI+
Micro-Engine
Pipeline
TMb
TMc
Cisco Confidential
Fabric Interface
TMa
Ethernet Side
GigE SGMII MACs (or)
XAUI 10G MACs
Host PCIExpress
Optional
TCAM72
Host
SGMII
(punt path)
71
From
Link/
SF/
Host
Frame
Memory
TOP
TOP
Search I
parse
keys
256KB
TOP
resolve
TOP
Search II
search
results
TOP
modify
TM
TM
TM
To
Link/
SF/
Host
search
results
Embedded search
Memory
256KB
Frame
Memory
External Search
Memory( RLDII, TCAM)
Control
Memory
Statistics
Memory
Trident NPU
Single Chip, Programmable, up to 12Gbps w/ 64B packets, full duplex, wire speed network
processor (up to 12 Gbps ingress plus 12 Gbps egress per chip)
Traffic Manager
Support WRED, total 32K queues (8 queues per subscriber x 4K subscribers) per TM
Programming
Model
Programming
Language
HW Assistance
Classification / Searching
Cisco Confidential
72
Ingress
BQS
engine
Interface
MAC/PHY
Egress
BQS
engine
64k
queues
PPE
PPE
PPE
PPE
PPE
PPE
PPE
PPE
PPE
PPE
PPE
PPE
PPE
PPE
PPE
PPE
PPE
PPE
PPE
PPE
32k
queues
switch
fabric
interface
RSP
RSP
Multicore/Multistage processing complex
fabric
Cisco Confidential
73
Cisco Confidential
74
6 10:31:21.480 UTC
Node: 0/0/CPU0:
---------------------------------------------------------------[total 4 NP] Driver - Version 10.26a Build 1010 ( Jan 28 2009, 12:00:00 )
NP 0 : Hardware Revision: v2 A1
:
NP 1 :
:
NP 2 :
:
NP 3 :
Node: 0/5/CPU0:
---------------------------------------------------------------[total 4 NP] Driver - Version 10.26a Build 1010 ( Jan 28 2009, 12:00:00 )
NP 0 : Hardware Revision: v2 A1
:
NP 1 :
:
NP 2 :
:
NP 3 :
Cisco Confidential
75
6 10:34:11.161 UTC
Node: 0/0/CPU0:
Counter
FrameValue
------------------------------------------------------------------------------25
PARSE_FABRIC_RECEIVE_CNT
53
XAUI_TRAINING_PKT_DISCARD
57
RESOLVE_INGRESS_L2_PUNT_CNT
85
DIAGS
19601
1093
29294
9786
197
PUNT_STATISTICS
447536
199
PUNT_DIAGS_RSP_ACT
9789
201
PUNT_DIAGS_RSP_STBY
9719
For detail explanation on what these counters mean, please look at: asr9k_ucode-cntrs.doc ( EDCS-778662)
Cisco Confidential
76
Bridge
-----1
1
0
0
Fia
--0
0
0
0
Ports
--------------------------------------------------TenGigE0/0/0/3
TenGigE0/0/0/2
TenGigE0/0/0/1
TenGigE0/0/0/0
Cisco Confidential
77
Fia to
Fabric
Fabric
Fabric
Fabric Link 3
SYNCED
SYNCED
Cisco Confidential
78
From
From
From
From
From
From
From
From
Unicast Xbar[0]
Unicast Xbar[1]
Unicast Xbar[2]
Unicast Xbar[3]
MultiCast Xbar[0]
MultiCast Xbar[1]
MultiCast Xbar[2]
MultiCast Xbar[3]
39225
34181
834384
34133
0
86872
0
4456
Cisco Confidential
79
Cast/
Packet
Packet
Prio
Direction
Count
Viking
Hardware Overview
--------------------------------------------------
Cisco Confidential
80
Status
--------
------
SYNCED
SYNCED
Status
--------
------
SYNCED
SYNCED
Cisco Confidential
81
NP#
Status
-------
---
------
SYNCED
SYNCED
SYNCED
SYNCED
Cisco Confidential
82
Bridge
Bridge
Bridge
Bridge
to
to
to
to
NP-0
NP-1
NP-2
NP-3
0
0
0
0
LP
LP
LP
LP
NP-0
NP-1
NP-2
NP-3
to
to
to
to
Bridge0
Bridge0
Bridge1
Bridge1
0
0
0
0
UC
UC
UC
UC
HP
HP
HP
HP
NP-0
NP-1
NP-2
NP-3
to
to
to
to
Bridge0
Bridge0
Bridge1
Bridge1
0
0
0
0
MC LP
NP-0 to Bridge0
MC LP
NP-1 to Bridge0
Viking Hardware
Overview
MC LP
NP-2 to Bridge1
0
0
0
Cisco Confidential
83
A9K-40GE-E
A9K-4T-E
A9K-4T/8-E
Cisco Confidential
84
Cisco Confidential
85
Support of BGP
Support of L3VPNs
Simultaneous Support of L2 / L3
Cisco Confidential
86
-B Line Cards
-E Line Cards
MAC Addresses
1M
1M
IPv4 Routes
1M
1M
IPv6 Routes
256k
256k
VRFs
4k
4k
EFPs
16k
32k
Bridge Domains
8k
8k
Queues
96k
384k
Policers
128k
256k
DHCP Clients
128k
128k
Packet Buffer
50ms
150ms
Scale
Cisco Confidential
87
Cisco Confidential
88
QFP Memory
HH SPA
SPA
I/F
QFP 0
HH SPA
DRAM
HyTop
FPGA
PEX8509
CPU
Serpent
FPGA
Fabric
Interface
Drakar
FPGA
CPU daughtercard
HH SPA
SPA
I/F
QFP 1
HH SPA
QFP Memory
SPA daughtercard
Viking Hardware Overview
89
Cisco Confidential
90
Viking Codenames
Ryan 40x1GE Linerate LC for Red October/Samurai
Ramius 8x10GE Over-subscribed LC for Red October/Samurai
Mancuso - 4 x10GE Linerate LC for Red October/Samurai
Jetfire 2x10GE + 20 GE Linerate LC for Red October/Samurai
Odin 8x10GE Linerate LC for Red October/Samurai
Valhalla 16x10GE Over-subscribed LC for Red October/Samurai
Cisco Confidential
91
ASR9K Overview
ASR9K Chassis
Architecture
RSP
ASR9K Life of a
Packet
Fabric
Linecard
Life of a Packet
Power Management
Cisco Confidential
92
SFP/XFP
Optics
NP3c
15G XAUI
per NP3
Moto 8641D
Octopus
32G DDR
per bridge
2 x 23G
Chico
per LC
Backplane
10G MAC
per PHY
Bridge
FPGA
Santa
Cruz
Santa
Cruz
Octopus
Punt
FPGA
Punted to RSP if
FPOE says so
SFP/XFP
Optics
NP3c
Bridge
FPGA
Octopus
Cisco Confidential
93
Life of a Packet
Ingress Packet Path
2GB flash
2GB memory
1
XFP
10GE PHY
CPU
8641D
Trident Memory
Trident 0
3
Trident Memory
XFP
10GE PHY
Trident 1
Trident Memory
XFP
10GE PHY
10GE PHY
4
gigE
control
network
RSP 0
Bridge
FPGA 1
Trident 3
Network
Clocking
daughtercard
Viking Hardware Overview
Octopus
Trident 2
Trident Memory
XFP
Bridge
FPGA 0
Cisco Confidential
RSP 1
via backplane
94
Bridge FPGA
The Bridge FPGA is acting as a traffic adaptor
between DDR interface of Octopus ASIC and
XAUI-like interface of G8000 Network
processor
There are two data paths from the NP
Bridge3 FPGA:
Manipulates the header and does interface conversion, to the
Octopus
This path handles all main data and also central punt data that
are routed
Local CPU through a switched GE link
used to process punt data locally or the packets may be sent to
the RSP card via the backplane GE or fabric link
Cisco Confidential
95
Cisco Confidential
96
Life of a Packet
Fabric Packet Path
Santa
Cruz 0
5: credit return
1: Fabric Request
Santa
Cruz 1
Bellagio
Octopus
(LC)
RSP0
2: Arbitration
Octopus (LC)
Santa
Cruz 0
3: Fabric Grant
Santa
Cruz 1
Bellagio
RSP1
4: load-balanced
transmission across fabric links
Cisco Confidential
97
Life of a Packet
Egress Packet Path
2GB flash
2GB memory
CPU
8641D
Trident Memory
XFP
10GE PHY
Trident 0
Bridge
FPGA 0
Trident Memory
XFP
Trident 1
10GE PHY
gigE
control
network
Trident Memory
XFP
Octopus
RSP 0
Trident 2
10GE PHY
2
5
XFP
10GE PHY
Bridge
FPGA 1
4
Trident Memory
Trident 3
Network
Clocking
daughtercard
Viking Hardware Overview
Cisco Confidential
RSP 1
via backplane
98
Cisco Confidential
99
Node
| Link State
---------------------------------0/RSP0/CPU0 |
Up (Local CPU)
0/RSP1/CPU0 |
Up (Peer CPU)
0/0/CPU0 |
Up
0/1/CPU0 | Down
0/2/CPU0 | Down
0/3/CPU0
0/4/CPU0
0/5/CPU0
0/6/CPU0
0/7/CPU0
|
|
|
|
|
Down
Down
Up
Down
Down
| Link State
---------------------------------0/RSP1/CPU0 |
Up (Local CPU)
0/RSP0/CPU0 |
Up (Peer CPU)
0/0/CPU0 |
Up
0/1/CPU0 |
0/2/CPU0 |
Down
Down
0/3/CPU0 |
0/4/CPU0 |
Down
Down
0/5/CPU0 |
0/6/CPU0 |
Up
Down
0/7/CPU0 |
Down
Cisco Confidential
100
Life of a Packet
Egress Multicast Packet Path
2GB memory
Non-subscriber
Non-subscriber
Non-subscriber
Non-subscriber
Trident Memory
Non-subscriber
Non-subscriber
Non-subscriber
Non-subscriber
Trident Memory
Non-subscriber
Non-subscriber
Non-subscriber
Non-subscriber
Non-subscriber
Non-subscriber
Non-subscriber
Non-subscriber
CPU
8641D
Trident 0
Bridge
FPGA 0
Trident 1
Trident Memory
gigE
control
network
Trident 2
Trident Memory
Octopus
RSP 0
mcast
Bridge
FPGA 1
Trident 3
RSP 1
via backplane
Cisco Confidential
101
Life of a Packet
Egress Multicast Packet Path
2GB memory
New
Sub
Non-subscriber
Subscriber
Non-subscriber
Non-subscriber
Trident Memory
Non-subscriber
Non-subscriber
Non-subscriber
Non-subscriber
Trident Memory
CPU
8641D
Trident 0
Bridge
FPGA 0
Trident 1
Octopus
Non-subscriber
Non-subscriber
Non-subscriber
Non-subscriber
Non-subscriber
Non-subscriber
Non-subscriber
Non-subscriber
RSP 0
Trident Memory
Trident 2
Trident Memory
mcast
Bridge
FPGA 1
Trident 3
RSP 1
via backplane
Cisco Confidential
102
Life of a Packet
Egress Multicast Packet Path
Non-subscriber
Subscriber
Subscriber
Trident Memory
Trident 0
Subscriber
Non-subscriber
Non-subscriber
Non-subscriber
Trident Memory
Bridge
FPGA 0
Trident 1
Subscriber
Octopus
Non-subscriber
Non-subscriber
Non-subscriber
Non-subscriber
Non-subscriber
Non-subscriber
Non-subscriber
Non-subscriber
RSP 0
Trident Memory
Trident 2
Trident Memory
mcast
Bridge
FPGA 1
Trident 3
RSP 1
via backplane
Cisco Confidential
103
Life of a Packet
Egress Multicast Packet Path
Trident Memory
Non-subscriber
Subscriber
Trident 0
Subscriber
Subscriber
Non-subscriber
Non-subscriber
Non-subscriber
Non-subscriber
Bridge
FPGA 0
Trident Memory
(Pruned)
Trident 1
(Pruned)
(leave)
Octopus
Subscriber
Subscriber
Subscriber
Subscriber
Non-subscriber
Non-subscriber
Subscriber
Subscriber
RSP 0
Trident Memory
Trident 2
Trident Memory
mcast
Bridge
FPGA 1
Trident 3
RSP 1
via backplane
Cisco Confidential
104
Viking Multicast
Viking Multicast Forwarding Plane
R
Replication Engines
RP
Switch Fabric
LC3
Fabric Interface
B0
[1] Ingress
Trident RPF
check.
LC2
Fabric Interface
B0
B1
LC1
R
Fabric Interface
1
0
R
B0
B1
R
T0
T1
T2
T3
T0
T1
T2
T3
T0
T1
[0] IGMP
joins for
subscriber
registration.
T2
T3
B1
IGMP joins
FGID : Fabric Group ID
Cisco Confidential
ASR9K Overview
ASR9K Chassis
Architecture
RSP
ASR9K Power
Management
Fabric
Linecard
Life of a Packet
Power Management
Cisco Confidential
106
Power Management
Power Management is a customer requirement that the feature
available start from FCI (3.7.2) release.
Power Management enabled ASR9K chassis have the capability to
prevent an FRU from being powered on, in the event that there is
not enough system power available to accommodate the FRU.
Power Management uses Power Monitor software feature which
allows user to monitor the power used and how much is available.
Power Management feature also alarms the user if there is not
sufficient power or any other related events.
Power management feature is not available in 3.7.1 and on
Gladiator chassis.
Cisco Confidential
107
System Overview
PwrMon process
Identifies and communicates with power supply modules via I2C
Shelfmgr process
Allows or Denies LC power-up based on (1) estimated power
requirements & (2) available power modules
Publishes Power Supply OIR events to internal consumers.
EnvMon process
Publishes power budget status to CLI
InvMgr process
Publishes detailed power supply description to inventory
Cisco Confidential
108
Feature Description
Inventory Description for Power Supplies
Indicate how many power module in system
Indicate power module source is AC or DC
RP/0/RSP0/CPU0:Samurai(admin)#show inventory
NAME: "power-module 0/PM0/SP", DESCR: "1.5kW DC Power Module"
PID: A9K-1.5KW-DC
, VID: V00, SN: TLD123950YS
NAME: "power-module 0/PM1/SP", DESCR: "2kW DC Power Module"
PID: A9K-2KW-DC
, VID: V01, SN: TLD1214001S
==================
RP/0/RSP0/CPU0:RO(admin)#show inventory
NAME: "power-module 0/PM0/SP", DESCR: "3kW AC Power Module"
PID: A9K-3KW-AC
, VID: V00, SN: TLD123850NH
NAME: "power-module 0/PM2/SP", DESCR: "3kW AC Power Module"
PID: A9K-3KW-AC
, VID: VOO, SN: TLD123650RA
Cisco Confidential
109
Feature Description
Power Management Command Summary
Power Management Command Summary
Command
Purpose
RP/0/RP0/CPU0:Router (admin-config)#hw-module
power [disable] location { location}
RP/0/RP0/CPU0:Router (admin-config)#hw-module
power override location { location}
Cisco Confidential
110
Feature Description
Checking available power capacity
RP/0/RSP0/CPU0:VKG-3(admin)#show environment power-supply
Mon Oct 12 12:25:05.399 UTC
R/S/I
Modules Sensor
Watts
Status
0/PM0/*
host
PM
3000
Ok
host
PM
3000
Ok
host
PM
3000
Ok
0/PM1/*
0/PM2/*
9000W
9000W
6000W
3000W
2615W
Slot
---0/0/CPU0
0/1/CPU0
0/RSP0/CPU0
0/RSP1/CPU0
0/7/CPU0
0/FT0/SP
0/FT1/SP
Worst Case Power Available:
Supply Protected Capacity Available:
Feed Protected Capacity Available:
Max Watts
--------375
375
250
250
375
495
495
(default)
(default)
6385W
3385W
385W
Cisco Confidential
111
ASR9K Overview
ASR9K Chassis
Architecture
RSP
Fabric
Linecard
Life of a Packet
Power Management
Cisco Confidential
112
Devices On RSP
Device
Harddisk
eUSB
C. Flash
Type
FS Type
70GB
QNX4
NAND
2GB/ea
QNX4
Compact
1GB
DOS/QNX4
64MB
QNX FFSv3
512KB
Cisco
Flash
Flash
NOR
Size
SAS
(removable)
NVRAM
Quantity
Cisco Confidential
113
Devices On LC
Device
Type
Quantity
Size
FS Type
eUSB
NAND
2GB
QNX4
Flash
NOR
128MB
QNX FFSv3
Cisco Confidential
114
Partitions On RSP
Device
Harddisk
Partition
/harddisk:
/harddiska:
Size
70GB
(total)
Purpose
dumps/ etc.
/harddiskb:
Raw
eUSB
C. Flash
/disk0:
1.6GB
/disk0a:
0.4GB
/disk1:
1.6GB
/disk1a:
0.4GB
/compactflash:
1GB
IOS-XR Packages
Golden Disk or Mirror Disk
(removable)
Cisco Confidential
115
Partition
Raw
/bootflash:
Flash 2
Purpose
MONLIB
43MB
MBI images
Raw
ROMMON/Firmware
Raw
MONLIB
/configflash:
NVRAM
Size
28MB
OBFL data
Raw
/nvram:
Variables, logs
/nvram-raw:
Cisco Confidential
116
Partitions On LC
Device
eUSB
Flash
Partition
/eusb0:
1.6GB
/eusb0a:
0.4GB
Raw
/bootflash:
Raw
Size
Purpose
Local Kernel Dumps
MONLIB
56MB
ROMMON/Firmware/Kernel
dumps
Cisco Confidential
117
DOS
QNX4
Types
6, 4, 11, 12
File
Organization
Block-based
Extent-based
Patition
fdisk
fdisk
Initialize
mkdosfs
dinit
fs check
chkdosfs
chkfsys
Verify media
dcheck
dcheck
Cisco Confidential
118
Free(b)
Type
Flags
Prefixes
network
rw
qsm/dev/fs/tftp:
network
rw
qsm/dev/fs/rcp:
network
rw
qsm/dev/fs/ftp:
1644150784
1404023296
flash-disk
rw
disk1:
1644150784
1404023296
flash-disk
rw
disk0:
35645292544 35628865024
harddisk
rw
harddisk:
1022427136
1022418944
flash-disk
rw
compactflash:
8075067392
8073070080
harddisk
rw
harddiska:
7840202752
7838258688
harddisk
rw
harddiskb:
411041792
410914816
flash-disk
rw
disk1a:
411041792
410903552
flash-disk
rw
disk0a:
224256
165888
nvram
rw
nvram:
290816
290816
nvram
rw
nvram-raw:
44695552
23889200
flash
rw
bootflash:
28966912
28862044
rw
configflash:
Cisco Confidential
119
show media
RP/0/RSP0/CPU0:VKG-3(admin)#sh media
Fri Apr 9 15:05:34.364 EST
Media Information for 0/RSP0/CPU0.
Image
Current Part
Mountpoint
FsType FsType
Size
State
DrvrPid Mirror Flags
================================================================================
/disk0:
QNX4
QNX4
1.5G Mounted
0069666 Enabled
/disk0a:
QNX4
QNX4
0.4G Mounted
0069666
/disk1:
QNX4
QNX4
1.5G Mounted
0069676
/disk1a:
QNX4
QNX4
0.4G Mounted
0069676
/compactflash:
FAT16
FAT16
1.0G Mounted
0081977
/harddiska:
QNX4
QNX4
7.5G Mounted
0049184
/harddiskb:
QNX4
QNX4
7.3G Mounted
0049184
/harddisk:
QNX4
QNX4
33.2G Mounted
0049184
/lcdisk0:
QNX4
(?)
Not Present
/lcdisk0a:
QNX4
(?)
Not Present
RP/0/RSP0/CPU0:VKG-3#sh media loc 0/0/cpu0
Fri Apr 9 15:13:51.680 EST
Media Information for 0/0/CPU0.
Image
Current Part
Mountpoint
FsType FsType
Size
State
DrvrPid Mirror Flags
================================================================================
/lcdisk0:
QNX4
QNX4
1.5G Mounted
0049185
/lcdisk0a:
QNX4
QNX4
0.4G Mounted
0049185
Cisco Confidential
120
ASR9K Overview
ASR9K Chassis
Architecture
RSP
Fabric
Online Diagnostics
Linecard
Life of a Packet
Power Management
Cisco Confidential
121
Cisco Confidential
122
EOBC paths
Cisco Confidential
123
Cisco Confidential
124
User Interface
Generic user interface : GOLD-XR, same as on CRS
Only admin users have privilege to access online diagnostic commands:
commands are in admin mode
Most tests running in the background by default
Cisco Confidential
125
) PuntFPGAScratchRegister ---------> .
) XbarInterfaceScratchRegister ----> .
) ClkCtrlScratchRegister ----------> .
) IntCtrlScratchRegister ----------> .
) CPUCtrlScratchRegister ----------> .
) XbarSwitchIdRegister ------------> .
) EccSbeTest ----------------------> U
) SrspStandbyEobcHeartbeat --------> U
) SrspActiveEobcHeartbeat ---------> U
10 ) FabricLoopback ------------------> .
11 ) PuntFabricDataPath --------------> U
12 ) BootflashVerify -----------------> U
Cisco Confidential
126
Referencias
ASR9000/XR Understanding and
troubleshooting Fabric issues in the A9K
https://supportforums.cisco.com/document/12135016/asr9
000xr-understanding-and-troubleshooting-fabricissues-a9k
Cisco Confidential
127
Cisco Confidential
128