Beruflich Dokumente
Kultur Dokumente
Presentation_ID © 2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 1
Agenda
Nexus 5500
Nexus 5000 & 5500 Hardware
Architecture
Layer 3
Nexus 2000 (N2K)
Virtualized Switch
Nexus Fabric
FCoE
NIV
Presentation_ID © 2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 2
Nexus 5000 and 2000
Virtualized Data Center Access
Nexus 2000
Fabric Extender
Nexus 5010 48 Fixed Ports 100M/1G Ethernet (1000 BASE-T)
20 Fixed Ports 10G/FCoE/IEEE DCB 32 Fixed ports 1G/10G/FCoE/IEEE DCB Nexus 5020
Line-rate, Non-blocking 10G 4-8 Fixed Port 10G Uplink 40 Fixed Ports 10G/FCoE/IEEE DCB
1 Expansion Module Slot Distributed Virtual Line Card Line-rate, Non-blocking 10G
Redundant Fans & Power Supplies 2 Expansion Module Slots
Redundant Fans & Power Supplies
Presentation_ID © 2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 3
Nexus 5000 and 2000 Architecture
Nexus 5020
Presentation_ID © 2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 4
Nexus 5000 and 2000 Architecture
Nexus 5010
Presentation_ID © 2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 5
Nexus 5000 and 2000 Architecture
Expansion Modules
Nexus 5000 utilizes expansion slots to provide flexibility of
interface types
Additional 10GE DCB/FCoE compliant ports
1/2/4/8G Fibre Channel ports
Nexus 5020 has two expansion module slots
Nexus 5010 has one expansion module slot
Expansion Modules are hot swappable
Contain no forwarding logic
Expansion
Modules Slots
Presentation_ID © 2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 6
Nexus 5000 Hardware Overview
Data and Control Plane Elements
SFP SFP SFP SFP SFP SFP SFP SFP SFP SFP SFP SFP Expansion
Module
CPU
Intel LV Xeon
1.66 GHz
DRAM
NVRAM
Unified Crossbar ç
PCIe
Flash
Bus
Fabric
Serial
SERDES
Console
Unified Port
Controller
... Unified Port
Controller
NIC NIC
XAUI
Mgmt 0
SFP SFP SFP SFP SFP SFP
Inband Data Path to CPU
Presentation_ID © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 7
Nexus 5548P
Nexus 5548
32 Fixed Ports
1 Expansion Module
Expansion Module
Expansion Module Expansion Module
8 Port FC 1/2/4/8 Gig
Unified Ports 16 Ports 1/10 GE
Presentation_ID + 8 Ports 1/10 GE
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 8
Nexus 5548P Rear Panel
Presentation_ID © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 9
Nexus 5548UP Rear Panel
Presentation_ID © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 10
Nexus 5548P/UP Front Panel
Fabric Out of Band Mgmt
Interconnect 10/100/1000 USB Flash
Presentation_ID © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 11
Nexus 5548P Expansion Modules
16 ports
1/10 GE
8 ports
1/10 GE
+
8 ports
1/2/4/8 G FC
16 ports
Unified
1/10 GE or 1/2/4/8 G
FC
Presentation_ID © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 12
Nexus 5596UP
Nexus 5596
48 Fixed Ports
3 Expansion Modules
Presentation_ID © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 13
Nexus 5596UP Rear Panel
Presentation_ID © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 14
Nexus 5596UP Front Panel
Fabric Out of Band Mgmt
Interconnect 10/100/1000 Console USB Flash
Power Entry Power Entry Fan Module Fan Module Fan Module Fan Module
16 ports
1/10 GE
8 ports
1/10 GE
+
8 ports
1/2/4/8 G FC
Presentation_ID © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 16
Nexus 5596UP Expansion Modules
16 ports
Unified
1/10 GE or 1/2/4/8 G
FC
L3 module
Presentation_ID © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 17
Nexus 5596 Hardware Diagram
Carmel 1
DDR3 x2
Carmel 2
South Intel
Carmel 6
Carmel cpu Bridge Jasper Forest
10 Gig Sunnyvale
NVRAM Memory
PCIe x8
UPC UPC UPC UPC UPC UPC
Serial Flash
12 Gig
12 Gig
PEX 8525
4 port PCIE
Switch
PCIe x4 PCIe x4 PCIe x4
UPC
Unified Crossbar Fabric
CPU
PCIE PCIE PCIE
Dual Gig Dual Gig Dual Gig
0 1 0 1
1 N/C
12 Gig 12 Gig
Xcon1 Mgmt
UPC UPC UPC UPC UPC UPC
Presentation_ID © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 18
Nexus 5500 Series
Universal Port – Flexibility and Reuse
Unified Port supports multiple
transceiver types
1G Ethernet Copper/Fibre
10G Ethernet Copper/Fibre
10G DCB/FCoE Copper/Fibre
1/2/4/8G Fibre Channel
Change the transceiver and
connect evolving end devices,
Server 1G to 10G NIC migration
FC to FCoE migration
FC to NAS migration
Unified Port supports a Unified
Servers, FCoE FC Attached
Access Layer across the entire attached Storage
Servers
Storage
Fabric
Flexibility to evolve system end Unified Port – ‘Any’ device in any rack connected to the
points same edge infrastructure
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 19
Agenda
Nexus 5500
Nexus 5000 & 5500 Hardware
Architecture
Layer 3
Nexus 2000 (N2K)
Virtualized Switch
Nexus Fabric
FCoE
NIV
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 20
Nexus 5500 Series
2nd Generation Nexus 5000 with Layer 3 support
48 Fixed Ports
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 22
Nexus 5548 Layer 3 Daughter Card installation
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 23
IO Module without L3 daughter card
Top view
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 24
IO module with integrated L3 daughter card
Top view
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 25
L3 expansion module for Nexus 5596
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 26
Nexus 5596UP with L3 Module
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 27
Nexus 5500 Series
Layer 3 – Routed Access
In most Data Center architectures
the use of Layer 3 in the access
layer is not compatible with
virtualized workloads
In some environments the scaling
of workloads can allow migration of
the Layer 3 boundary to the access
Nexus 5500 supports the ability to
extend layer 3 routing to the access
In smaller environments can be
leveraged to provide routed
services for small Data Center sites
Fully compatible with Nexus 2000
Virtualized Switch architecture
Servers, FCoE FC Attached
Co-existence with the evolution of attached Storage Storage
Unified I/O and FCoE
Servers
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 28
Scaling the Virtualized Architecture
Scaling the Data Center Fabric
Scaling of both VM and non VM
based workloads is driving
increased density of compute and
growth of layer 2 fabrics
Nexus designs currently leveraging vPC
Scaling for up
vPC to increase capacity and to 32 x 10G
increase scale of layer 2 fabrics links = 320
Gbps
Nexus 5000/5500 when combined
with F1 line cards on Nexus 7000
can support port channels of up to vPC
32 x 10G interfaces = 320 Gbps
between access and aggregation
Nexus 5500/2000 virtualized access Scaling for up
switch can support MCEC based to 16 x 10G
links
port channels of up to 16 x 10G
links between server and virtualized VM VM VM
access switch #2 #3 #4
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 29
Agenda
Nexus 5500
Nexus 5000 & 5500 Hardware
Architecture
Layer 3
Nexus 2000 (N2K)
Virtualized Switch
Nexus Fabric
FCoE
NIV
Presentation_ID © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 30
Cisco FEXlink: Virtualized Access Switch
Nexus 2000 Fabric Extender
Nexus 5000
Nexus 5000/2000 Virtualized Access Parent Switch
Switch provides a number of design
options to address evolving Data Centre
requirements
Nexus 2000 Fabric Extender operates as
a remote line card in the Virtualized
switch
Nexus 2000 server ports are ports on the
Nexus 5000
Centralized management and
configuration of all ports on the Nexus
5000
Fabric Extender provides for flexibility in
the design of the physical topologies 10GE Fabric Links
Nexus 2000 Fabric
Extender
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 31
What is FEX
Presentation_ID © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 32
Cisco FEXlink: Virtualized Access Switch
Parent Switch provides the forwarding functionality
Nexus parent switch provides the forwarding functionality for the
Virtualized Access Switch
Upgrading the parent switch upgrades the capabilities of the entire
virtualized Access switch
Migrating “Supervisor”
Parent Switches Upgrade
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 33
Cisco FEXlink: Virtualized Access Switch
Upgrade Flexibility
Virtualized Access Switch provides for additional flexibility for end station
migration
Addition or replacement of Nexus 2000 upgrades the ‗line cards‘ for the
virtualized switch
“Line Card”
Upgrade
...
Virtualized Switch
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 35
Virtualized Access Switch
Packet Forwarding Overview
2 3 4 5
3. Nexus 5000 UPC 4. If required
performs ingress egress queuing 6. VNTag stripped
1. Frame received on forwarding and and flow control and frame
N2K HIF port queuing
forwarded out on
N2K HIF port
2. Nexus 2000
appends VNTag and 5. Nexus 5000 UPC
forwards frame to appends destination
fabric uplink VNTag and forwards
frame on fabric link
36
Virtualized Access Switch
Switching Morphology—Is this Really Different?
Nexus 2000 Nexus 5000 Nexus 2000
Fabric ASIC
Port ASIC Port ASIC
& DFC &
Buffers Buffers
PFC
37
Virtualized Access Switch
Packet Forwarding Latency
Nexus 2000 Nexus 5000 Nexus 2000
1G Store &
Ingress Unified Egress
Forward
UPC Crossbar UPC
Nexus 2000 Nexus 2000
VNTag ASIC
Cut Through Switching
Fabric in all subsequent stages
VNTag ASIC
10G Cut-Thru
5000/5500) Port
Controll
er .
Port
Controll
er
Nexus 7000
Nexus 5000 UCS 6100
Unified
Access
Layer
Direct Attach
10GE Nexus
4000 Cisco
Nexus Nexus Nexus
2000 2000 2000 UCS
* Scalability for Number of Routes, PACL/VACL/RACL for Nexus 7000 is based on M1 line card, N7K-M132XP-12 or N7K-M132XP-12XL
** Scalability for Number of Routes, PACL/VACL/RACL for Nexus 5000 is dependent on selection of parent switch, Nexus 5000 or Nexus 5500
Presentation_ID © 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential
Agenda
Nexus 5500
Nexus 5000 & 5500 Hardware
Architecture
Layer 3
Nexus 2000 (N2K)
Virtualized Switch
Nexus Fabric
FCoE
NIV
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 42
Unified Fabric
Fibre Channel over Ethernet (FCoE)
FCoE Benefits
Mapping of FC Frames over Fewer Cables
Ethernet Both block I/O & Ethernet
traffic co-exist on same cable
Enables FC to Run
on a Lossless Fewer adapters needed
Ethernet Network
Overall less power
Ethernet Interoperates with existing
SAN‘s
Fibre Management of SAN‘s
Channel remains constant
Traffic
No Gateway
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 43
Virtualized Access Switch
Unified Fabric and FCoE FC
Nexus
Consolidated Adapters, Cabling and 5000/5500
Switching at the first hop in the fabrics
Nexus 5000 as
FCF or as NPV
The Unified Edge supports multiple device
LAN and SAN topology options
Virtualized Data Center LAN designs
Fibre Channel edge with direct
Nexus 2232
attached initiators and targets 10GE FEX
Generation 2 CNAs
44
FCoE Multi-Tier Fabric Design
Extending FCoE past the Unified Edge
Extending FCoE Fibre Channel fabrics LAN Fabric
Fabric A Fabric B
beyond direct attach initiators can be
achieved in two basic ways
FCF
Extend the Unified Edge
VE
Add DCB enabled Ethernet switches
Using FCoE
between the VN and VF ports (stretch for ISL
the ‗link‘ between the VN_Port and the between FC
VE
VF_Port) Switches
FCF
Extend Unified Fabric capabilities into the Switch Mode
SAN Core VF
Extending
FCoE into a
Leverage FCoE wires between Fibre multi-hop
Channel switches (VE_Ports) Ethernet
‘Access’ Fabric
What design considerations do we have
when extending FCoE beyond the edge?
VN DCB + FIP
High Availability Snooping
Bridge
Oversubscription for SAN and LAN
Ethernet layer 2 and STP design
45
Virtualized Access Switch
Enhanced IEEE DCB Service Lanes
Configs for
Pause Threshold Resume
3000m no-drop Buffer size
(XOFF) Threshold (XON)
class
Fully compatible with virtualized Servers, NAS, FC, Servers, NAS, FC,
access switch and will Co-exist with FCoE attached FCoE attached
Storage Storage
FabricPath and/or Layer 3 designs
47
Agenda
Nexus 5500
Nexus 5000 & 5500 Hardware
Architecture
Layer 3
Nexus 2000 (N2K)
Virtualized Switch
Nexus Fabric
FCoE
NIV
48
Virtualized Access Switch
Network Interface Virtualization
NIV allows a single physical PCIe
device to be virtualized into
multiple different PCIe devices
Provides true traffic segregation in
hardware without need for VLANs
or QinQ tags
Virtual Interfaces can be Ethernet
NICs or Fibre Channel HBAs and
presented as individual PCIe
devices at the host level
VN-Tag Enforces the value proposition of
& VIC FCoE, but can support iSCSI and
vNIC vNIC vNIC
Protocol NFS services
Driven to standards through IEEE
802.1Qbh working group
vHBA vHBA
Note: Not All Designs Supported in the NIV Architecture Are Currently Implemented
50
Nexus 5500 Virtualized Access Switch
Why virtualized adapters?
Nexus 5000
Any network interface can be virtualized
1 2 3 4 5 6 7 8
(FEX, adapter)
Enables external switch to forward frames
that ―belong‖ to the same physical port by
1 2 3 4 5
using VNTag
Under standardization - 802.1Qbh
1
51
Nexus 5500 Virtualized Access Switch
Technologies related to VN-Link
52
Agenda
Nexus 5500
Nexus 5000 & 5500 Hardware
Architecture
Layer 3
Nexus 2000 (N2K)
Virtualized Switch
Nexus Fabric
FCoE
NIV
53
54