Sie sind auf Seite 1von 67

CHAPTER-3

FIBRE CHANNEL
STORAGE AREA
NETWORK (FC SAN)

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 1
Business Needs and Technology Challenges
• An effective information management solution must provide:
 Just-in-time information to business users
 Flexible and resilient storage infrastructure
• Information management challenges in DAS environment:
 Explosive growth of information storage that remains isolated and
underutilized
 Proliferation of new servers and applications
 Complexity in sharing storage resources across multiple servers
 High cost of managing information
• Storage area network (SAN) addresses these challenges

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 2
What is a SAN?
SAN

It is a high-speed, dedicated network of servers and shared storage devices.

• Centralizes storage and management


• Enables sharing of storage resources across multiple servers at
block level
• Meets increasing storage demands efficiently with better
economies of scale
• Common SAN deployments are:
 Fibre Channel (FC) SAN: uses FC protocol for communication
 IP SAN: uses IP-based protocols for communication

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 3
Understanding Fibre Channel
• High-speed network technology
 Latest FC implementation supports speed up to 16 Gb/s
• Highly scalable
 Theoretically, accommodate approximately 15 million devices

IP
Network FC SAN

Clients Application Servers Storage Arrays

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 4
Components of FC SAN
• Node (server and storage) ports
• Cables
• Connectors
• Interconnecting devices such as FC switches and hubs
• SAN management software

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 5
Node Ports
• Provide physical interface for communicating with other nodes
• Exist on
 HBA in server
 Front-end adapters in storage
• Each port has a transmit (Tx) link and a receive (Rx) link

Node
Tx
Port 0 Rx
Port 0
Link
Port 1

Port n

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 6
Cables
• SAN implementation uses
 Copper cables for short distance
 Optical fiber cables for long distance
• Two types of optical cables: single-mode and multimode
Cladding Core Cladding Core

Single-mode Multimode
Light In Light In

Carries single Can carry multiple beams


beam of light of light simultaneously
(a) Multi-mode Fiber (b) Single-mode Fiber
Single-mode Fiber

Distance up to Used for short distance


Cladding Core
10km (Modal dispersion
weakens signal strength Light In
after certain distance )
(a) Multi-modeFiber
Multimode Fiber

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 7
Connectors
• Attached at the end of a cable
• Enable swift connection and disconnection
of the cable to and from a port Standard Connector
• Commonly used connectors for fiber optic
cables are:
 Standard Connector (SC)
 Duplex connectors
 Lucent Connector (LC) Lucent Connector

 Duplex connectors
 Straight Tip (ST)
 Patch panel connectors
 Simplex connectors
Straight Tip Connector

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 8
Interconnecting Devices
• Commonly used interconnecting devices in FC SAN are:
 Hubs, switches, and directors
• Hubs provide limited connectivity and scalability
• Switches and directors are intelligent devices
 Switches are available with fixed port count or modular design
 Directors are always modular, and its port count can be increased
by inserting additional 'line cards' or 'blades'
 High-end switches and directors contain redundant components

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 9
SAN Management Software
• A suite of tools used in a SAN to manage
interfaces between host and storage arrays
• Provides integrated management of SAN
environment
• Enables web-based management using GUI
or CLI

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 10
FC Interconnectivity Options
• Point-to-Point
• Fibre Channel Arbitrated Loop (FC-AL)
• Fibre Channel Switched Fabric (FC-SW)

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 11
Point-to-Point Connectivity
• Enables direct connection between nodes
• Offers limited connectivity and scalability
• Used in DAS environment Servers

Server

Server

Storage Array

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 12
FC-AL Connectivity
• Provides shared loop to attached nodes Servers

 Nodes must arbitrate to gain control


• Implemented using ring or star topology Server

• Limitations of FC-AL
 Only one device can perform I/O operation at a
time
 Supports up to 126 nodes
FC Hub
 Addition or removal of a node causes
momentary pause in loop traffic

Storage Array

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 13
FC-SW Connectivity
• Creates a logical space (called fabric) in which all nodes
communicate with one another using switches
 Interswitch links (ISLs) enable switches to be connected together
• Provides dedicated path between nodes
• Addition/removal of node does not affect traffic of other nodes
Servers
Storage Array

FC Switch FC Switch

Server Interswitch Links

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 14
Port Types in Switched Fabric

Server

N-Port

F-Port
FC Switch FC Switch

F-Port E-Port E-Port F-Port


ISL
N-Port N-Port

Storage Array Storage Array

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 15
FC Architecture Overview
• Provides benefits of both channel and network technologies
 Provides high performance with low protocol overheads
 Provides high scalability with long distance capability
• Implements SCSI over FC network
 Transports SCSI data through FC network
• Storage devices, attached to SAN, appear as local storage devices
to host operating system

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 16
Fibre Channel Protocol Stack
Upper Layer Protocol
Example: SCSI, HIPPI, ESCON, ATM, IP

FC-4 Upper Layer Protocol Mapping

FC-2 Framing/Flow Control

FC-1 Encode/Decode

FC-0 1 Gb/s 2 Gb/s 4 Gb/s 8 Gb/s 16 Gb/s

FC Layer Function Features Specified by FC Layer


Mapping upper layer protocol (e.g. SCSI)
FC-4 Mapping interface
to lower FC layers
FC-3 Common services Not implemented
Frame structure, FC addressing, flow
FC-2 Routing, flow control
control
8b/10b or 64b/66b encoding, bit and
FC-1 Encode/decode
frame synchronization
FC-0 Physical layer Media, cables, connector

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 17
FC Addressing in Switched Fabric
• FC Address is assigned to nodes during fabric login
 Used for communication between nodes within FC SAN
• Address format

• Domain ID is a unique number provided to each switch in the


fabric
 239 addresses are available for domain ID
• Maximum possible number of node ports in a switched fabric:
 239 domains X 256 areas X 256 ports = 15,663,104

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 18
World Wide Name (WWN)
• Unique 64 bit identifier
• Static to node ports on an FC network
 Similar to MAC address of NIC
 WWNN and WWPN are used to uniquely identify nodes and ports
respectively

World Wide Name - Array


5 0 0 6 0 1 6 0 0 0 6 0 0 1 B 2
0101 0000 0000 0110 0000 0001 0110 0000 0000 0000 0110 0000 0000 0001 1011 0010

Format Company ID Port Model Seed


Type 24 bits 32 bits

World Wide Name - HBA


1 0 0 0 0 0 0 0 c 9 2 0 d c 4 0
Format Reserved Company ID Company Specific
Type 12 bits 24 bits 24 bits

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 19
Structure and Organization of FC Data
• FC data is organized as Exchange, Sequence, and Frame
FC Data
Description
Structure
• Enables two N_Ports to identify and manage a set of
information units
• Information unit: upper layer protocol-specific information
Exchange
that is sent to another port to perform certain operation
• Each information unit maps to a sequence
• Includes one or more sequences
• Contiguous set of frames that correspond to an information
Sequence
unit
• Fundamental unit of data transfer
Frame • Each frame consists of five parts: SOF, frame header, data field,
SOF CRC, and
Frame EOF
Header Data Field CRC EOF
4 Bytes 24 Bytes 0 - 2112 Bytes 4 Bytes 4 Bytes

FC Frame

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 20
Fabric Services
• FC switches provide fabric services as defined in FC standards

Fabric
Description
Services
Fabric Login • Used during the initial part of the node’s fabric login process
Server • Located at pre-defined address of FFFFFE
• Responsible for name registration and management of node ports
Name Server
• Located at pre-defined address FFFFFC
• Responsible for managing and distributing Registered State
Change Notifications (RSCNs) to attached node ports
Fabric
• Responsible for distributing SW-RSCNs to every other switch
Controller
− SW-RSCNs keep the name server up-to-date on all switches
• Located at pre-defined address FFFFFD
Management • Enables FC SAN management using fabric management software
Server • Located at pre-defined address FFFFFA

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 21
Login Types in Switched Fabric
• Fabric login (FLOGI)
 Occurs between an N_Port and an F_Port
 Node sends a FLOGI frame with WWN to Fabric Login Server on
switch
 Node obtains FC address from switch
 Immediately after FLOGI, N_Port registers with Name Server on
switch, indicating its WWN, port type, assigned FC address, etc.
 N_Port queries name server about all other logged in ports
• Port login (PLOGI)
 Occurs between two N_Ports to establish a session
 Exchange service parameters relevant to the session
• Process login (PRLI)
 Occurs between two N_Ports to exchange ULP related parameters

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 22
Fibre Channel Storage Area Network
(FC SAN)

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 23
Mesh Topology Full Mesh
FC Switches

• Full mesh
 Each switch is connected to every other Server

switch
 Maximum of one ISL or hop is required
for host-to-storage traffic
 Host and storage can be connected to Storage Array

any switch Partial Mesh

• Partial mesh FC Switches

 Not all the switches are connected to


every other switch Server

Storage Array

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 24
Core-edge Topology
• Consists of edge and core FC Switch
Edge Tier
FC Switch FC Switch
switch tiers
• Network traffic traverses
core tier or terminate at
core tier Server FC Director
• Storage is usually Core Tier Storage Array

connected to the core tier


Edge Tier
• Benefits FC Switch FC Switch FC Switch

 High availability
 Medium scalability
 Medium to maximum
connectivity Server FC Director FC Director
Storage Array
Core Tier

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 25
Zoning
Zoning
It is an FC switch function that enables node ports within the fabric to be
logically segmented into groups, and communicate with each other within
the group.

• Zone set comprises zones Zone 1

• Each zone comprises zone


members (HBA and array Server
ports)
FC SAN
• Benefits
 Restricts RSCN traffic Storage Array
 Provides access control
Array port

Zone 2
Servers HBA Port

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 26
Types of Zoning

Servers Switch Domain ID = 15

Port 5

Zone 2

Port 1
WWN 10:00:00:00:C9:20:DC:40 FC Switch Storage Array

Port 12
Port 9
Zone 3

WWN 10:00:00:00:C9:20:DC:56

WWN 50:06:04:82:E8:91:2B:9E

Zone 1

WWN 10:00:00:00:C9:20:DC:82 Zone 1 (WWN Zone) = 10:00:00:00:C9:20:DC:82 ; 50:06:04:82:E8:91:2B:9E


Zone 2 (Port Zone) = 15,5 ; 15,12
Zone 3 (Mixed Zone) = 10:00:00:00:C9:20:DC:56 ; 15,12

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 27
Single HBA Zoning
• Optimally, one HBA per zone.
 Nodes can only “talk” to Storage in the same zone
• Storage Ports may be members of more than one zone.
• HBA ports are isolated from each other to avoid potential
problems associated with the SCSI discovery process.
 Also known as “chatter”
• Decreases the impact of a changes in a Fabric by reducing the
amount of nodes that must communicate.

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Storage Area Networks (SAN) - 28
Fibre Channel Storage Area Network
(FC SAN)

Virtualization in SAN

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 29
Block-level Storage Virtualization
• Provides a virtualization
Servers

layer in SAN Server

• Abstracts block storage


devices and creates a
storage pool by
aggregating LUNs FC SAN

• Virtual volumes are Virtual Volume Virtualization


Appliance
created from storage pool
and assigned to hosts
 Virtualization layer maps
virtual volumes to LUNs
• Benefits LUN Storage Pool LUN

 Online volume expansion


LUN LUN
 Nondisruptive migration
Storage Array Storage Array

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 30
Block-level Storage Virtualization
• Provides a virtualization
Servers

layer in SAN Server

• Abstracts block storage


devices and creates a
storage pool by
aggregating LUNs FC SAN

• Virtual volumes are Virtual Volume Virtualization


Appliance
created from storage pool
and assigned to hosts
 Virtualization layer maps
virtual volumes to LUNs
• Benefits: LUN Storage Pool LUN

 Online volume expansion


LUN LUN
 Nondisruptive migration
Storage Array Storage Array

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 31
Virtual SAN (VSAN)/Virtual Fabric
VSAN
VSAN 10 VSAN 20
It is a logical fabric on an FC SAN, Servers Servers
enabling communication among a
group of nodes, regardless of their Server Server
physical location in the fabric.

• Each VSAN has its own fabric


services (name server, zoning),
configuration, and set of FC FC SAN
addresses
• VSANs improve SAN security,
scalability, availability, and
manageability
Storage Array Storage Array

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 33
Fibre Channel Storage Area Network (FC SAN)

Concept in Practice:

• EMC Connectrix
• EMC VPLEX

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 34
EMC Connectrix
• Connectrix family includes networked storage connectivity
products
 Offers high-speed FC connectivity, highly resilient switching
technology, intelligent IP storage networking, and I/O
consolidation with Fibre Channel over Ethernet
• Connectrix family consist of enterprise directors, departmental
switches, and multi-purpose switches

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 35
Switches versus Directors

• Connectrix Switches • Connectrix Directors


 High availability through  “Redundant everything”
redundant deployment provides optimal
 Redundant fans and power serviceability and highest
supplies availability
 Departmental deployment  Data center deployment
or part of Data Center  Maximum scalability
deployment  Maximum performance
 Small to medium fabrics  Large fabrics
 Multi-protocol possibilities  Multi-protocol

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Storage Area Networks (SAN) - 36
Connectrix Switch - DS-220B

• Provides eight, 12, or 16 ports


 Auto-detecting 1, 2, and 4 Gb/s Fibre Channel ports
 Single, fixed power supply
 Field-replaceable optics
 Redundant cooling
• Simplified setup—no previous SAN experience needed
 Eliminates the need for advanced skills to manage IP addressing or
Zoning

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Storage Area Networks (SAN) - 37
Connectrix Director – MDS 9509

• Multi-transport switch—Fibre
Channel, FICON, iSCSI, FCIP
 16 to 224 Fibre Channel ports
 4–56 Gigabit Ethernet ports for iSCSI
or FCIP
 Non-blocking fabric
 1 / 2 Gb/s auto-sensing ports
• All components are fully redundant

MDS-9509

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Storage Area Networks (SAN) - 38
Connectrix Management Interfaces

MDS-Series
Fabric Manager

M-Series
Web Server

B-Series
Web Tools

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Storage Area Networks (SAN) - 39
EMC VPLEX
• Provides solution for block-level storage virtualization and data
mobility – both within and across data centers
• Enables multiple hosts located across two locations to access a
single copy of data
• Provides capability to mirror a virtual volume – both within and
across locations
 Allows hosts at different data centers to simultaneously access
cache-coherent copies of the same virtual volume
• VPLEX family consists of three products
 VPLEX Local
 VPLEX Metro
 VPLEX Geo

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 40
IP SAN AND FCOE

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 43
Drivers for IP SAN
• IP SAN transports block-level data over IP network
• IP is being positioned as a storage networking option because:
 Existing network infrastructure can be leveraged
 Reduced cost compared to investing in new FC SAN hardware and
software
 Many long-distance disaster recovery solutions already leverage IP-
based network
 Many robust and mature security options are available for IP
network

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 44
IP SAN Protocol: iSCSI
• IP based protocol that is used to connect host and storage
• Encapsulates SCSI commands and data into an IP packet and
transports them using TCP/IP

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 45
Components of iSCSI
• iSCSI initiator
 Example: iSCSI HBA
• iSCSI target
 Storage array with iSCSI port
 iSCSI gateway – enables communication with FC storage array
• IP network iSCSI Gateway
Storage Array
Server

IP
FC Port
iSCSI HBA

iSCSI Port

Storage Array

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 46
iSCSI Host Connectivity Options
• Standard NIC with software iSCSI initiator
 NIC provides network interface
 Software initiator provides iSCSI functionality
 Requires host CPU cycles for iSCSI and TCP/IP processing
• TCP Offload Engine (TOE) NIC with software iSCSI initiator
 Moves TCP processing load off the host CPU onto the NIC card
 Software initiator provides iSCSI functionality
 Requires host CPU cycles for iSCSI processing
• iSCSI HBA
 Offloads both iSCSI and TCP/IP processing from host CPU
 Simplest option for boot from SAN

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 47
iSCSI Topologies: Native iSCSI
• iSCSI initiators are either directly attached to storage array or
connected through IP network
 No FC component
• Storage array has iSCSI port
• Each iSCSI port is configured with an IP address

IP
Server Storage Array
iSCSI HBA iSCSI Port

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 48
iSCSI Topologies: Bridged iSCSI
• iSCSI gateway is used to enable communication between iSCSI
host and FC storage
• iSCSI gateway works as bridge between FC and IP network
 Converts IP packets to FC frames and vice versa
• iSCSI initiator is configured with gateway’s IP address as its target
• iSCSI gateway is configured as FC initiator to storage array
iSCSI Gateway

IP
Server
iSCSI HBA

FC SAN
Storage Array
Server FC HBA FC Port

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 49
Combining FC and Native iSCSI Connectivity
• Array provides both FC and iSCSI ports
 Enable iSCSI and FC connectivity in the same environment
 No bridge devices needed

iSCSI Port

IP
Server
iSCSI HBA

FC SAN
Storage Array
FC Port
Server FC HBA

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 50
iSCSI Protocol Stack
OSI Model iSCSI Initiator iSCSI Target

Layer 7 Application SCSI Commands and Data SCSI

Layer 5 Session iSCSI Login and Discovery iSCSI

Layer 4 Transport TCP Windows and Segments TCP

Layer 3 Network IP Packets IP

Layer 2 Data Link Ethernet Frames Ethernet

Interconnect

Ethernet IP TCP iSCSI SCSI Data

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 51
iSCSI Discovery
• For iSCSI communication, initiator must discover location and
name of target on a network
• iSCSI discovery takes place in two ways:
 SendTargets discovery
 Initiator is manually configured with the target’s network portal
 Initiator issues SendTargets command; target responds with required
parameters
 Internet Storage Name Service (iSNS)
 Initiators and targets register themselves with iSNS server
 Initiator can query iSNS server for a list of available targets

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 52
iSCSI Name
• iSCSI name is a unique iSCSI identifier that is used to identify
initiators and targets within an iSCSI network
• Two common types of iSCSI names are:
 iqn: iSCSI Qualified Name
 iqn.2008-02.com.example:optional_string
 eui: Extended Unique Identifier
 eui.0300732A32598D26

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 53
IP SAN Protocol: FCIP
• IP-based protocol that is used to connect distributed FC SAN
islands
• Creates virtual FC links over existing IP network that is used to
transport FC data between different FC SANs
• Encapsulates FC frames onto IP packet
• Provides disaster recovery solution

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 54
FCIP Topology
Servers Servers

Server Server

FCIP Gateway FCIP Gateway

FC SAN FC SAN

IP

Storage Array Storage Array

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 55
FCIP Protocol Stack
Application

SCSI Commands, Data, and Status FC Frame

FCP (SCSI over FC)

FCIP

TCP FC to IP Encapsulation

IP

Physical Media

SOF FC SCSI Data CRC EOF


FC Frame Header

FCIP Encapsulation

IP TCP FCIP
IP Packet Header Header Header IP Payload

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 56
Fibre Channel over Ethernet (FCoE)

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 57
Drivers for FCoE
• FCoE is a protocol that transports FC data over Ethernet network
(Converged Enhanced Ethernet)
• FCoE is being positioned as a storage networking option
because:
 Enables consolidation of FC SAN traffic and Ethernet traffic onto a
common Ethernet infrastructure
 Reduces the number of adapters, switch ports, and cables
 Reduces cost and eases data center management
 Reduces power and cooling cost, and floor space

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 58
Data Center Infrastructure – Before Using FCoE
Servers Servers

Server Server

FC IP
Switches Switches

FC
Switches LAN

Storage Array Storage Array

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 59
Data Center Infrastructure – After Using FCoE
Servers Servers

Server Server

FCoE
Switches

FC
Switches LAN

Storage Array Storage Array

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 60
Components of an FCoE Network
• Converged Network Adapter (CNA)
• Cable
• FCoE switch

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 61
Converged Network Adapter (CNA)
• Provides functionality of both – a
standard NIC and an FC HBA
 Eliminates the need to deploy separate
adapters and cables for FC and Ethernet
communications
• Contains separate modules for 10 Gigabit
Ethernet, FC, and FCoE ASICs
 FCoE ASIC encapsulates FC frames into
Ethernet frames

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 62
Cable
• Two options are available for FCoE cabling
 Copper based Twinax cable
 Standard fiber optical cable

Twinax Cable Fiber Optical Cable


Suitable for shorter distances (up Can run over longer distances
to 10 meters)
Requires less power and are less Relatively more expensive than
expensive than fiber optical cable Twinax cables

Uses Small Form Factor Uses Small Form Factor


Pluggable Plus (SFP+) connector Pluggable Plus (SFP+) connector

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 63
FCoE Switch
• Provides both Ethernet and
FC switch functionalities FC Port FC Port FC Port FC Port

• Consists of FCF, Ethernet


bridge, and set of CEE ports Fibre Channel Forwarder (FCF)
and FC ports (optional)
 FCF encapsulates and de-
encapsulates FC frames Ethernet Bridge

• Forwards frames based on


Ethertype Ethernet Ethernet Ethernet Ethernet
Port Port Port Port

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 64
FCoE Frame Mapping

OSI Stack

7 - Application
FCoE Protocol Stack FC Protocol Stack

6 - Presentation FC - 4 FC - 4 Protocol map

5 - Session FC Layers FC - 3 FC - 3 Services

4 - Transport FC - 2 FC - 2 Framing

3 - Network FCoE Mapping FC - 1 Data enc/dec

2 - Data Link 2 - MAC FC - 0 Physical


IEEE 802.1q
Layers
1 - Physical 1 - Physical
Ethernet

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 65
Converged Enhanced Ethernet
• Provides lossless Ethernet
• Lossless Ethernet requires following functionalities:
 Priority-based flow control (PFC)
 Enhanced transmission selection (ETS)
 Congestion notification (CN)
 Data center bridging exchange protocol(DCBX)

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 66
Priority-Based Flow Control (PFC)
• Creates eight virtual links
on a single physical link
• Uses PAUSE capability of
Ethernet for each virtual
link
 A virtual link can be
paused and restarted
independently
 PAUSE mechanism is
based on user priorities
or classes of service

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 67
Enhanced Transmission Selection (ETS)
• Allocates bandwidth to different traffic classes such as LAN, SAN,
and Inter Process Communication (IPC)
• Provides available bandwidth to other classes of traffic when a
particular class of traffic does not use its allocated bandwidth

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 68
Congestion Notification (CN)
• Provides a mechanism for detecting congestion and notifying the
source
 Enables a switch to send a signal to other ports that need to stop or
slow down their transmissions
Rate limiting to avoid
packet loss
FCoE
Switch
FCoE
Switch
FCoE
Switch
Host
(Node A)

Congestion
Notification Message

Congestion Storage Array


(Node B)

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 69
Data Center Bridging Exchange Protocol (DCBX)
• Enables CEE devices to convey and configure their features with
other CEE devices in the network
 Allows a switch to distribute configuration values to attached
adapters
• Ensures consistent configuration across network

EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 6: IP SAN and FCoE 70

Das könnte Ihnen auch gefallen