Sie sind auf Seite 1von 34

Brocade Product Training

Fibre Channel Topologies, Terminology and Addressing

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

Course Objectives
After completing this module, attendees should be able to:
Identify Discuss Discuss

FC Topologies and Review key FC Terminology FC Addresses

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

Topics

FC Topologies FC Terminology FC Addressing


World Wide Names (WWNs) Port Identifiers (PIDs), also called 24-bit, S_ID, or D_ID addresses Well-known Addresses

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

Fibre Channel Topologies


Three kinds of Fibre Channel Topologies

Point-to-Point (Pt to Pt) - Allows two devices to talk Arbitrated Loop - Allows 126 devices to talk, Arbitrated Loop Physical Address (AL_PA) 00, is reserved for the Fabric Loop Port (FL_Port) Switched Fabric Allows 16 Million theoretical devices to talk

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

Point-to-Point is limited to two devices but they can talk at greater distances than SCSI allows. Arbitrated Loop is limited to 126 devices in a blocking architecture (plus one for FL_Port). Without a switch only two of these devices can talk at a time, all others are blocked until those two are done. An arbitrated loop attached to a switch allows queuing into and out of the port where the loop is attached. The embedded port will take one AL_PA, so on a Brocade switch port there are 125 available AL_PAs. Switched fabric can theoretically allow 16 million nodes to talk (16^6 There are 6 Port Identifier (PID) slots with 16 hex choices per slot)). The committee reserves million of these addresses for well known addresses and testing purposes.

Fibre Channel Topology Cont.


Point to Point (Pt to Pt)

Two devices connected together

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

Point-to-point is a simple topology that allows bi-directional communication between two nodes, in this case a storage system and a server. This topology is very similar with SCSI direct attached except it is faster and supports longer distance. Point-to-point, like all SAN topologies, benefits from a longer reach with fiber optic connections. It is clear that a point-to-point topology has its limitations, yet it has proven to be a fast and powerful method for connecting storage devices/arrays directly to the servers.

Fibre Channel Topology Cont.


Fibre Channel Arbitrated Loop (FCAL) Theoretically up to 126 devices on a shared media for small systems at reduced cost and reduced performance level Requires a port to successfully arbitrate prior to establishing a circuit to send and/or receive frames
2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

The arbitrated loop is a ring topology where each node passes data to its adjacent nodes. Like an IBM Token Ring network, the SAN hub arbitrates requests for data to make optimum use of the available bandwidth. In an Arbitrated Loop configuration, the transmitter of each node is connected to the receiver of the next node. In order to send data from one node to another, devices must arbitrate for access to the loop. The initiating device arbitrates for control of the loop. Once the device wins arbitration, it then opens a communication session with the target and sends the data. The initiating node engages in a Point-to-Point connection with the recipient node. Only one connection can be established at a time. When the data transfer is completed, the initiator closes the session and releases control of the loop, allowing other devices to arbitrate for the loop. Currently, the maximum bandwidth is 100 MB/sec Fibre Channel Arbitrated Loop - the transmit of each node is connected to the receive of the next node. Reduced cost path into FC SCSI Replacement Requires FC Hub technology Easy for vendors to develop Difficult for customers to deploy Limited possible nodes (126) plus the Loop Master (FL_Port) Lower overall throughput - 100MB maximum bandwidth Limited any to any connectivity - nodes on the loop have to arbitrate for control of the loop in order to be able to communicate with a target device on the loop. While this communication is happening all other devices are waiting to get their turn.

FC Arbitrated Loop Topology


An FCAL attached to a switch

Switch
F F FL

NL NL NL

Hub
NL

NL NL
2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

NL

This diagram shows an example of a FCAL loop attached to a switch Communication can take place between: 1. Devices on the loop. 2. A device on the loop and a device attached to the switch. (A host on the loop could access data from the Fabric-attached storage.) 3. A device attached to the switch and a device on the loop. (The Fabricattached host could write data to the storage on the loop.) Devices on the loop can either be public (capable of doing a Fabric Login called a FLOGI) or private (not capable of doing a Fabric Login called a FLOGI) If the devices are private, the switch will probe them and get them into the Fabric Name Server if possible (private host devices do not accept probes). The FL_Port that the private loop device is attached to will also provide translation of Fabric 24-bit addresses and FCAL 8-bit addresses.

Arbitrated Loop Physical Address


AL_PA

Arbitrated Loop Physical Address (AL_PA) needed to communicate An 8-bit address assigned to each device on loop Maximum of 126 AL_PAs attached to FL_Port AL_PA 00 reserved for FL_Port These 127 AL_PAs are a unique set out of the possible 256 bit patterns The lower the AL_PA, the higher the priority

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

Arbitrated Loop uses 8 bits to identify each of the devices on a loop. This is the Physical Address for the device and is known as the AL_PA. The protocol allows for 127 devices, so 126 unique AL_PAs need to exist for the NL Nodes AL_PA 00 reserved for the Switch FL_Port. Using certain bit combinations can create disparity errors so the 126 AL_PAs available for the NL_Ports are a fixed set. The next slide shows the valid AL_PA table. Not all AL_PAs are created equal. In arbitrating for control of the loop, the device with the highest priority succeeds. The lower the AL_PA assigned, the higher the priority for the device in the loop. Arbitrated Loop devices receive an AL_PA during the loop initialization process, and are described in later slides.

Valid AL_PAs
00 01 02 04 25 26 27 29 2A 2B 2C 2D 2E 10 31 32 33 34 35 36 51 52 53 54 55 56 71 72 73 74 75 76 80 81 82 84 A5 A6 A7 A9 AA AB AC AD AE 90 B1 B2 B3 B4 B5 B6 D1 D2 D3 D4 D5 D6 E0 E1 E2 E4

Highest priority

23

43 45 46 47 49 4A 4B 4C 4D 4E

63 65 66 67 69 6A 6B 6C 6D 6E

A3

C3 C5 C6 C7 C9 CA CB CC CD CE

08

17 18

88 39 3A 3C 59 5A 5C 79 7A

97 98

E8 B9 BA BC D9 DA DC

1B 1D 1E 1F

9B 7C 9D 9E 9F

0F

8F

EF

Lowest priority

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

The 8-bit addresses not shown in this table will never be used as an AL_PA for a device on the loop (03, 05, 06, etc.). The AL_PA for the FL_Port on a public loop will always be 00.

Loop Initialization
What can cause it?

10

Power On /Power On Reset Entering/Leaving a participating mode Loop failure Arbitration Wait timeout Selective Reset LIP

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

Power On / Power On Reset Loop Initialization occurs when a port is powered on or was given an equivalent reset. Enter/Leave Participating Mode A port in nonparticipating mode may, after a port dependent timeout, attempt to become a participating port. If the port is successful in obtaining an AL_PA, it can participate in loop operations after initialization completes. If the port is unsuccessful it remains in nonparticipating mode. A port already in participating mode can change to nonparticipating mode. It relinquishes the AL_PA it was assigned and makes it available for other ports to acquire. Loop Failure This may have occurred due to a port on the loop failing, being powered off, or a physical connection in the loop is broken. Arbitration Wait Timeout Excessive unfairness or a hung port may cause a port to not win arbitration. The port may use loop initialization to clear this condition. Selective reset LIP Causes the ports on the loop to do a vendor-unique reset. Usually, this is equivalent to a power-on reset.

Loop Initialization
What happens?

11

Loop initialization begins by a port transmitting LIPs All loop activity is suspended All ports enter the Open-Initializing state One port is selected as Master Ports are assigned an AL_PA Positional AL_PA map of loop is built (if supported) All ports return to Monitoring state Normal loop operations resume
2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

The Loop Initialization Primitive (LIP) is used to begin the process and suspend any activities if the loop is currently active. Receiving ports recognize the loop initialization process when at least three consecutive LIPs are received. The port enters the Open-Init state and continues to retransmit the LIPs to the next port on the loop. Once all the ports are in the Open-Init state, a series of frames are passed around the loop to determine a loop master, assign an AL_PA to each device on the loop and report the position of each device (optional). The loop returns to the monitoring state and normal loop operations can resume.

Loop Initialization
Sequence of Events
LIPs LISM LIFA LIPA LIHA LISA LIRP LILP ( ( ( ( ( ( ( (Loop Initialization Primitive Sequence) Select Master) Fabric Assigned) Previous Assigned) Hardware Assigned) Software Assigned) Report Position (if supported)) Loop Position (if supported))

12

FC Frames

CLS (Close Primitive Signal ) Initialization is complete Public loop devices can log into the Fabric!
2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

LIP and CLS are Ordered Sets used to indicate states or events. Ordered Sets are special four-character combinations that have special meaning in Fibre Channel. A LIP is a Primitive Sequence Ordered Set. Primitive Sequences are used to indicate states or conditions and are normally transmitted continuously until something causes the current state to change. CLS is a Primitive Signal Ordered Set. Primitive Signals are used to indicate events or actions and are normally transmitted once. LISM is a frame that each device enters on the loop. It will determine the device that becomes the loop master. This port controls the rest of the loop initialization process. LIFA, LIPA, LIHA, LISA are frames passed around the loop for devices to have their AL_PA assigned. LIRP and LILP are also frames that are passed around the loop but are used to allow the reporting of the position of the device on the loop. This is an optional step in the loop initialization process. It allows any device to learn not only the AL_PA of all the devices but the order in which they occur on the loop. There are different types of LIP sequences: LIP(F7,F7) - loop port in initialization state does not have an AL_PA LIP(F7,AL_PS) - loop port identified by AL_PS requests loop initialization LIP(F8, F7) - loop port, without a valid AL_PA (thus the F7), in the initializing state, requests loop initialization due to loop failure LIP(F8,AL_PS) - loop port identified by AL_PS detects loop failure LIP(AL_PD,AL_PS) - used to perform a vendor specific reset at loop port AL_PD, AL_PS port originated the request

Fibre Channel Topology Cont.


Switched Fabric
Switch Fabric Topology: Highest performance level High scalability Good fault isolation Embedded management and services Up to 239 unique domains (switches) with: Unique switch names Unique IP addresses Same fabric.ops 1 parameters

13

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

Switched fabric - An extensive storage network in which large numbers of servers and storage systems are connected using Fibre Channel switches. Switches can be cascaded and combined with loops to create highly interwoven networks known as fabrics. Fortunately, these complex solutions can be kept under control by software that takes advantage of SAN management capabilities built directly into the fabric. Switched SAN Fabrics Fullest FC Network topology Require FC Switch technology Difficult for vendors to develop Easy for customers to deploy Maximum possible nodes (16 Million or 224 theoretical) Higher overall aggregate throughput - each connection to the switch is 100 or 100 MB per second. Enterprise any to any connectivity - Any device on the switch/Fabric can communicate with any other device on the Fabric Scaling is easy as switches can be connected together in various topologies. The result is a Fibre Channel Fabric. Footnote 1: fabric.ops parameters contain configurable parameters that need to be the same on all Fabric switches, examples include: fabric.ops.dataFieldSize: 2112 <Output truncated> fabric.ops.mode.pidFormat: <Output truncated> 1

Fibre Channel Terminology Review


Terminology will be defined throughout the course but some basics would be helpful: Fabric A Fabric is a connection of Fibre Channel switches and/or devices capable of routing frames using only a destination identifier (D_ID) A Fabric is commonly pictured as a cloud

14

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

The term Fabric can also refer to the physical switches, or to a set of global software components such as the routing tables, zoning configuration, and name server.

Fibre Channel Terminology Cont.

15

Nodes Transmit and Receive information via one or more ports which provide the physical connection(s) for the nodes Ports Separate transmit (tx) and receive (rx) functions

Tx encodes and transforms data to serial format Rx recovers clock from serial data received, decodes and deserializes the data

Node I

Tx

Tx

Node II

Nx_Port A
Rx

Nx_Port B
Rx

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

Each Node has a unique 64-bit address called Node World Wide Name. The format of this 64-bit identifier along with the format for the port on this nodes 64-bit identifier are specified by IEEE. Each Port also has a unique 64-bit address called Port World Wide Name. N_Ports are node ports that can either attach to other N_Ports or to Fabric Ports (F_Port). Nx_Ports could either be N_Ports (x not used) or NL_Ports (Node Loop Ports) used in the Arbitrated Loop topology. Each Nx_Port also has a 24-bit address also referred to as: port identifier (PID), Source Identifier (S_ID) when its used as a source in FC communications and Destination Identifier (D_ID) when its used as a destination address in FC communications. The PID is assigned to the port when it logs into the fabric (FLOGI).

Deciphering FC Addresses
More FC Terms

16

Node and port names Fixed 64 bit addresses used to uniquely identify Fabric devices also referred to as node and/or port world wide name (WWN) Fabric Address Required address, needed for devices and services to communicate, also referred to as

Port identifiers (PIDs) 24-bit addresses Source ids (S_ID) or destination ids (D_ID)

Well-Known Addresses The Fabric addresses used for accessing Fabric services Fabric Services Intelligent services provided by a Fabric, necessary for Fabric operation (more on these in next module)

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

FC Addresses - FC layers
Compare to OSI layers:

17

PID, 24 bit, S_ID / D_ID

Node / Port WWNs


2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

Node WWN Name Format


Assigned by IEEE

18

10:00:00:60:69:50:60:02
Single hexadecimal Name Assignment Authority (NAA) digit (Brocade uses a 1) FC Standard reserved

Assigned by the vendor

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

Based on the IEEE Standard format, a typical SilkWorm Node WWN is: 10:00:00:60:69:xx:xx:xx Where: The first 2 bytes are always 10:00 (format 1 addressing); The next 3 bytes are vendor specific. Brocade was assigned 00:60:69; The last 3 bytes are derived from the Brocade SilkWorm main board; The 3 byte company ID found in the 64 bit IEEE Standard format WWN can be searched at: http://standards.ieee.org/regauth/oui/index.html The 1st 4 bits of FC 64-bit addresses identify the authority responsible for administration of that address or the Name Assignment Authority (NAA). A subset of NAA address authority denotes the naming convention used. FC-PH Rev 4.3 Fibre Channel standards table 41 define the NAA identifiers. Brocade uses a HEX 1 in the first 4 bits this translates to a binary 0001 and tells you that the Brocade node address represents an IEEE format 1 name which is based directly on the 48-bit MAC address in the middle 3 bytes of 64-bit address (Brocades = 00:60:69). See the notes on the next slide for a list of ommon NAA identifiers.

Port WWN Name Format


Assigned by IEEE

19

20:00:00:60:69:50:60:02
Single hexadecimal Name Assignment Authority (NAA) digit (Brocade uses a 2) Three hex digits usually set by the vendor to uniquely identify a port on a device or switch

Assigned by the vendor

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

Fabric Port Name 2p:pp:00:60:69:xx:xx:xx The next 3 nibbles (p:pp) are used by Brocade to show the switch port number. 20:04:00:60:69:1f:25:e6 The 0:04 which means this is port 4 on the switch Common NAA identifiers include: HEX
1

Binary
0001

NAA description
Address based on IEEE 48-bit address (middle 3 bytes of 8-byte (64-bit) address (WWN) - referred to as address format 1. Brocades = 00:60:69

0010

A format 2 address based on the same IEEE address described in NAA HEX 1 identifier but used to define ports associated with a node using IEEE address format 1. Format 5 IEEE registered addressing was added in FC-PH3 standards to extend the number of vendor addresses beyond NAA = Ox1. Format 5 allows vendors to uniquely use the whole address space (all bits) as a Vendor-Specific IDentifier (VSID).

0101

FC Device Node / Port WWNs


Switch Main Board Node WWN: 10:00:00:60:69:50:60:02 Switch Port 3 WWN: 20:03:00:60:69:50:60:02

20

Each

port on the switch will have a unique port WWN

A A

node WWN is often referred to as node name port WWN is often referred to as port name
2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

FC Device Node / Port WWNs Cont.


Switch Main Board Node WWN: 10:00:00:60:69:50:60:02 Switch Port 3 WWN: 20:03:00:60:69:50:60:02
HBA

21

HBA Node WWN: 10:00:12:34:56:00:10:0E

HBA Port 1 WWN: 11:00:12:34:56:00:10:0E HBA Port 2 WWN: 12:00:12:34:56:00:10:0E


2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

Not all Fabric devices assign port WWNs the same. The fictitious HBA vendor pictured above used the 2nd nibble of the first byte to designate port numbers while Brocade switch port WWNs use the 2nd nibble of the 2nd byte to designate ports in WWN addressing.

FC Addresses Analogy
Telephone Numbers for FC Devices

22

Telephone Service:

Telephone number to call Your telephone number Telephone service (accessed with your telephone number)

Fabric Service:

Destination ID (the Fabric address of whom you want to communicate with) Source ID (your Fabric address) Fabric service

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

FC Addresses

23

Fabric addresses are 24-bits (3 bytes long) A devices Fabric address indicates: The switch and port number to which the device is connected The FC-type of device (Fabric or loop) Fabric addresses are represented in hexadecimal format (0x) which often appear before the address Fabric addresses come in two modes: Native and Core PID address modes

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

Native Addressing Mode: The PID format on switches running Fabric OS v2.x and v3.x could originally only support a maximum of 16 ports in one switch. The 24-bit port address format consists of three bytes defining the Domain identifier, Area address and AL_PA fields respectively. Each field can provide 00-FF addressing. The Domain ID field byte provides domain addressing 1-239. The three byte fields of the old PID format were defined as XX1YZZ, where Y was a hexadecimal number that specified a particular port on a switch and 1 was constant. When Brocade developed the ASIC for the SilkWorm 2000 series, the largest switch has 16 ports, so only half of the second byte in the Area field of the PID was required to specify ports. Core PID Addressing Mode: To support the increased port count on the higher port count products based upon Brocade Fabric OS v4.x, the new format XXYYZZ has been adopted, where YY represents a port area designator. Using the entire middle byte for the port area designator allows Brocade switches to scale up to the Fibre Channel standard maximum of 256 ports per switch. Core PID addressing mode is the default address mode on all Brocade switches with greater than 16 ports. To ensure inter-operability between Fabric OS v4.x based products and Fabric OS v2.x and v3.x based products, while maintaining compatibility with older firmware versions, a setting was created to enable the PID format to be set to use either the new format or the old format. This is commonly known as the Core Switch PID format setting.

FC Addresses Cont.

24

Each switch (Domain) is responsible for assigning unique 24 bit Fabric address (also referred to as PID, S_ID or D_ID) Address are three bytes long:

Byte Zero: Byte One: Byte One: Byte Two:


BYTE Zero Domain Number 1-239 1-239

Domain Number Area Number* Native Mode/Port Node Address


BYTE One Area Number 0-255 1 0-F

0x01 0xEF 0x0-0x255 0x0-0xF 0x00 or > 0x00


BYTE Two Node Address 00 or ALPA 00 or ALPA

*Core PID Enabled on 16 port switches


2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

FC Addresses Cont.
Address Assignment Dependency 3 Address Classifications:
Fabric Address Public Loop Address Private Loop Address

25

NN NN 00
NN NN 00 is the generic address of any Fabric device that has logged into the fabric (FLOGI). Device FLOGI response assigns 24 bit Fabric address Native Mode has 2nd byte 1st nibble with a 1 Core PID mode uses entire 2nd byte AREA

LL LL PP
Where LL LL is assigned by the Fabric at login (FLOGI); and PP = the local loop address (AL_PA) These devices 1st LIP to get 8 bit AL_PA and then FLOGI and are assigned the other 16 bits (LLLL) PP is always a non zero value
2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

00 00 PP
Device LIPs PP = the local loop address (AL_PA) Private address only use the last byte (8 bits) of the 24-bit Fabric address PP is always a non zero value

Fabric attached devices use an address format of NN NN 00, where NN NN 00 is the address of any Fabric-attached device that has logged into the fabric. This Fabric assigned address 1 byte represents the domain of the switch. the last byte (2 nibbles) is 00 indicating a Fabric device. The 2nd byte or 3rd nibble is 1 (native mode) for a 2000 series, the 2nd byte 4th nibble is the port, there are 15 possibilities (0-F). Port counts greater than 15 required a change in addressing modes, so core pid addressing was developed and the 1 offset (2nd byte, 3rd nibble) was done away with. Core PID address mode uses an AREA designation to indicate port numbers 0 256. Public Loop attached devices use an address format of LL LL PP, where LL LL is assigned by the Fabric at login; and PP = the local loop address (AL_PA). This type of address is simply a Fabric assigned address for a device attached to an FL_Port (24 bits). The value of LL LL is the same for all Public Loop devices attached to the same FL_Port and has the same meaning as NN NN Fabric addressing. Private devices use an address format of 00 00 PP, where PP = the local loop address. A Private Loop device has a 1-byte, 8-bit address, called the arbitrated loop physical address (AL_PA). This type of address is all that a Private device is capable of receiving or sending (8 bits). Therefore, the Private devices may only communicate with the devices it can see on the local loop.

Fabric Address Example 1


Native Address Mode

26

Native address mode can be used when a 3900 or 12000 is not present in the fabric: XX 1Y ZZ

XX is a value between 0x1 to 0xEF inclusive


The 1 means Native Mode (think of it as a 1 offset)

Y is the port number (0-15)


ZZ is the AL_PA for a loop device or 00 for an F_Port

A Brocade Fabric device will have low byte = 00

02 14 00
Port Number = 4 Domain (Switch) ID = 2

A 1 can be used in the upper nibble of byte #2 if port count 16

AL_PA = 00 (Non-Loop Fabric device)

Note: This is a Fabric device connected to switch domain 2, port 4

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

A sample Fabric address:021500 XX1YZZ XX=02 1 Y=5 ZZ=00 of the device Domain_ID of the switch Native mode Port # If 00, then it is an F_Port. If non-zero, then it is the AL_PA on the FL_Port.

Fabric Address Example 2


Core PID Address Mode

27

Configuration required on OS v2.6.0+ and OS v3.02+


Enables attachment to higher port count switches that use OS v4.x Configurable option under the configure command Core Switch PID Format: (0..1) [1]

This format allows interoperability for switches with port > 16 Core PID address mode is default, non configurable address mode on switches with greater than 16 ports
AREA = 21 HEX so this is port 33

0a 21 00
AL_PA = 00 (Non-Loop Fabric device) AREA Number = 21 Domain (Switch) ID = 0a = 10

Set all configurable switches to CORE PID if possible


2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

The PID format on switches running Fabric OS v2.x and v3.x could originally only support a maximum of 16 ports in one switch. The 24-bit port address format consists of three bytes defining the Domain identifier, Area address and AL_PA fields respectively. Each field can provide 00-FF addressing. The Domain ID field byte provides domain addressing 1-239. The three byte fields of the old PID format were defined as XX1YZZ, where Y was a hexadecimal number that specified a particular port on a switch and 1 was constant. When Brocade developed the ASIC for the SilkWorm 2000 series, the largest switch has 16 ports, so only half of the second byte in the Area field of the PID was required to specify ports. To support the increased port count on the higher port count products based upon Brocade Fabric OS v4.x, the new format XXYYZZ has been adopted, where YY represents a port area designator. Using the entire middle byte for the port area designator allows Brocade switches to scale up to the Fibre Channel standard maximum of 256 ports per switch. To ensure inter-operability between Fabric OS v4.x based products and Fabric OS v2.x and v3.x based products, while maintaining compatibility with older firmware versions, a setting was created to enable the PID format to be set to use either the new format or the old format. This is commonly known as the Core Switch PID format setting.

Fabric Address Example 3


Core PID, Public Loop Address Mode

28

A loop device will have a non-zero address in low byte.


AREA = 10 HEX so this is port 16

0a 10 e8
Area Number = 10 Domain (Switch) ID = 0a = 10

Loop Address = e8 (loop device)

This loop device is connected to switch 10 on port 16 and has a loop address of e8 To determine address mode on a switch with 16 or less ports, check the core PID address mode using configshow or configure commands
2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

Well-Known Addresses of Fabric Services

29

Well-Known Addresses
Fabric Login FFFFFE Directory Server FFFFFC Fabric Controller FFFFFD Time Server FFFFFB Mgmt Server FFFFFA Alias Server FFFFF8 Broadcast Server FFFFFF

Brocade Fabric Operating System

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

Every switch has reserved three byte addresses known as Well Known Addresses. The services residing at these addresses provide a service to either nodes or management applications in the fabric. Fabric Login: Before a fabric node can communicate with services on the switch or other nodes in the fabric an address is assigned by the fabric login server. Fabric addresses assigned to nodes are three bytes long and are a combination of the domain id plus the port area number of the port the node is attached to. Directory Server: The directory server/name server is where fabric/public nodes register themselves and query to discover other devices in the fabric. Fabric Controller: The fabric controller provides state change notifications to registered nodes when a change in the fabric topology occurs. Time Server: The time server sends to the member switches in the fabric the time on either the principal switch or the Primary FCS switch. Management Server: The Management server provides a single point for managing the fabric. Alias Server: The Alias server keeps a group of nodes registered as one name to handle for multicast groups Broadcast Server: This service is optional and when frames are transmitted to this address are broadcasted to all operational N and NL ports. When registration and query frames are sent to a Well Known Address a different protocol service, Fibre Channel Common Transport (FC-CT), is used. This protocol provides a simple, consistent format and behavior when a service provider is accessed for registration and query purposes.

Fibre Channel Terminology Cont.


Review
Fibre Channel uses Exchanges to send Sequences of Frames

30

The Exchange manages the transaction it contains a set of related sequences Sequences within the Exchange hold sets of related Fibre Channel frames A Frame contains a header and payload and is up to 2148 bytes An example Small Computer Serial Interface (SCSI) Read Command: Initiator
CMD (Seq u ence)

Target

One Exchange

equence) DATA IN (S uence) STATUS (Seq

Sequences of Frames
2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

An exchange can be bi-directional Sequences and frames are uni-directional

Fibre Channel Terminology Cont.


Fibre Channel Information Transfer
Sequence 3 Sequence 2 Information Units (Large Blocks) Sequence 1 Exchange (Transactions)

31

Sequence

Buffer
S O F

Buffer
Data C R C E O F

(server/storage/Work Station (WS))

N_Port A

FC Frame (Max. payload 2112 Bytes)

Frames, sequences, and exchanges can all be multiplexed


2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

This picture shows the flow of data in the Fibre Channel environment for a point-to-point connection or a Fibre Channel connection through a Fabric. One or more frames will be sent and those frames can reside in one or more sequences. The sequences reside in an Exchange. From the other point of view: Exchanges consist of sequences of frames. The flow control (throttling of data from one port to another) depends upon the class of service (COS) being used as specified during PLOGI when common service parameters where exchanged.
Exchange
Composed of 1-n non-concurrent sequences Unit- or bi-directional flow of sequences for an operation Exchanges normally uses the same ULP Exchange may be Identified by each end: Originator / Responder Exchange IDs

(OX_ID, RX_ID), RX_ID is frequently optional Exchange controls found in F_Ctl frame header field are: Seq_Init (initiating sequence); First_Seq (indicates first sequence of exchange); Last_Seq (indicates last sequence of exchange); Seq_ID (sequence identifier) Info_CAT- Unsolicited Command (information category); Exc_Contxt (indicates whether originator or responder in Exchange) Sequence Composed of 1-n Frames Unidirectional set of frames for an operation Each Sequence is identified by initiator: Sequence Identifier (SEQ_ID) Each frame within a Sequence is numbered: Sequential Count (SEQ_CNT) Other sequence controls: SOFiX (start of frame for class x used to indicate class of service this sequence is using, SOFnX is used for subsequent frames); R_CTL (routing control to indicate data, ACK (for COS 1,2,4,6 and F); End_Seq (set to 1 for last sequence); SEQ_CNT (SEQ_CNT is incremented by 1 for each data frame sent); EOF (last frame of sequence will be indicated by a EOFt) Frame:
Frame is smallest unit of transfer and is discussed in more detail in the next slide.

Header

(server/storage/WS)

N_Port B

Fibre Channel Terminology Cont.


FC-PH Generic Frame - Frame Header
FC header contains vital frame information:

32

Control information (routing, class, sequence count) Addressing (Source and Destination)

Word 0 Word 1 Word 2 Word 3 Word 4 Word 5 Word 6

Byte 0 Byte 1 Byte 2 Byte 3 R_CTL Destination ID (D_ID) CS_CTL Source ID (S_ID) Type Frame CTL SEQ_ID DF_CTL SEQ_CNT OX_ID RX_ID Parameter Payload

Important bytes:
R_CTL = Routing Control Destination Fabric Address Source Fabric Address Protocol Type:SCSI, IP Payload word that defines what is being said called command code Payloads often contain node and port names

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

R_CTL - Routing Control bits communicate the type of frame we are looking at: Extended Link Service Frame, Data Frame, and Acknowledge Frames are common. D_ID - Destination ID (Native port address or well-known address) CS_CTL - Class specific Control Field. This field is always zero for Classes 2 and 3 per the standards but may change in the future S_ID - Source ID (Native port address or well-known address) Type - Data Structure Type that describes what the data is: i.e., 01 = Extended Link Services 05 = ISO/IEC 8802-2 LLC/SNAP (IPFC) 08 = SCSI FCP 20 = Fibre Channel Services F_CTL - Frame Control. This field contains information related to the frame contents. Example: First/last sequence, passing initiative SEQ_ID - Sequence ID DF_CTL - Data Field Control. This field indicates if there are any optional headers SEQ_CNT - sequence Count - Indicates the sequential order of the frame in the sequence OX_ID - Originator ID - Exchange ID assigned by the originator RX_ID - Responder ID - The exchange ID assigned by the responder to the Exchange Data Field/Payload - This is the payload of the frame and can be from 0 to 2112 bytes in length The R_CTL byte is one of the first items to check. Note: S_ID and D_Ids are also referred to as PIDs (port identifies) or 24 bit addresses.

Summary

33

FC Topologies include Point-to-Point, Arbitrated Loop and Switched Fabric FC Terminology discussed includes Fabric, Nodes, Ports, and a review of Exchanges, Sequences and Frames FC devices have node and port WWNs FC device address classifications: Private, Fabric and Public Loop FC addresses are called Port Identifiers (PIDs), 24-bit addresses, and S_ID, or D_ID addresses Well-known Addresses are used to communicate with Fabric services The FC Frame is 2148 Bytes and includes a SOF, Header, Payload, CRC and EOF

The header contains D_ID, S_ID, OX_ID and RX_ID identifiers

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

Additional Information

34

Use resources page Internet Link section - Find SAN ED 101 link SAN Fabric Foundation, look at chapter 2 (Fibre Channel Essentials) for additional information about material presented in this module Use resources page Reference section - FC_AL Initialization presentation for detailed FC_AL initialization information

2003 Brocade Communications Systems, Incorporated. Revision0.1_FC101_2003

Das könnte Ihnen auch gefallen