Sie sind auf Seite 1von 75

PowerVM – Storage Virtualization with NPIV

Lab Services and Technical Training – Travis Haasch


© 2012 IBM Corporation
IBM Africa Institute 2013
Agenda

 IO Virtualization with VIOS


 Single VIOS with Multipath NPIV Ports
 Dual VIOS with Multipath NPIV Ports
 Highly Redundant Dual VIOS with Multipath NPIV Ports
 High Availability with Storage & Zoning Design
 Fiber Channel & NPIV Best Practices
IBM Africa Institute 2013
Agenda

 IO Virtualization with VIOS


 Single VIOS with Multipath NPIV Ports
 Dual VIOS with Multipath NPIV Ports
 Highly Redundant Dual VIOS with Multipath NPIV Ports
 High Availability with Storage & Zoning Design
 Fiber Channel & NPIV Best Practices
IBM Africa Institute 2013
IO Virtualization with VIOS
VIOS Virtualization Overview

VIOS a feature of PowerVM which can Virtualize


 IO Adapters
 Storage
 Virtualizes Memory
 Virtual Servers Relocation, Suspend, and Resume

VIOS Client 1 Client 2 VIOS

Power Hypervisor

System Hardware (Processors, Memory, & IO Devices)

Physical IO Virtual IO
IBM Africa Institute 2013
IO Virtualization with VIOS
VIOS creates Virtual Adapters

 Each virtual server has virtual I/O slots.


– Configurable for each virtual server
 Virtual slots can have a virtual adapter instance.
– Virtual Ethernet
– Virtual SCSI
– Virtual Fiber Channel
 Virtual I/O slots can be dynamically added or removed just like physical I/O slots.
– Cannot be dynamically moved to another virtual server

VIOS Client 1 Client 2 VIOS

Power Hypervisor

System Hardware (Processors, Memory, & IO Devices)

Physical IO Virtual IO
IBM Africa Institute 2013
IO Virtualization with VIOS
Virtual Ethernet
Client
Virtual Server
Virtual
Ethernet
Adapter Hypervisor Virtual IO
Server
Virtual Physical
network
Switch Virtual
Ethernet SEA
Physical
Ethernet
Adapter Adapter

Virtual
Ethernet
Adapter
IBM Africa Institute 2013
IO Virtualization with VIOS
Virtual Fiber Channel
Client
Virtual Server

Hypervisor
Virtual IO
Virtual Server
Fiber Channel
Client Adapter

Virtual Fiber
Channel Physical
Server Adapter Fiber Channel SAN
Virtual Fiber
Adapter Storage
Channel
Server Adapter

Virtual
Fiber Channel
Client Adapter
IBM Africa Institute 2013
IO Virtualization with VIOS
Virtual SCSI
Client
Virtual Server

Hypervisor
Virtual IO
Server

Virtual SCSI
Client Adapter

Logical
Virtual SCSI disk
Server Adapter

Virtual SCSI Virtual SCSI


Client Adapter Server Adapter
IBM Africa Institute 2013
IO Virtualization with VIOS
Virtual IO Complete
Client
Virtual Server
Virtual
Ethernet
Adapter Hypervisor
Virtual IO
Virtual Server
Fiber Channel
Client Adapter
Virtual Physical
network
Virtual SCSI
Switch Virtual
Ethernet
Layer 2 Physical
Ethernet
Adapter bridge
Adapter
Client Adapter
Virtual Fiber
Channel Physical
Server Adapter Fiber Channel SAN
Virtual Virtual Fiber
Adapter Storage
Ethernet Channel
Adapter Server Adapter

Virtual Logical
Fiber Channel Virtual SCSI disk
Client Adapter Server Adapter

Virtual SCSI Virtual SCSI


Client Adapter Server Adapter
IBM Africa Institute 2013
Agenda

 IO Virtualization with VIOS


 Single VIOS with Multipath NPIV Ports
 Dual VIOS with Multipath NPIV Ports
 Highly Redundant Dual VIOS with Multipath NPIV Ports
 High Availability with Storage & Zoning Design
 NPIV Best Practices
IBM Africa Institute 2013
Single VIOS with Multipath NPIV Ports
Nothing is configured

VIOS 1 Client 1 Client 2


Nothing configured…

fcs0 fcs1
(Phy) (Phy)
Hypervisor

Fiber Channel Switch


IBM Africa Institute 2013
Single VIOS with Multipath NPIV Ports
DLPAR a virtual adapter in the HMC(Save Profile)

VIOS 1 Client 1 Client 2

Create a Virtual Fiber Channel Server Adapter


DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2


(Phy) (Phy) (Vir)
Hypervisor

Fiber Channel Switch


IBM Africa Institute 2013
Single VIOS with Multipath NPIV Ports
DLPAR a virtual adapter in the HMC(Save Profile)

VIOS 1 Client 1 Client 2

Create a Virtual Fiber Channel Client Adapter


DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2 fcs0


(Phy) (Phy) (Vir) (Vir)
Hypervisor

Fiber Channel Switch


IBM Africa Institute 2013
Single VIOS with Multipath NPIV Ports
Map the Virtual Fiber Channel Pair to the Physical Adapter

VIOS 1 Client 1 Client 2

Map the virtual fiber channel server adapter to the physical adapter
Use the VfcMap command or the HMC storage manager

fcs0 fcs1 fcs2 fcs0


(Phy) (Phy) (Vir) (Vir)
Hypervisor

Fiber Channel Switch


IBM Africa Institute 2013
Single VIOS with Multipath NPIV Ports
DLPAR a virtual adapter in the HMC(Save Profile)

VIOS 1 Client 1 Client 2

Create a Virtual Fiber Channel Server Adapter


DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2 fcs3 fcs0


(Phy) (Phy) (Vir) (Vir) (Vir)
Hypervisor

Fiber Channel Switch


IBM Africa Institute 2013
Single VIOS with Multipath NPIV Ports
DLPAR a virtual adapter in the HMC(Save Profile)

VIOS 1 Client 1 Client 2

Create a Virtual Fiber Channel Client Adapter


DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2 fcs3 fcs0 fcs1


(Phy) (Phy) (Vir) (Vir) (Vir) (Vir)
Hypervisor

Fiber Channel Switch


IBM Africa Institute 2013
Single VIOS with Multipath NPIV Ports
Map the Virtual Fiber Channel Pair to the Physical Adapter

VIOS 1 Client 1 Client 2

Map the virtual fiber channel server adapter to the physical adapter
Use the VfcMap command or the HMC storage manager

fcs0 fcs1 fcs2 fcs3 fcs0 fcs1


(Phy) (Phy) (Vir) (Vir) (Vir) (Vir)
Hypervisor

Fiber Channel Switch


IBM Africa Institute 2013
Single VIOS with Multipath NPIV Ports
DLPAR a virtual adapter in the HMC(Save Profile)

VIOS 1 Client 1 Client 2

Create a Virtual Fiber Channel Server Adapter


DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2 fcs3 fcs4 fcs0 fcs1


(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir)
Hypervisor

Fiber Channel Switch


IBM Africa Institute 2013
Single VIOS with Multipath NPIV Ports
DLPAR a virtual adapter in the HMC(Save Profile)

VIOS 1 Client 1 Client 2

Create a Virtual Fiber Channel Client Adapter


DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2 fcs3 fcs4 fcs0 fcs1 fcs0


(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir)
Hypervisor

Fiber Channel Switch


IBM Africa Institute 2013
Single VIOS with Multipath NPIV Ports
Map the Virtual Fiber Channel Pair to the Physical Adapter

VIOS 1 Client 1 Client 2

Map the virtual fiber channel server adapter to the physical adapter
Use the VfcMap command or the HMC storage manager

fcs0 fcs1 fcs2 fcs3 fcs4 fcs0 fcs1 fcs0


(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir)
Hypervisor

Fiber Channel Switch


IBM Africa Institute 2013
Single VIOS with Multipath NPIV Ports
DLPAR a virtual adapter in the HMC(Save Profile)

VIOS 1 Client 1 Client 2

Create a Virtual Fiber Channel Server Adapter


DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs0 fcs1 fcs0


(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir)
Hypervisor

Fiber Channel Switch


IBM Africa Institute 2013
Single VIOS with Multipath NPIV Ports
DLPAR a virtual adapter in the HMC(Save Profile)

VIOS 1 Client 1 Client 2

Create a Virtual Fiber Channel Client Adapter


DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs0 fcs1 fcs0 fcs1
(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir)
Hypervisor

Fiber Channel Switch


IBM Africa Institute 2013
Single VIOS with Multipath NPIV Ports
Map the Virtual Fiber Channel Pair to the Physical Adapter

VIOS 1 Client 1 Client 2

Map the virtual fiber channel server adapter to the physical adapter
Use the VfcMap command or the HMC storage manager

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs0 fcs1 fcs0 fcs1
(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir)
Hypervisor

Fiber Channel Switch


IBM Africa Institute 2013
Single VIOS with Multipath NPIV Ports
Finished

VIOS 1 Client 1 Client 2


Finished

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs0 fcs1 fcs0 fcs1
(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir)
Hypervisor

Fiber Channel Switch


IBM Africa Institute 2013
Agenda

 IO Virtualization with VIOS


 Single VIOS with Multipath NPIV Ports
 Dual VIOS with Multipath NPIV Ports
 Highly Redundant Dual VIOS with Multipath NPIV Ports
 High Availability with Storage & Zoning Design
 NPIV Best Practices
IBM Africa Institute 2013
Dual VIOS with Multipath NPIV Ports
Start with the configuration for a multipath single VIOS

VIOS 1 Client 1 Client 2 VIOS 2


Configured Nothing configured…

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs0 fcs1 fcs0 fcs1 fcs1 fcs0
(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Dual VIOS with Multipath NPIV Ports
DLPAR a virtual adapter in the HMC(Save Profile)

VIOS 1 Client 1 Client 2 VIOS 2

Configured
Create a Virtual Fiber Channel Server Adapter
DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs0 fcs1 fcs0 fcs1 fcs2 fcs1 fcs0
(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Dual VIOS with Multipath NPIV Ports
DLPAR a virtual adapter in the HMC(Save Profile)

VIOS 1 Client 1 Client 2 VIOS 2

Configured
Create a Virtual Fiber Channel Client Adapter
DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs0 fcs1 fcs2 fcs0 fcs1 fcs2 fcs1 fcs0
(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Dual VIOS with Multipath NPIV Ports
Map the Virtual Fiber Channel Pair to the Physical Adapter

VIOS 1 Client 1 Client 2 VIOS 2

Configured Map the virtual fiber channel server adapter to the physical adapter
Use the VfcMap command or the HMC storage manager

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs0 fcs1 fcs2 fcs0 fcs1 fcs2 fcs1 fcs0
(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Dual VIOS with Multipath NPIV Ports
DLPAR a virtual adapter in the HMC(Save Profile)

VIOS 1 Client 1 Client 2 VIOS 2

Configured
Create a Virtual Fiber Channel Server Adapter
DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs0 fcs1 fcs2 fcs0 fcs1 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Dual VIOS with Multipath NPIV Ports
DLPAR a virtual adapter in the HMC(Save Profile)

VIOS 1 Client 1 Client 2 VIOS 2

Configured
Create a Virtual Fiber Channel Client Adapter
DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs0 fcs1 fcs2 fcs3 fcs0 fcs1 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Dual VIOS with Multipath NPIV Ports
Map the Virtual Fiber Channel Pair to the Physical Adapter

VIOS 1 Client 1 Client 2 VIOS 2

Configured Map the virtual fiber channel server adapter to the physical adapter
Use the VfcMap command or the HMC storage manager

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs0 fcs1 fcs2 fcs3 fcs0 fcs1 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Dual VIOS with Multipath NPIV Ports
DLPAR a virtual adapter in the HMC(Save Profile)

VIOS 1 Client 1 Client 2 VIOS 2

Configured
Create a Virtual Fiber Channel Server Adapter
DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs0 fcs1 fcs2 fcs3 fcs0 fcs1 fcs5 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Dual VIOS with Multipath NPIV Ports
DLPAR a virtual adapter in the HMC(Save Profile)

VIOS 1 Client 1 Client 2 VIOS 2

Configured
Create a Virtual Fiber Channel Client Adapter
DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs0 fcs1 fcs2 fcs3 fcs0 fcs1 fcs2 fcs4 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Dual VIOS with Multipath NPIV Ports
Map the Virtual Fiber Channel Pair to the Physical Adapter

VIOS 1 Client 1 Client 2 VIOS 2

Configured Map the virtual fiber channel server adapter to the physical adapter
Use the VfcMap command or the HMC storage manager

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs0 fcs1 fcs2 fcs3 fcs0 fcs1 fcs2 fcs4 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Dual VIOS with Multipath NPIV Ports
DLPAR a virtual adapter in the HMC(Save Profile)

VIOS 1 Client 1 Client 2 VIOS 2

Configured
Create a Virtual Fiber Channel Server Adapter
DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs0 fcs1 fcs2 fcs3 fcs0 fcs1 fcs2 fcs5 fcs4 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Dual VIOS with Multipath NPIV Ports
DLPAR a virtual adapter in the HMC(Save Profile)

VIOS 1 Client 1 Client 2 VIOS 2

Configured
Create a Virtual Fiber Channel Client Adapter
DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs0 fcs1 fcs2 fcs3 fcs0 fcs1 fcs2 fcs3 fcs5 fcs4 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Dual VIOS with Multipath NPIV Ports
Map the Virtual Fiber Channel Pair to the Physical Adapter

VIOS 1 Client 1 Client 2 VIOS 2

Configured Map the virtual fiber channel server adapter to the physical adapter
Use the VfcMap command or the HMC storage manager

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs0 fcs1 fcs2 fcs3 fcs0 fcs1 fcs2 fcs3 fcs5 fcs4 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Agenda

 IO Virtualization with VIOS


 Single VIOS with Multipath NPIV Ports
 Dual VIOS with Multipath NPIV Ports
 Highly Redundant Dual VIOS with Multipath NPIV Ports
 High Availability with Storage & Zoning Design
 NPIV Best Practices
IBM Africa Institute 2013
Highly Redundant Dual VIOS with Multipath NPIV Ports
Two Adapters per a VIOS for Redundancy
VIOS 1

Dual port adapters provide port & link redundancy

Two Adapters provide adapter redundancy

Adapter Redundancy

Port/Link Redundancy
IBM Africa Institute 2013
Highly Redundant Dual VIOS with Multipath NPIV Ports
Create 2 VIOS each with 2 Fiber Channel Adapters
VIOS 1 Client 1 VIOS 2

fcs0 fcs1 fcs2 fcs3 fcs3 fcs2 fcs1 fcs0


(Phy) (Phy) (Phy) (Phy) (Phy) (Phy) (Phy) (Phy)

Assign 2-Physical Adapters to Each VIOS


Each port allows up to 64-NPIV(Virtual Fiber Channel) Connections..
2 ports per an Adapter, 4 ports per a VIOS, 8 paths per a client disk

VIOS Redundancy

Adapter Redundancy

Port/Link Redundancy
IBM Africa Institute 2013
Highly Redundant Dual VIOS with Multipath NPIV Ports
Attach all the fiber channel cables to the proper switches
VIOS 1 Client 1 VIOS 2

Attach all 8-Ports to the SAN Fabric


Adapter Port 1Fiber Channel Switch 1
Adapter Port 2Fiber Channel Switch 2
Switch Redundancy
fcs0 fcs1 fcs2 fcs3 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Phy) (Phy) (Phy) (Phy) (Phy) (Phy)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


Switch Redundancy

VIOS Redundancy

Adapter Redundancy

Port/Link Redundancy
IBM Africa Institute 2013
Highly Redundant Dual VIOS with Multipath NPIV Ports
DLPAR 4 virtual adapters in the HMC(Save Profile)
VIOS 1 Client 1 VIOS 2

Create 4 Virtual Fiber Channel Server Adapters


DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs6 fcs7 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy) (Phy) (Phy)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Highly Redundant Dual VIOS with Multipath NPIV Ports
DLPAR 4 virtual adapters in the HMC(Save Profile)
VIOS 1 Client 1 VIOS 2

Create 4 Virtual Fiber Channel Client Adapters


DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs6 fcs7 fcs0 fcs1 fcs2 fcs3 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy) (Phy) (Phy)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Highly Redundant Dual VIOS with Multipath NPIV Ports
Run the vfcmap command on VIOS 1 to map all 4 virtual fiber channel ports
VIOS 1 Client 1 VIOS 2

Map the virtual fiber channel server adapter to the physical adapter
Use the VfcMap command or the HMC storage manager

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs6 fcs7 fcs0 fcs1 fcs2 fcs3 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy) (Phy) (Phy)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Highly Redundant Dual VIOS with Multipath NPIV Ports
The disk is now available via 4-paths on VIOS 1
VIOS 1 Client 1 VIOS 2

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs6 fcs7 fcs0 fcs1 fcs2 fcs3 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy) (Phy) (Phy)
Hypervisor

The disk are available to VIOS 1


The client disk has port, physical adapter, and switch redundancy
The client does not have VIOS redundancy yet…

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Highly Redundant Dual VIOS with Multipath NPIV Ports
DLPAR 4 virtual adapters in the HMC(Save Profile)
VIOS 1 Client 1 VIOS 2

Create 4 Virtual Fiber Channel Server Adapters


DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs6 fcs7 fcs0 fcs1 fcs2 fcs3 fcs7 fcs6 fcs5 fcs4 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy) (Phy) (Phy)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Highly Redundant Dual VIOS with Multipath NPIV Ports
DLPAR 4 virtual adapters in the HMC(Save Profile)
VIOS 1 Client 1 VIOS 2

Create 4 Virtual Fiber Channel Client Adapters


DLPAR using the HMC(Save the Profile)
Run cfgdev for the adapter to appear

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs6 fcs7 fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs6 fcs7 fcs7 fcs6 fcs5 fcs4 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy) (Phy) (Phy)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Highly Redundant Dual VIOS with Multipath NPIV Ports
Run the vfcmap command on VIOS 2
VIOS 1 Client 1 VIOS 2

Map the virtual fiber channel server adapter to the physical adapter
Use the VfcMap command or the HMC storage manager

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs6 fcs7 fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs6 fcs7 fcs7 fcs6 fcs5 fcs4 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy) (Phy) (Phy)
Hypervisor

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Highly Redundant Dual VIOS with Multipath NPIV Ports
Each client disk will now have 8-paths to the external storage device
VIOS 1 Client 1 VIOS 2

Path & Adapter Redundancy

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs6 fcs7 fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs6 fcs7 fcs7 fcs6 fcs5 fcs4 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy) (Phy) (Phy)
Hypervisor

Finished..
This architecture supports up to 64 virtual servers
8-Paths per a virtual disk
8x8Gb Ports = 64Gb of bandwidth or 8,000MBps…
Your storage device isn’t this fast…(yet)

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Highly Redundant Dual VIOS with Multipath NPIV Ports
Live Partition Mobility Example
VIOS 1 Client 1 VIOS 2 VIOS 1 VIOS 2

fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs6 fcs7 fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs6 fcs7 fcs7 fcs6 fcs5 fcs4 fcs3 fcs2 fcs1 fcs0 fcs0 fcs1 fcs2 fcs3 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy) (Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy) (Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy) (Phy) (Phy) (Vir) (Vir) (Vir) (Vir)

Use LPAR Mobility


Setup the 2-Servers the same way…

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Highly Redundant Dual VIOS with Multipath NPIV Ports
Live Partition Mobility Example
VIOS 1 VIOS 2 VIOS 1 Client 1 VIOS 2

fcs0 fcs1 fcs2 fcs3 fcs3 fcs2 fcs1 fcs0 fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs6 fcs7 fcs0 fcs1 fcs2 fcs3 fcs4 fcs5 fcs6 fcs7 fcs7 fcs6 fcs5 fcs4 fcs3 fcs2 fcs1 fcs0
(Phy) (Phy) (Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy) (Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy) (Phy) (Phy) (Vir) (Vir) (Vir) (Vir) (Phy) (Phy) (Phy) (Phy) (Vir) (Vir) (Vir) (Vir)

Use LPAR Mobility


Setup the 2-Servers the same way…

Fiber Channel Switch Fiber Channel Switch


IBM Africa Institute 2013
Agenda

 IO Virtualization with VIOS


 Single VIOS with Multipath NPIV Ports
 Dual VIOS with Multipath NPIV Ports
 Highly Redundant Dual VIOS with Multipath NPIV Ports
 Storage High Availability, Zoning, and Wiring
 NPIV Best Practices
IBM Africa Institute 2013
Storage High Availability, Zoning, & Wiring
Storage devices typically have redundant storage controllers

Storage Redundancy
Two Controllers

Storage Controller A

Storage Controller B
IBM Africa Institute 2013
Storage High Availability, Zoning, & Wiring
How many wires do you run and how should it be zoned?

How should the cables be ran & the switches be zoned?

Fiber Channel Switch 1 Fiber Channel Switch 2

Storage Controller A

Storage Controller B
IBM Africa Institute 2013
Storage High Availability, Zoning, & Wiring
Technically this is a “N + N” configuration…

How should the cables be ran & the switches be zoned?


Is this really a good idea?

Fiber Channel Switch 1 Fiber Channel Switch 2

Storage Controller A

Storage Controller B
IBM Africa Institute 2013
Storage High Availability, Zoning, & Wiring
A higher availability solution then N + N, but…..

How should the cables be ran & the switches be zoned?


This looks better, but what is wrong with this?

Fiber Channel Switch 1 Fiber Channel Switch 2

Storage Controller A

Storage Controller B
IBM Africa Institute 2013
Storage High Availability, Zoning, & Wiring
A failure means you work until its fixed…

How should the cables be ran & the switches be zoned?


A switch failure is equal to a controller failure…

Fiber Channel Switch 1 Fiber Channel Switch 2

Storage Controller A

SAS Ports

Storage Controller B
IBM Africa Institute 2013
Storage High Availability, Zoning, & Wiring
Create 2-zones on each switch

Fiber Channel Switch 1 Fiber Channel Switch 2


Green Zone Blue Zone

Orange Zone Purple Zone

Storage Controller A

Storage Controller A has 1-Port for Each Zone

Storage Controller B has 1-Port for Each Zone


Storage Controller B
IBM Africa Institute 2013
Storage High Availability, Zoning, & Wiring
Switch 1 & switch 2 connect to both storage controllers

Fiber Channel Switch 1 Fiber Channel Switch 2


Green Zone Blue Zone

Orange Zone Purple Zone

Storage Controller A

Storage Controller B
IBM Africa Institute 2013
Storage High Availability, Zoning, & Wiring
Wiring & zoning the storage device

Fiber Channel Switch 1 Fiber Channel Switch 2


Green Zone Blue Zone

Orange Zone Purple Zone

Storage Controller A

Storage Controller B
IBM Africa Institute 2013
Storage High Availability, Zoning, & Wiring
Adding a second external storage device Storage Controller A

Storage Controller B

Fiber Channel Switch 1 Fiber Channel Switch 2


Green Zone Blue Zone

Orange Zone Purple Zone

Storage Controller A

Storage Controller B
IBM Africa Institute 2013
Storage High Availability, Zoning, & Wiring
Wiring rules for adapters
VIOS 1 Client 1

Dual Port Adapters….


Connect all adapters Port 1 to Switch 1
Connect all adapters Port 2 to Switch 2

Fiber Channel Switch 1 Fiber Channel Switch 2


Green Zone Blue Zone

Orange Zone Purple Zone

Storage Controller A

Storage Controller B
IBM Africa Institute 2013
Storage High Availability, Zoning, & Wiring
Wiring & zoning for virtual servers
VIOS 1 Client 1

Fiber Channel Switch 1 Fiber Channel Switch 2


Green Zone Blue Zone

Orange Zone Purple Zone

Storage Controller A

Storage Controller B
IBM Africa Institute 2013
Storage High Availability, Zoning, & Wiring
Wiring & zoning for virtual servers
VIOS 1 Client 1 VIOS 2

Fiber Channel Switch 1 Fiber Channel Switch 2


Green Zone Blue Zone

Orange Zone Purple Zone

Storage Controller A

Storage Controller B
IBM Africa Institute 2013
Storage High Availability, Zoning, & Wiring
Switch A & B connect to both controllers
VIOS 1 Client 1 VIOS 2 VIOS 1 Client 1 VIOS 2

Fiber Channel Switch 1 Fiber Channel Switch 2


Green Zone Blue Zone

Orange Zone Purple Zone

Storage Controller A

Storage Controller B
IBM Africa Institute 2013
Storage High Availability, Zoning, & Wiring
Switch A & B connect to both controllers
VIOS 1 Client 1 VIOS 2 VIOS 1 Client 1 VIOS 2

Fiber Channel Switch 1 Fiber Channel Switch 2


Green Zone Blue Zone

Orange Zone Purple Zone

Storage Controller A

Storage Controller A

Storage Controller B

Storage Controller B
IBM Africa Institute 2013
Agenda

 IO Virtualization with VIOS


 Single VIOS with Multipath NPIV Ports
 Dual VIOS with Multipath NPIV Ports
 Highly Redundant Dual VIOS with Multipath NPIV Ports
 High Availability with Storage & Zoning Design
 NPIV Best Practices
IBM Africa Institute 2013
NPIV Best Practices
Naming Conventions for Virtual Adapters

 Virtual Adapter slots use similar numbering convention to physical adapter slots

 NPIV Adapters are assigned in pairs


– NPIV client adapters in the client lpar
– NPIV server adapters in the VIOS

 An organized naming and number convention to simplify complexity


– Use the Partition ID for the first number of the virtual slot
• LPAR ID 3 uses virtual slots 30 to 39
• LPAR ID 4 uses virtual slots 40 to 49
– Even & Odd Numbering
• Odd virtual slots go to VIOS1
• Event virtual slots go to VIOS2
IBM Africa Institute 2013
NPIV Best Practices
IBM i is configured differently than AIX!

Queue DISK Active Queue


Slots LUNs Paths Total
IBM i 3 30 1 = 90
(Non-Virtualized)

IBM i with vSCSI(3-1TB) 32 3 1 = 96


(Virtualized by an AIX guy)

IBM i with FC or NPIV(3-1TB) 3 3 1 = 9


(Virtualized by an AIX guy)

IBM i with FC or NPIV(30-100GB) 3 30 1 = 90


IBM i with FC or NPIV(30-100GB) 3 30 2 = 180
IBM i with FC or NPIV(30-100GB) 3 30 4 = 360
IBM i with FC or NPIV(30-100GB) 3 30 8 = 720
IBM i LPARs require many disk units.
Consider making virtualized disk equal or greater then non-virtualized disk.
AIX generally requires fewer disk.
IBM Africa Institute 2013
NPIV Best Practices
Best Practices – VIOS Limits
Description Limit

Maximum Number of LUNs per a Fiber Channel Adapter Thousands

Maximum virtual ports per a physical port 64

Maximum virtual ports per a physical adapter 128

IBM i LUN requirement Consider….


Virtualized LUNs => Non-Virtualized LUNs
IBM Africa Institute 2013

Find at www.tablespace.net
IBM Africa Institute 2013

Find at www.tablespace.net
IBM Africa Institute 2013

This is not a design


document!

This document is only to


show possible methods to
design a solution!
THANK YOU

Das könnte Ihnen auch gefallen