Jack Arnold - IT Management Consultant 29 May 2013

Session 1031 Introduction to SVC and Storwize V7000: Virtualization, Compression and Business Continuity

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

SVC Purpose
Combine disk subsystems into a single reservoir of capacity Manage from a single interface Insulate applications from storage changes Enable tiered storage Provide replication within and between storage subsystems

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

SVC - Logical View

Server

Server

SAN

SAN

IBM

EMC

HDS

IBM

EMC

HDS

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

SVC - Logical View

To the server, it looks like a storage controller

SAN

Server

To the storage controllers, it looks like a server!

IBM
4 2013 IBM Corporation

EMC

HDS

Session 1031 Introduction to SVC and Storwize V7000:

SVC - Physical View and Zoning

Server

SAN

SVC

IBM

EMC

HDS

The SVC is attached and zoned into the SAN

5 2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Multipathing Drivers

SAN
SAN Volume Controller
Virtual Disk

Only one device driver Multipathing, failover/failback, load-balancing Server only sees SVC Adding a new storage system requires no additional maintenance to servers Choice is yours, per server IBM SDD (System Device Driver) MPIO (Window, AIX) MPxIO (Solaris) PVLinks (HP-UX) DM-MP (Linux) Symantec DMP

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

SVC Node History

Type-model 2145-4F2 2145-8F2 2145-8F4 2145-8G4 2145-8A4 2145-CF8 2145-CG8 4 8 8 8 8 24 24 Cache [GB] 2 2 4 4 4 8 8 FC speed [Gb/s] iSCSI Speed [Gb/s] n/a 1 1 1 1 1 1 (10 Gbit/s optional) Based upon x335 x336 x336 x3550 x3250 x3550M2 x3550M3 Announced 2 June 2003 25 October 2005 23 May 2006 22 May 2007 28 October 2008 20 October 2009 9 May 2011

http://en.wikipedia.org/wiki/IBM_SAN_Volume_Controller#Terminology (updated 21 May 2013 by Jack G. Arnold)

7 2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

SVC release history is a continuous evolution

2011 Storwize V7000 Unified Mixed Replication Longer distance split cluster Native LDAP New Global Mirror option

2003 2145-4F2 4 node

2004 2145-8F2 VSS GDS

2006 Global Mirror Multi-target FlashCopy

2008 Thin provisioning vDisk Mirroring SVC Entry Edition

2010 Storwize V7000 New GUI Easy Tier

1.1

1.2

2.1

3.1

4.1

4.2

4.3

5.1

6.1

6.2 6.2

6.3

6.4

2004 8 nodes

2005 2145-8F4

2007 2145-8G4 FlashCopy enhancements

2009 2145-CF8 SSD support 3 site Mirror > 2TB VDisk Split cluster iSCSI Zero detect

2011 2145-CG8 VAAI >2 TB MDisk Performance monitor Flash Copy enhancements

2012 Real-time Compression Non-disruptive volume move FCoE 4 way Storwize V7000 clustering

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Migration to a SAN Volume Controller Current Image Mode

Virtualized

Va

Vb

Vc

Va

Vb

Vc

MDG1

MDG1

Non-Disruptive C A B C
MDG2
9 2013 IBM Corporation

C
MDG2

Session 1031 Introduction to SVC and Storwize V7000:

Improved Application Availability

Traditional SAN
1. 2. 3. 4. Stop the application Move data Re-establish host connections Restart application

SAN Volume Controller

1. Move data 2. Host systems and applications are not affected.

SAN

Volume

SAN

SAN Volume Controller

10

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Improved Application Availability

Traditional SAN
1. 2. 3. 4. Stop the application Move data Re-establish host connections Restart application

SAN Volume Controller

1. Move data 2. Host systems and applications are not affected.

SAN

Volume

SAN

SAN Volume Controller

11

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Replication Services
Traditional SAN Replication APIs differ by vendor Lower-cost disks offer primitive, or no replication services SAN Volume Controller Common replication API, SAN-wide, that does not change as storage hardware changes Replication targets can be on lowercost disks

FlashCopy PPRC IBM ESS

SAN

TimeFinder SRDF EMC Sym

SAN
SAN Volume Controller IBM ESS IBM
SATA

SVC IBM
DS4000

IBM ESS

EMC Sym

EMC Sym

HP MA

12

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Remote Copy

Source

Destination

MDG2

MDG4

MDG1

MDG3

13

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

IBM SAN Volume Controller - FlashCopy

Up to 256 targets

FlashCopy relationships

FlashCopy: Volume level point-in-time copy with any mix of SEV and fully-allocated

Source vdisk

14

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

IBM SAN Volume Controller - FlashCopy

Start incremental FlashCopy

Data copied as normal

Incremental FlashCopy: Volume level point-in-time copy

Later

Some data changed by apps Start incremental FlashCopy

Only changed data copied by background copy

15 2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

IBM SAN Volume Controller - FlashCopy

Map 1

Map 2

Disk2 FlashCopy target of Disk1

Cascaded FlashCopy: Copy the copies

Disk0 Source

Disk1 FlashCopy target of Disk0 Map 4 Disk4 FlashCopy target of Disk3

Disk3 FlashCopy target of Disk1

16

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Virtual Disk Mirroring

SVC maintains a primary and secondary copy If primary one copy fails, SVC reads from secondary Copies are automatically resynchronized after repair Intended to protect critical data against failure of a disk system Copies can be split Either or both copies may be space-efficient (SEV) Reads come from only 1, writes go to both
17 2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Return successful completion as soon as one copy has completed

Wait until both copies are written before returning success

-mirrorwritepriority latency | redundancy SVC/V7000 6.3 code release

18

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Reclaiming Unused Disk Space

Reclaim unused allocated disk space (zeros) when converting a fully allocated VDisk to a Space-Efficient Virtual Disk (SEV) using VDisk Mirroring Using Vdisk Mirroring, move from full to SEV

zeros

VDisk
data

SAN Volume Controller

zeros data data

Reclaimed disk space

fully allocated
19 2013 IBM Corporation

space-efficient

Session 1031 Introduction to SVC and Storwize V7000:

Scale-Out Implementation

Add SVC I/O Groups to scale throughput and add capacity

20

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Easy Tier
Automatic storage hierarchy Mixed storage pool with 2 tiers Internal or External SSD and spinning disks Volumes belong to a single pool I/O Monitor keeps access history for each virtualisation extent Extent sizes 16MB to 8GB Default is 256 MB extent size
SSD Mixed storage pool Host Host Host

Host Volumes & Extents

HDD

Automatic extent migration

21

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Stretched Cluster and Remote Replication

Stretched Cluster does not protect against all unplanned outages Regional disasters could affect both data centers

Stretched Cluster can be combined with Global Mirror to third location Up to 8000 km away

22

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

SVC 2145-CF8 Storage Engine

New SVC engine based on IBM System x3550 M2 server (1U) Intel Xeon 5500 (Westmere) 2.40 GHz hex-core processor 24GB of cache per node Four 8Gbps FC ports per node Solid State Drive support (up to four per SVC node) enabling scale-out high performance SSD support with SVC 10 Gb Ethernet support for 10 Gb iSCSI host attachment and future FCoE support Providing this will require a decision of either SAS-attached SSD or 10 GbE for each node

23 23

This proprietary educational material is intended for IBM and IBM Business Partner staff only. 2013 IBM Corporation It is not intended for distribution to customers or other third parties.

Session 1031 Introduction to SVC and Storwize V7000:

Storwize V7000 Announced = 07 OCT 2010 Available = 12 NOV 2010

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Storwize V7000
Midrange storage controller Virtualization from SVC Functionality from SVC Reports as 2145 (SVC) RAID from DS8000 (+ more) GUI from XIV Classic controller head + expansion drawers IBM designed and developed (at Hursley in the U.K.) Optional compression from Storwize acquisition

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Storwize V7000 Overview

Enclosure Front View 12 Drive Bays 2076-112/212/312

Enclosure Front View 24 Drive Bays 2076-124/224/324

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Scale the Storwize V7000 to Meet Your Needs

Scale-up Add non-disruptively

Scale-out Cluster up to 4 frames and 40 enclosures Add non-disruptively

Control Enclosure Control Enclosure Control Enclosure Control Enclosure

Expansion Enclosures

Expand

Expansion Enclosures

Expansion Enclosures

Expansion Enclosures

Cluster
2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

User Interface

2013 IBM Corporation

2010 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Storwize V7000 Unified

Single four Core Intel Xeon E5620 at 2.4GHz (12MB L3 cache, 80W)
V7000 Unified

V7000 Unified

1 x Intel Jasper Forest quad core 64-bit CPU (2.1GHz) per controller (8MB L3 cache, 65W)

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Storwize V7000 Unified

Unified block and files storage system Tightly integrated management console NFS / CIFS / FTP / HTTPS / SCP in addition to block functions IBM Active Cloud Engine File based ILM File based asynchronous replication File based snapshots Quotas

V7000 Unified

V7000 Unified

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Extensive Help

Intuitive Function Icons Simplify Storage Management

Status Indicators

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Connecting Storwize V7000 Unified

NFS, CIFS, FTP, HTTP, SCP, management 2 x 1 Gb 2 x 10 Gb Ethernet Ethernet IBM Storwize V7000 File module (2U) 2 x 8 Gb Fibre Channel 4 x 10 Gb Ethernet iSCSI iSCSI, MGMT 4 x 1 Gb Ethernet IBM Storwize V7000 IBM Storwize V7000 File module (2U) 2 x 8 Gb Fibre Channel SAN 4 x 8 Gb Fibre Channel
2013 IBM Corporation

2 x 1 Gb Ethernet

6 Gb/s SAS to expansion trays

Session 1031 Introduction to SVC and Storwize V7000:

File Placement
Rule 'Data rule 1' set pool 'tier1' where UPPER(NAME) like '%.DOC' Rule 'Data rule 2' set pool 'tier2' where UPPER(NAME) like '%.PPT' Rule 'Data rule 3' set pool 'tier3' where UPPER(NAME) like '%.MP3'

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

File Management

RULE 'mig1' MIGRATE FROM POOL 'pool_1' THRESHOLD(90,70) WEIGHT(KB_ALLOCATED) TO POOL 'pool_2' RULE 'del1' DELETE FROM POOL 'pool_1' WHERE (DAYS(CURRENT_TIMESTAMP) - DAYS(ACCESS_TIME) > 30) AND (lower(NAME) LIKE '%.tmp' OR PATH_NAME LIKE '%/tmp/%')

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

IBM Active Cloud Engine with TSM

Migrating data to TSM could place it on lower cost tape Leaves stub behind

TSM
2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Dedicated CPU Resources, V7000 and SVC CF8

Create first compressed volume

Delete last compressed volume

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Dedicated CPU Resources, SVC CG8

Create first compressed volume

Delete last compressed volume

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Dedicated Cache Resources, SVC CF8, CG8

Create first compressed volume

Delete last compressed volume

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Real-time Compression
Clients
Front End Remote Copy Cache Flash Copy Mirroring Thin Provisioning Virtualization Back End
Random Access Compression Engine

All copy services will interoperate with compressed Volumes New property introduced

Uncompressed capacity

Storage

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Advantages Compared with other Technologies

IBM Real-time Compression can be used with active primary data IBM Real-time Compression operates immediately and is easy to manage No need to schedule periods to run post-process compression Eliminates need to reserve space for uncompressed data waiting post-processing IBM Real-time Compression supports all Storwize storage Internal or externally virtualized storage

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Expected Compression Rates

Databases Server Virtualization Collaboration Data Engineering Data E-mail

50-80% 45-70% 30-75% 50-80% 30-60%

IBM Comprestimator tool should be used to evaluate expected compression benefits in existing environments

2013 IBM Corporation

Session 1031 Introduction to SVC and Storwize V7000:

Compression Implementation Guidelines

Good for compression Databases DB2, Oracle, MS-SQL, etc. Applications based on databases SAP, Oracle Applications, etc. Server Virtualization KVM, VMware, Hyper-V, etc. Other compressible workloads engineering, seismic, collaboration Bad for compression Workloads using pre-compressed data types such as video, images, audio Workloads using encrypted data Heavy sequential write oriented workloads

2013 IBM Corporation

The End

Session 1031 Introduction to SVC and Storwize V7000: Virtualization, Compression and Business Continuity

2013 IBM Corporation 43

For more from Jack: https://www.ibm.com/developerworks/mydeveloperworks/blogs/ IBMStorage or Google search IBM blog Jack Arnold

2013 IBM Corporation