IBM System Mirror for AIX

HA Solutions for the 21st Century

April 2015

Steven Finnes
Session objectives

Understand the basics of the PowerHA V7 offering

Understand clustering verses VM restart

Discuss the PowerHA strategic roadmap

Brief discussion on HA for Linux on Power

2014, 2015 International Business Machines Corporation Copyright IBM Corporation

2014
 V7 for AIX
Based on OS integrated clustering for simplicity and reliability
Smart Assists to simplify deployment of high availability for SAP and other applications
Multiple redundant heartbeat with SAN communications for robust cluster integrity
Advanced resource group policies for automated recovery sequencing
Multi-site split-merge technologies, Operator Controlled Failover,
7.1.3 Enhancements
Flexible SAP HA Management
Active-Active Sites with HyperSwap
Unicast Clustering
Dynamic Host Name modification support

7.1.0 GA: Sep 2010

7.1.1 GA: Dec 2011
7.1.2 GA: Nov 2012
7.1.3 GA: Dec 2013
7.2 GA: Dec 2015 (Planned)

3 2014, 2015 International Business Machines Corporation

 Clustering for HA and DR
Application

PowerHA standard edition cluster

Application

PowerHA enterprise edition cluster

PowerHA enables 24x365 operational availability
Automation for planned and unplanned outages
Solutions covering simple data center to multiple-site configurations
4 2014, 2015 International Business Machines Corporation
 PowerHA SystemMirror Shared Storage Cluster
Benefits:
Automated Fallover
Non disruptive upgrades PTFs
Redundant LAN
Application Monitoring
CAA and kernel level comm
Event / ERROR Notification
Server A Server B
GUI, CL mgmt
Cluster
Configuration
Different Failure Types:
IP Loss Detection
Loss of Storage
Redundant SAN
Application Interruption
Server Crash
Loss of Power

Configuration Options
Storage Enclosure Active / Passive
Mutual Takeover

5 2014, 2015 International Business Machines Corporation

Solution Approach for High Availability (HA)
Requirements
Near continuous application service
Recovery Time Objective (RTO) measured in minutes
Recovery Point Objective (RPO) is Zero (no data loss)
Sync-mode replication configurations enable two-site HA
Eliminate affects of planned outages including hardware and software
maintenance (upgrades, PTF apply etc)

Solution Strategy:
PowerHA with shared storage (swichable LUNs)
PowerHA with cross-site mirroring
PowerHA with SVC stretch cluster
PowerHA with SAP live cache hot-standby
PowerHA with Metro Mirror (synchronous replication)
PowerHA with active-active sites (Oracle RAC)

6 2014, 2015 International Business Machines Corporation

 clustering solutions for high availability active-passive
Application

Example: high availability configuration

Application

Synchronous replication

Example: Combined high availability and

disaster recovery configuration

7 2014, 2015 International Business Machines Corporation

Campus Style HA: Cross Site LVM Mirroring
Stretched-Cluster

Common At:
Banking Institutions
SAN interconnection links Hospitals
Power Companies
Universities
Storage Area Network

LVM Mirror

Location A Location B

2014, 2015 International Business Machines Corporation

PowerHA SVC stretch cluster
Virtual
switchable
Site A Site B LUNs

San Switch San Switch

Quorum Disk

SVC SVC

Storwize V7000 Storwize V7000

Mirrored Volumes

PowerHA Standard Edition (appears as a switchable LUN cluster)

Site A and Site B volumes are mirrored by the SVC (under the covers)
Solution provides cross-campus continuously available storage in a PowerHA cluster

9 2014, 2015 International Business Machines Corporation

Continuous Availability With PowerHA HyperSwap
Active Nodes PowerHA Cluster Passive Nodes

Active-Passive Sites
Active-Active workload within a site
Active-Passive across sites Metro Mirror

Storage continuous availability across sites Oracle RAC Oracle RAC

Site A Site B

Active Nodes PowerHA Cluster Active Nodes

Active-Active Sites
Active-Active workload across sites
Continuous availability
Oracle RAC long distance deployment
Metro Mirror

Oracle RAC

Site A Site B

10 2014, 2015 International Business Machines Corporation Copyright IBM Corporation

2014 IBM Confidential
Solution Approach for Disaster Recovery (DR)
Requirements
Recover operations at a remote location due to site outage
Recovery Time Objective (RTO) measured in hours
Recovery Point Objective (RPO) is zero
Simplified disaster recovery compliance testing

Solution Strategy:
PowerHA with Geographic Mirroring Async Mode
PowerHA with Global Mirroring (asynchronous storage replication)
Application

Asynchronous replication

Example: disaster recovery configuration

11 2014, 2015 International Business Machines Corporation
Unified Multi-Site HA/DR Solution Example

Requirements
Multi-site configurations
Data center/campus component for HA
Multiple site configuration for DR

Solution Strategy:
Unified clustering solution for data center & multi-site resiliency
PowerHA SystemMirror Enterprise Edition

Application

Asynchronous replication

12 2014, 2015 International Business Machines Corporation

What about IT shops looking for a low cost two-site solution

GLVM is PowerHA host mirroring of the Vg data over IP

Host based replication (verses storage based replication)
No additional charge for GLVM and it is storage agnostic
Replication workload requires additional CPU, memory, network etc
Async mode will consume more memory and disk space than sync mode
AIX storage management sends the memory pages to both the remote and
local server either synchronously or asynchronously
Synchronous distance is typically under 40 KM but distance is driven by
application response time requirements
Proof of concept is recommended to attain proper sizing and bandwidth or
work with lab services to have them gather I/O stats and perform and
bandwidth analysis

2014, 2015 International Business Machines Corporation

HyperSwap Support by AIX-PowerHA

Application/LVM/Middleware Application/LVM/Middleware

/dev/hdiskX

/dev/hdiskX /dev/hdiskY /dev/hdiskX /dev/hdiskY

Metro Mirror Metro Mirror

Primary DS8K Secondary DS8K Primary DS8K Secondary DS8K

Traditional Metro Mirror Cluster HyperSwap Cluster

HyperSwap device configuration transparent to application
Applications continue to use the devices as usual - storage switching is fast seconds

14 2014, 2015 International Business Machines Corporation

HA/DR Solution Approaches
OS1 OS2
PowerHA Data Center Clustering Standard Edition
Data Center clustering for mission critical application availability
DB
Shared storage based data resiliency
Data Center Cluster
o Independent operating system (OS) resident on each node
o Database and other files in cluster disk pool OS1 OS2 OS3

PowerHA Multi-Site Clustering Enterprise Edition

Multi-Site clustering for disaster recovery DB DB
Independent operating systems on each node, two copies of the DB Multi-Site Cluster
Storage (disk sector) replication data resiliency
OS1

Data Center VM Restart (out of band solution)

Automated remote LPAR restart, full system recovery DB
VIOS instance of Applications and middleware within disk pool Data Center Restart
Roll from system to another: reboot of the OS and data
OS1
Two-Site VM Restart (out of band solution)
Automated LPAR restart, full system recovery at 2nd location
Two copies, single instance of OS and DB DB
DB
Reboot primary partition to secondary partition
Two Site Restart

2014, 2015 International Business Machines Corporation 15

Clustering verses VM restart for High Availability

Cluster based High Availability PowerHA

Failover
PowerHA
Cluster Cluster
Planned and unplanned outage management Node 1 Node 2
Active Standby
Software and/or hardware concurrent maintenance PowerHA
Warm or hot standby topology (active OSs on nodes) Cluster

Automated AIX workload bring up

Fig 1: DR Cluster

Restart
VM Restart Recovery Availability VM partition
CEC level (hardware) outage management Active
Hardware maintenance only (one active OS)
Reboot recovery outage management
Cold standby topology
AIX or Linux workload restart
Fig 2: DR VM Restart

16 2014, 2015 International Business Machines Corporation

Clustering verses VM restart for DR
Site 1 Site 2

Cluster based Disaster Recovery (DR) PowerHA

Failover
PowerHA
Cluster Cluster
Planned and unplanned outage management Node 1 Node 2
Software and hardware concurrent maintenance Active Standby
PowerHA
Warm or hot standby topology Cluster

Storage or host based replication

Automated AIX workload bring up

Fig 1: DR Cluster

Site 1 Site 2

Restart

VM partition
VM Restart Disaster Recovery Active
Disaster recovery outage management
Cold standby topology
Storage based replication
Automated AIX or Linux workload restart
Fig 2: DR VM Restart

17 2014, 2015 International Business Machines Corporation

 VM Restart (out-of-band) HA/DR

VM restart for the data center example

Application
Single image of OS and application
External Ksys (out of band) provides automation

Two-Site VM restart example OS 1 OS 1

In-band cluster management for the data center
Out of band VM restart to DR site

Application

OS 1 OS 2 OS 1 or OS2

2014 International Business 2014, 2015 International Business Machines Corporation 18

Machines Corporation
Whats new in April

2014, 2015 International Business Machines Corporation

PowerHA Volume Purchase Offering

Purchase a minimum of 1000 PowerHA entitlements for a volume discount, increments of 50

Ordering
Order against a single serial number
Available for small, medium and large processor groups
Order for the largest processor group in the enterprise
Available only for the enterprise data centers within a country
One time purchase no incremental purchases supported
Available for PowerHA on AIX PID: 5765 H39
One volume purchase billing feature: xxxx for 50 entitlements per core
Minimum quantity of 1000 ( 20 xxxx features)

Deployment
Customer is responsible to manage the post sale RPO split license transfer process or call into
2nd level support against the original serial number

2014, 2015 International Business Machines Corporation

 PowerVC Managing PowerVM Remote VM Restart
PowerVC Remote VM Restart enables starting VMs from a failed host on another server
Accelerate recovery time for a failed Power Server
VMs are automatically rebooted on new servers
Works with AIX, IBM i or Linux VMs
Requires a human decision to perform restart using PowerVC
Host Group policy controls VM placement upon restart

VM VM VM VM
VM VM VM VM
VM VM VM VM

PowerVM PowerVM PowerVM

Failed Server Healthy Server Healthy Server

21 2014, 2015 International Business Machines Corporation

 PowerVC Managing PowerKVM Remote VM Restart
PowerVC Remote VM Restart enables starting VMs from a failed host on another server
Accelerate recovery time for a failed Power Server
VMs are automatically rebooted on new servers
Works with any Linux VM type
Requires a human decision to perform restart using PowerVC
Host Group policy controls VM placement upon restart

VM VM VM VM
VM VM VM VM
VM VM VM VM

PowerKVM PowerKVM PowerKVM

Failed Server Healthy Server Healthy Server

22 2014, 2015 International Business Machines Corporation

 PowerVC Restart vs PowerHA Comparison

Capability PowerVC PowerHA

PowerVM
PowerKVM
Source & Target System can be
separate HMC s
Graphical Management UI
Local or Remote Recovery Local only Local and Remote
AIX, IBM i, Linux , , AIX, IBM i
Hardware support POWER8,fw 8.20 POWER 6,7,8
Complexity Low Medium
PowerVM EE Required Yes No
Pricing Per core Per core

23 2014, 2015 International Business Machines Corporation

Common Causes of Downtime and Classification

Group 1 Predictive + failures of hardware.

Eg: (CPU & Memory)
Group 2 Network/Storage Adapter failures
External Errors
(Eg: Storage errors, Switch errors etc)
Group 3 Critical OS events (Eg: Volume failures,
Critical File system failures, etc)
Group 4 Software/Middleware failures and Operator
Errors

Group 5 Site Outages

Hypervisor

Hypervisor HA Technology Coverage

- Remote VM Restart Clustering Coverage
- Active Memory Mirroring

2014, 2015 International Business Machines Corporation

Clustering and Power Virtualization Technology HA Coverage

Coverage

Application

Guest OS

PowerHA
VM

PowerVC
Hardware VM Restart
Recovery
Seconds 5 30 minutes Time
Minimize downtime for unplanned outages
PowerHA provides complete coverage and lowest recovery times
PowerVC Remote VM Restart provides additional coverage for Server Hardware Issues.

2014, 2015 International Business Machines Corporation

 Basic DR Characteristics Clustering verses DR VM Restart

Cluster technology (in band) DR Remote VM Restart (out of band)

Error coverage Comprehensive Limited
(Monitoring inside the VM ) (Monitoring external to VM)
Workload failover/startup time Failover + workload startup (mins) Reboot of VM (15 Minutes or more)
Administration Network, Storage, Security, etc Minimal
Deployment Effort Inside the VM (requires skill) Outside the VM (simple)
Cost of acquisition Redundant cores and LPPs Redundant cores
Outage Types Covered All Primarily CEC
Application/Middleware Resiliency Independent OS per LPAR Single OS image
Workload type suitability Mission Critical Mission Critical

General Characteristics
Cluster technology monitors events inside of the VM
Cluster technology requires redundant licensing for the DR site
VM restart technology is generally relatively easy to set up and use
DR remote VM restart enables simple compliance testing and minimal redundant licensing

2014, 2015 International Business Machines Corporation 26

HA Solution Strategy For Linux on Power

Promote established HA/DR solutions that support Linux on Power

Support customer choice enabling a wide range of options based

on vendor supplied product offering characteristics such as price
function, and deployment options

Work to broaden the number of solutions and solution providers

27 2014, 2015 International Business Machines Corporation

PowerLinux Solutions for HA Overview
IBM
Tivoli System Automation for Mutiplatform (TSA-MP)
Supports Red Hat and SUSE
DB2 HADR
Supports Ret Hat and SUSE

SUSE
Linux Enterprise High Availability Extension
https://www.suse.com/products/highavailability/

NEC
Express Cluster
Supports Red Hat and SUSE
http://www.nec.com/en/global/prod/expresscluster/en/overview/index.html

Ubuntu
High Availability Cluster Solutions for Ubuntu 14.04 on Power
Supports Red Hat and SUSE
https://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki/W51a7ffcf4dfd_4b40_9d82_446ebc23c55
0/page/High%20Availability%20Cluster%20Solutions%20for%20Ubuntu%2014.04%20on%20Power

2014 IBM Corporation

PowerLinux Solutions for HA Overview

Linbit
High availability and disaster recovery (official support pending)
Supports RedHat and SUSE

Storeix
System Backup for IBM PowerLinux
supports Red Hat and SUSE
http://www-304.ibm.com/partnerworld/gsd/solutiondetails.do?&solution=17057&lc=en

HAO for RHEL on p Systems. Developed and supported by Sine Nomine ... the High-Availability Option
(HAO) for Red Hat Enterprise Linux on p Systems provides software and support tooling to implement ...
requirements. SNA engineers can assist with implementing HA support for many products as part of
separate services engagements. ...
HAO for RHEL on p Systems (POWER)

2014 IBM Corporation

PowerHA V7.2 and Beyond (not in your handouts)

2014, 2015 International Business Machines Corporation

 PowerHA SystemMirror Life Cycle

2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019
* * * *
* * * * * * *
PowerHA V7.2 12/15
* * * * * *
* * * * * *
PowerHA V7.1 TL3 4/2017
12/13 *
Std/Ent EOS*
* * * * * *
* * * * * *
PowerHA V7.1 TL2 4/2016
Std/Ent 11/12
EoSP* V7
* * * *
* * * * * *
PowerHA V7.1 TL1 4/2015
12/11
Std EoSP*
* * *
* * * * *
PowerHA V7.1 TL0
9/10 9/2014
Std EoSP
* *
* *
PowerHA V6.1
10/09 4/2015
Std/Ent EOS

* - Estimated since not currently announced

Current PowerHA Releases - New software enhancements, new system and I/O support
PowerHA Service Packs - Software updates, new system and I/O support updates
Product Marketing and Service Available
Withdrawn from Marketing; Standard Program Services Available
End of Service marker (without additional fees)
Fee-based support offering planned
SP update for software, new HW&IO support
Significant new functionality added

2014, 2015 International Business Machines Corporation

PowerHA SystemMirror V7: Rapid Deployment Guide
https://www.ibm.com/developerworks/aix/tutorials/au-ibm-powerha-system-mirror/

2014, 2015 International Business Machines Corporation

 PowerHA SystemMirror V7: Resources
Redbook (www.redbook.com)
1. IBM PowerHA SystemMirror for AIX 7.1.3 Best Practices and Migration Guide:
http://www.redbooks.ibm.com/Redbooks.nsf/RedbookAbstracts/sg248234.html?Open
2. IBM PowerHA SystemMirror Cookbook: http://www.redbooks.ibm.com/redpieces/abstracts/sg247739.html
3. IBM PowerHA SystemMirror 7.1.3 for AIX Reference Guide, SG24-8167-00
4. IBM PowerHA SystemMirror Standard Edition 7.1.1 for AIX Update, SG24-8030
5. IBM PowerHA SystemMirror 7.1.2 Enterprise Edition for AIX, SG24-8106-00
6. Exploiting IBM PowerHA SystemMirror V6.1 for AIX Enterprise Edition, SG24-7841
7. PowerHA for AIX Cookbook, SG24-7739-00
8. Deploying PowerHA Solution with AIX HyperSwap, REDP-4954-00
White Papers, FAQ, Knowledge Center
1. PowerHA v7 Rapid Deployment white paper: https://www.ibm.com/developerworks/aix/tutorials/au-ibm-powerha-system-mirror/
2. PowerHA Home Page: www.ibm.com/systems/power/software/availability/
3. PowerHA Product Documentation (Knowledge Center): http://www-
01.ibm.com/support/knowledgecenter/SSPHQG_7.1.0/com.ibm.powerha.navigation/kc_welcome_ha_71.htm
4. PowerHA Wiki: https://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki/Power%20Systems/page/High%20Availability
5. PowerHA FAQ: http://www-03.ibm.com/systems/power/software/availability/aix/faq_support.html
6. Migration youtube video: https://www.youtube.com/watch?v=MaPxuK4poUw

Education (www.ibm.com/services/learning)
1. Whats New in PowerHA SystemMirror 7 and Migration - Course code: AN65G
2. IBM PowerHA SystemMirror 7.1.2 for AIX Update - Course code: WRB82G
3. PowerHA 7 Planning, Implementing, Customizing and Administration -Course code: AN61G
4. PowerHA SystemMirror 6.1 Migration, Extended Configuration and PD - Course code: AN42G
5. PowerHA/XD: Extended Distance and Disaster Recovery - Course code: AN44G
6. PowerHA SystemMirror for AIX III: Virtualization and Mobility - Course code: AN43G
7. PowerHA SystemMirror 7.1 Planning and Implementation - Course code: AN67G
8. PowerHA 7 Additional Configurations - Course code: AN62G
9. PowerHA SystemMirror 7.1: Customization and Basic Administration - Course code: AN68G
IBM Services Offerings
1. Availability Factory: Contact your IBM representative or an IBM Business Partner and they will contact us via e-mail (hacoc@us.ibm.com) to
learn more.
2. IBM Technology Service Offering for PowerHA SystemMirror Multi Site deployment: http://www-
935.ibm.com/services/us/index.wss/offering/its/a1000032
2014, 2015 International Business Machines Corporation
 PowerHA SystemMirror V7: ResourcesContinued

IBM System Lab Services (LBS) Offerings

Offering
PowerHA Deployment Services
PowerHA Health Check
PowerHA and IBM Storage
Planning/Implementation
PowerHA Disaster Recovery
Workshop
Duration Details
2 to 8 days Review of customer requirements
Plan and design PowerHA deployment
Support deployment and document best practices
Week Review current HA deployment
Review business processes
Create guidance, recommendations report
4 days Education and hands-on activities
Review HA and DR requirements
Plan PowerHA and storage for the environment
1 to 4 days Develop HA DR requirements by working closely with the on
site customer reps.
Assist in development of action plan and schedule

Visit: ibm.com/systems/services/labservices

Contacts:
1.Linda Hoben Opportunity Manager hoben@us.ibm.com 1-720-395-0556
2.Stephen Brandenburg Opportunity Manager sbranden@us.ibm.com 1-301-240-2182
3.Send mail to: stgls@us.ibm.com

2014, 2015 International Business Machines Corporation

 PowerHA SystemMirror V7: ResourcesContinued

PowerHA SAP HA Management

White papers and Redbooks
1. PowerHA - SAP HA management Chapter in IBM PowerHA SystemMirror 7.1.3 for AIX Reference Guide, SG24-8167-0
2. PowerHA-SAP LiveCache Hotstandby Solution Guide: http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP100677
3. LPM of LPARS running SAP: http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP101471
4. Tuning SAP with Oracle on AIX: http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP100377

Education and Service Offerings: Contact: isicc@de.ibm.com

PowerHA SAP HA Management:: Plan, Smart Assist based NetWeaver, ERS deployment design, planning and deployment.
Deploy SAP instances, databases including liveCache/MAXDB

SAP liveCache HotStandby plan, Deploy PowerHA Smart Assist based liveCache Hotstandby solution design, and deployment

Pre Sales Offering: Education and assistance to plan for SAP solutions with PowerHA
PowerHA cluster HA management of SAP

PowerHA HA management of Sybase Plan, deploy Sybase ASE HA management by PowerHA Clustering

PowerHA: DB2 HADR HA management Integration of DB2 HADR with PowerHA: Design, deployment assistance

PowerHA: HA management of Oracle or DB2 PowerHA provides Smart Assists to do HA management of Oracle or DB2. This service
will help customer deploy the PowerHA and enable HA management of DB2 or Oracle

Duration: Depending on the ordered modules and amount of instances. Estimate will be provided upon request.

2014, 2015 International Business Machines Corporation

Open innovation to put data to
work across the enterprise

2014, 2015 International Business Machines Corporation

 Special notices
This document was developed for IBM offerings in the United States as of the date of publication. IBM may not make these offerings available in
other countries, and the information is subject to change without notice. Consult your local IBM business contact for information on the IBM
offerings available in your area.
Information in this document concerning non-IBM products was obtained from the suppliers of these products or other public sources. Questions
on the capabilities of non-IBM products should be addressed to the suppliers of those products.
IBM may have patents or pending patent applications covering subject matter in this document. The furnishing of this document does not give
you any license to these patents. Send license inquires, in writing, to IBM Director of Licensing, IBM Corporation, New Castle Drive, Armonk, NY
10504-1785 USA.
All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives
only.
The information contained in this document has not been submitted to any formal IBM test and is provided "AS IS" with no warranties or
guarantees either expressed or implied.
All examples cited or described in this document are presented as illustrations of the manner in which some IBM products can be used and the
results that may be achieved. Actual environmental costs and performance characteristics will vary depending on individual client configurations
and conditions.
IBM Global Financing offerings are provided through IBM Credit Corporation in the United States and other IBM subsidiaries and divisions
worldwide to qualified commercial and government clients. Rates are based on a client's credit rating, financing terms, offering type, equipment
type and options, and may vary by country. Other restrictions may apply. Rates and offerings are subject to change, extension or withdrawal
without notice.
IBM is not responsible for printing errors in this document that result in pricing or information inaccuracies.
All prices shown are IBM's United States suggested list prices and are subject to change without notice; reseller prices may vary.
IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.
Any performance data contained in this document was determined in a controlled environment. Actual results may vary significantly and are
dependent on many factors including system hardware configuration and software design and configuration. Some measurements quoted in this
document may have been made on development-level systems. There is no guarantee these measurements will be the same on generally-
available systems. Some measurements quoted in this document may have been estimated through extrapolation. Users of this document
should verify the applicable data for their specific environment.

Revised September 26, 2006

37 2014, 2015 International Business Machines Corporation

 Special notices (cont.)
IBM, the IBM logo, ibm.com AIX, AIX (logo), AIX 5L, AIX 6 (logo), AS/400, BladeCenter, Blue Gene, ClusterProven, DB2, ESCON, i5/OS, i5/OS (logo), IBM Business
Partner (logo), IntelliStation, LoadLeveler, Lotus, Lotus Notes, Notes, Operating System/400, OS/400, PartnerLink, PartnerWorld, PowerPC, pSeries, Rational, RISC
System/6000, RS/6000, THINK, Tivoli, Tivoli (logo), Tivoli Management Environment, WebSphere, xSeries, z/OS, zSeries, Active Memory, Balanced Warehouse,
CacheFlow, Cool Blue, IBM Watson, IBM Systems Director VMControl, pureScale, TurboCore, Chiphopper, Cloudscape, DB2 Universal Database, DS4000, DS6000,
DS8000, EnergyScale, Enterprise Workload Manager, General Parallel File System, , GPFS, HACMP, HACMP/6000, HASM, IBM Systems Director Active Energy
Manager, iSeries, Micro-Partitioning, POWER, PowerLinux, PowerExecutive, PowerVM, PowerVM (logo), PowerHA, Power Architecture, Power Everywhere, Power
Family, POWER Hypervisor, Power Systems, Power Systems (logo), Power Systems Software, Power Systems Software (logo), POWER2, POWER3, POWER4,
POWER4+, POWER5, POWER5+, POWER6, POWER6+, POWER7, POWER7+, Systems, System i, System p, System p5, System Storage, System z, TME 10,
Workload Partitions Manager and X-Architecture are trademarks or registered trademarks of International Business Machines Corporation in the United States, other
countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol ( or ), these symbols
indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law
trademarks in other countries.

A full list of U.S. trademarks owned by IBM may be found at: http://www.ibm.com/legal/copytrade.shtml.

Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or
other countries.
AltiVec is a trademark of Freescale Semiconductor, Inc.
AMD Opteron is a trademark of Advanced Micro Devices, Inc.
InfiniBand, InfiniBand Trade Association and the InfiniBand design marks are trademarks and/or service marks of the InfiniBand Trade Association.
Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered
trademarks of Intel Corporation or its subsidiaries in the United States and other countries.
IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce.
Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates.
Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and other countries.
Linux is a registered trademark of Linus Torvalds in the United States, other countries or both.
PowerLinux uses the registered trademark Linux pursuant to a sublicense from LMI, the exclusive licensee of Linus Torvalds, owner of the Linux mark on a world-
wide basis.
Microsoft, Windows and the Windows logo are registered trademarks of Microsoft Corporation in the United States, other countries or both.
NetBench is a registered trademark of Ziff Davis Media in the United States, other countries or both.
SPECint, SPECfp, SPECjbb, SPECweb, SPECjAppServer, SPEC OMP, SPECviewperf, SPECapc, SPEChpc, SPECjvm, SPECmail, SPECimap and SPECsfs are
trademarks of the Standard Performance Evaluation Corp (SPEC).
The Power Architecture and Power.org wordmarks and the Power and Power.org logos and related marks are trademarks and service marks licensed by Power.org.
TPC-C and TPC-H are trademarks of the Transaction Performance Processing Council (TPPC).
UNIX is a registered trademark of The Open Group in the United States, other countries or both.

Other company, product and service names may be trademarks or service marks of others.

Revised November 28, 2012

38 2014, 2015 International Business Machines Corporation POP03352-USEN-02