Sie sind auf Seite 1von 88

POWER8 Enterprise Server Deep Dive

Power System E870


Power System E880

Michael Chang ()
fcchang@tw.ibm.com
Server Solutions-Power Systems
STG, IBM Taiwan

2014 IBM Corporation

http://publib-b.boulder.ibm.com/redpieces/abstracts/redp5137.html?Open

2014 International Business Machines Corporation

http://www-03.ibm.com/systems/power/hardware/reports/factsfeatures.html

2014 International Business Machines Corporation

http://www-03.ibm.com/systems/power/hardware/reports/system_perf.html

2014 International Business Machines Corporation

Quick Reference to Power Systems PCIe Adapter card


Partners: http://partners.boulder.ibm.com/src/atsmastr.nsf/WebIndex/TD105846
IBMers : http://w3.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/TD105846

2014 International Business Machines Corporation

Agenda
Power System E870 & E880
System Node & System Control Unit
Memory

Performance
PCIe Gen3 slots in System Node
PCIe Gen3 I/O Expansion Drawer

Racking considerations
OS Support
Upgrade path (same serial number)

Migrating using Power Enterprise Pools to save cost

2014 International Business Machines Corporation

POWER8 Enterprise Server


Announcement / General Availability Plans

Annc

eConfig

GA

Power E870

(1-2 node)

6 Oct 2014

7 Oct 2014

18 Nov 2014

Power E880

(1-2 node)

6 Oct 2014

7 Oct 2014

18 Nov 2014

Power E880

(3rd/4th node)

6 Oct 2014

Mar 2015

Jun 2015

Same serial number upgrades to E870/E880


shipped with IBM T42 rack

6 Oct 2014

7 Oct 2014

12 Dec 2014

Same serial number upgrades to E870/E880


shipped without IBM T42 rack

6 Oct 2014

7 Oct 2014

Mid Feb
2015

System Planning Tool (SPT) availability for E870/E880 was late Oct 2014

2014 International Business Machines Corporation

Power Systems QUIZ


What is the correct name of the latest chip technology
an IBM Power System uses?
a) Power 8
b) Power8
c) POWER8
d) POWER 8

c)

POWER8 chips are used in Power Systems servers

2014 International Business Machines Corporation

IBM Power System E870


(9119-MME)

IBM Power System E880


(9119-MHE)
2014 International Business Machines Corporation

10

1Q 2014 Portfolio: POWER7/POWER7+


Power
780+
Power
770+

Power
795

Power
750+ / 760+
Power
710+/730+

Power
720+/740+

PowerLinux
7R1+ / 7R2+

PowerLinux
7R4+

IBM PureFlex
System
P460+
p260+

p24L
2014 International Business Machines Corporation

11

2Q (June) 2014 Portfolio: POWER8/POWER7/POWER7+


Power
780+
Power
770+

Power
795

Power
750+ / 760+

S822
Power
710+/730+

S814/S824
Power
720+/740+

PowerLinux
7R1+ / 7R2+

S812L/S822L

PowerLinux
7R4+

IBM PureFlex
System
P460+
p260+

p24L
2014 International Business Machines Corporation

12

4Q (November) 2014 Portfolio: POWER8/POWER7/POWER7+


Power
780+

Power
795

Power
770+
Power
750+ / 760+

S822
Power
710+/730+

S814/S824
Power
720+/740+

PowerLinux
7R1+ / 7R2+

S812L/S822L

2014 International Business Machines Corporation

PowerLinux
7R4+

IBM PureFlex
System
P460+
p260+

POWER8
Scale-out Servers

S824L

p24L
13

Power Enterprise (Scale-up) Positioning

Power E880
Power E880

Power E870
Power E880

Power E870
Power E880

Power 780

Power 795

Power 770
2014 International Business Machines Corporation

14

POWER8 Enterprise (Scale-up) Systems


No Primary Node
Midplane
Service Processors
Clocks
Oscillators
Large Memory

E870
E880

795

770
780

19 Rack
Modular design
Up to 4 CEC drawers/nodes
PCIe slots in the nodes

2014 International Business Machines Corporation

15

POWER8 Enterprise (Scale-up) System


Blend of Power 795 & Power 780/770
Architecturally:
Similar to Power 795
Packaging:
Similar to Power 780/770
One to four nodes (E880 - 9119-MHE)
One to two nodes (E870 - 9119-MME)
19 Rack
Great memory
Up to 16TB (E880) or 4TB* (E870)
Faster memory - 1600 MHz
Up to 85.3 GB / Core
PCIe Gen3 Slots
* SOD for 8TB
2014 International Business Machines Corporation

16

POWER8 Enterprise System Node (CEC Drawer)


8 PCIe Gen3 x16 Slots

32 CDIMM slots
Up to 4TB

(for LP PCIe adapter or


Optical Interface to I/O drawer)

Fans

4 POWER8 SCM
Sockets
Power Supplies

5U Enclosure

2014 International Business Machines Corporation

17

POWER8 Enterprise System Node (CEC Drawer)

One to four nodes (E880)


32-core 4.35 GHz (#EPBB one feature per node)
See SOD for 48-core node

One to two nodes (E870)


40-core 4.19 GHz (#EPBC one feature per node)
32-core 4.02 GHz (#EPBA one feature per node)
All nodes in a server must have identical SCM processor

features (e.g. E870: 4.19 GHz node 4.02 GHz node )

2014 International Business Machines Corporation

18

Power E870/E880 SOD (Statement of Direction)


Power E870: IBM plans to enhance the Power E870 with greater I/O and
memory capacity and flexibility with:
1. Support for concurrent maintenance on the Power E870 I/O Expansion
Drawer by enabling hot add and repair capabilities
2. The ability to scale up to 4TBs of memory per Power E870 processor
node
Power E880: IBM plans to enhance the Power Systems enterprise
system portfolio with greater scalability, availability and flexibility. IBM
intends to deliver the following offerings:
1. A more scalable Power E880 enterprise-class system with up to 192
POWER8 processor cores and up to 16TBs of total memory
2. Support for concurrent maintenance on the Power E880 I/O Expansion
Drawer by enabling hot add and repair capabilities
IBMs statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBMs sole discretion. Information
regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.
The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or
functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future
features or functionality described for our products remains at our sole discretion.
2014 International Business Machines Corporation

19

POWER8 Enterprise System Node (CEC Drawer)

1-node
system

2-node
system

3-node
system

4-node
system

32-core

64-core

96-core
(2015)

128-core
(2015)

2015

2015

2015

E880
32-core node

48-core node (SOD) 2015

E870
40-core node

40-core

80-core

n/a

n/a

32-core node

32-core

64-core

n/a

n/a

2014 International Business Machines Corporation

20

POWER8 Enterprise System Node (CEC Drawer)


Processor Core Activation Features

Processor SCM feature


#core (c) GHz

E870

E880

9119-MME

9119-MHE

#EPBA
32c 4.02 GHz

#EPBC
40c 4.19 GHz

#EPBB
32c 4.35 GHz

Static activation

#EPBJ

#EPBL

#EPBK

Mobile-enabled (static)
activation

#EPBN

#EPBQ

#EPBP

Mobile activation

#EP2S

#EP2S

#EP2T

Power Integrated
Facility for Linux (IFL)
Quantity 4

#ELJ5*

#ELJ7*

#ELJ6*

Minimum of 8 cores must be activated (any of the above activations)


Notes:
Activations associated with Power IFL can only be used for Linux partitions
Static activations can be converted to mobile activations. There is a minimum number of
static activations required on the server (i.e. 8 cores)
It is less expensive to buy a mobile-enabled static activation and convert it to a mobile
activation than to buy a static activation and convert it to a mobile activation
2014 International Business Machines Corporation

21

POWER8 Enterprise System Node (CEC Drawer)

5U Enclosure

32 memory DIMM slots per node

8 PCIe Gen3 x16 low profile (LP) slots per node


- Uses low profile blind swap cassete(BSC)
---------------------No integrated SAS bays or SAS controller in node
No integrated DVD bay or DVD controller in node
No integrated Ethernet port in node
No tape bay in node

2014 International Business Machines Corporation

22

System Control Unit

(Midplane)

One system control unit per system


2U drawer
Must be immediately physically adjacent

to system nodes

System control unit holds:


Service processors (FSPs)
HMC ports
Master system clocks
Operator panel
VPD (vital products data)
Optional DVD

2014 International Business Machines Corporation

23

System Control Unit (Midplane)


Front View
Optional DVD

Fan

Fan

Fan

Fan

Ops panel

Rear View
Redundant Power

Service
Processor

Redundant Hot plug


Clock Battery

Clock
2 HMC
ports

2014 International Business Machines Corporation

Clock

Redundant Power

Service
Processor

2 HMC
ports

24

Auto-adding a System Control Unit

(Midplane)

One system control unit auto-included with each Power E870 or

E880 system (**No separate feature code is used for system control unit)
Auto-add two #EU0A Service processors (FSPs)
Auto-add the cables to connect to the System nodes
Add #ECCA for node 1 attachment
Add #ECCB for node 2 attachment
Add #ECCC for node 3 attachment (2015)
Add #ECCD for node 4 attachment (2015)
Optional order DVD #EU13 (see next chart)

2014 International Business Machines Corporation

25

DVD Bay in System Control Unit


AIX or Linux optionally uses DVD. IBM i (AS/400) requires a DVD on the
servers somewhere in system unit or in external I/O enclosure like 72261U3
If use optional system control unit DVD --- needs a PCIe USB adapter to be
located either in CEC or PCIe3 IO Drawer (#EC45 or #EC46 PCIe2 4-port USB Adapter)
Note: do not use a SAS adapter to control #EU13. Use a SAS adapter like #5901/#EJ0J/EJ0M to control a SATA DVD
located in an external enclosure such as a 7226-1U3.

Optional DVD
#EU13

1.6 meter USB cable

#EBK4

USB Port cable


connection to adapter
Front of sys cntrl unit hot pluggable, optional DVD
DVD is SATA, but a USB-to-SATA converter included

Rear of sys cntrl unit has USB connector for cabling ease

2014 International Business Machines Corporation

26

System Control Unit Redundancy


(designed for no Single Point of Failure)
One system control unit per server, HOWEVER
Drawer is basically a holder of redundant system control unit elements
Redundant system clocks/oscillators
Redundant service processors
Redundant power sources (up to four UPIC power cords and any one of the four
is all that is needed*)

Redundant HMC ports (two per service processor, four total)


Drawer also includes:
One operator panel shared by the above redundant components
not critical due to HMC

One master VPD card redundant copies of information on the card


One backplane and one mid-plane providing cross element

connections connections are passive, therefore incredibly unlikely to fail


One optional DVD (attached separately to nodes, alternate DVDs available in
other drawers)
* except if optional DVD is used, then needs at least two UPIC power cords connected for enough power

2014 International Business Machines Corporation

27

Power E870/E880 with 1 Node

Node
Sys Cntrl Unit

7U in 19 rack
2014 International Business Machines Corporation

28

Power E870/E880 with 2 Nodes

Node
Sys Cntrl Unit
Node

12U in 19 rack
2014 International Business Machines Corporation

29

Power E880 with 3 Nodes (2015)

Node
Sys Cntrl Unit
Node

Node

2014 International Business Machines Corporation

17U in 19 rack
30

Power E880 with 4 Nodes (2015)

Node

Node
Sys Cntrl Unit
Node

Node

2014 International Business Machines Corporation

22U in 19 rack
31

POWER8 Enterprise System Node Cabling

SMP Cables
Sys Cntrl Unit
Redundant
Power
Sys Cntrl Unit
Redundant
Global Service
processor
Sys Cntrl Unit
Redundant
Clock
Flex Cables

Above cable colors are for viewing in this diagram.


Actual colors are mostly all black.

2014 International Business Machines Corporation

32

Cabling Configuration
Service Processor
(FSP) Cables
Clock Cables

System Control Unit

FSP

Clock

Clock

FSP

Cables ordered using features


#ECCA, ECCB, ECCC, ECCD

2014 International Business Machines Corporation

33

Power E870 & E880


Performance

2014 International Business Machines Corporation

34

rPerf (for AIX)

E870

SMT8

SMT4

32-core
64-core

4.02 GHz
4.02 GHz

674.5 630.4
1,349.0 1260.8

40-core
80-core

4.19 GHz
4.19 GHz

856.0
1,711.9

E880
32-core
64-core
96-core
128-core

2014 International Business Machines Corporation

800.0
1599.9

SMT8 SMT4
4.35 GHz
4.35 GHz
4.35 GHz
4.35 GHz

Please refer to
Power
Systems
Performance
Report for
more details

716.3 669.4
1,432.5 1338.8
2,148.8 2008.2
2,865.0 2677.6

35

rPerf Multiple SMT Levels


+45%

+30%

+7%

SMT1

SMT2

SMT4

SMT8

32-core 4.02 GHz

334.4

484.9

630.4

674.5

64-core 4.02 GHz

668.8

969.8

1260.8

1349.0

40-core 4.19 GHz

424.4

615.4

800.0

856.0

80-core 4.19 GHz

848.8

1230.7

1599.9

1711.9

32-core 4.35 GHz

355.1

514.9

669.4

716.3

64-core 4.35 GHz

710.2

1029.8

1338.8

1432.5

96-core 4.35 GHz

1065.3

1544.8

2008.2

2,148.8

128-core 4.35 GHz

1420.5

2059.7

2677.6

2,865.0

Power E870

Power E880

2014 International Business Machines Corporation

36

CPW (for IBM i)

E870

SMT8

32-core
64-core

4.02 GHz
4.02 GHz

359,000
711,000

40-core
80-core

4.19 GHz
4.19 GHz

460,000
911,000

E880
32-core
64-core
96-core
128-core

2014 International Business Machines Corporation

SMT8
4.35 GHz
4.35 GHz
4.35 GHz
4.35 GHz

Measured
using SMT8
SMT4 would
be somewhat
lower

381,000
755,000
1,114,000
1,495,000

37

Power E870 outperforms all other 8-socket systems


(best Intel Xeon and best Oracle SPARC)
SAP SD Standard Application Benchmark Results, 2-Tier: SD Benchmark Users
SAP enhancement package 5 for SAP ERP 6.0
Source: http//www.sap.com/solutions/benchmark/sd2tier.epx

1.6X more users than Ivybridge-EX v2


Nearly 2X more users than Oracle T5-8
with 1/3 less cores!
120c

80c

96c

120c

128c

Oracle T5-8 Fujitsu PQ 2800E


IBM x3950 X6 IBM Power 780 IBM Power E870
T5, 128c/1024t
Intel E7-8890 v2,
120c/240t

Intel E7-8890 v2
120c/240t

POWER7+
96c/384t

POWER8
80c/640t

(1) IBM Power System E870 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 8 processors / 80 cores / 640 threads, POWER8; 4.19GHz, 2048GB memory, 79,750 SD benchmark users, running AIX 7.1 and DB2 10.5, dialog response: 0.97 seconds, line
items/hour:8,722,000, dialog steps/hour: 26,166,000 SAPS: 436,100 database response time (dialog/update): 0.013 sec / 0.026 s ec, CPU utilization: 99%, Certification #: 2014033 Results valid as of 10/3/14. Source: http://www.sap.com/benchmark.
(2) IBM Power System 780 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 8 processors / 96 cores / 384 threads, POWER7+; 3.72GHz, 1536GB memory, 57024 SD benchmark users, running AIX 7.1 and DB2 10, dialog response: 0.98 seconds, line
items/hour: 6,234,330, dialog steps/hour: 18,703,000 SAPS: 311,720 database response time (dialog/update): 0.009 sec / 0.014 sec, CPU utilization: 99%, Certification #: 2014024 Results valid as of 10/3/14. Source: http://www.sap.com/benchmark.
(3) IBM System x3950 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 8 processors / 120 cores / 240 threads, Intel Xeon Processor E7-8890 v2; 2.80GHz, 1024GB memory, 49,000 SD benchmark users, running Windows Server 2012 Standard Edition and
DB2 10, dialog response: 0.85 seconds, line items/hour: 5,421,670, dialog steps/hour: 16,265,000 SAPS: 271,080; database res ponse time (dialog/update): 0.0083 sec / 0.022 sec, CPU utilization: 98%, Certification #: 2014024 Results valid as of 10/3/14. Source: http://www.sap.com/benchmark.
(4) Fujitsu PRIMEQUEST 2800E on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 8 processors / 120 cores / 240 threads, Intel Xeon Processor E7-8890 v2; 2.80GHz, 1024GB memory, 49,000 SD benchmark users, running Windows Server 2012 Standard
Edition and SQL Server 12, dialog response: 0.97 seconds, line items/hour: 5,193,670, dialog steps/hour: 15,581,000 SAPS: 259,680; database response time (dialog/update): 0.015 sec / 0.030 sec, CPU utilization: 99%, Certification #: 2014003 Results valid as of 10/3/14. Source: http://www.sap.com/benchmark.
(5) (5) Oracle SPARC Server T5-8 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 8 processors/128 cores/1024 threads, SPARC T5; 3.60 GHz, 2,048 GB memory; 40,000 SD benchmark users, running Solaris 11 and Oracle 11g; Certification #
2012013008. Results valid as of 10/3/14. Source: http://www.sap.com/benchmark.
SAP and all SAP logos are trademarks or registered trademarks of SAP AG in Germany and in several other countries. All other product and service names mentioned are the trademarks of their respective companies.

2014 International Business Machines Corporation

39

Over twice the SAP ERP users per core with Power
E870/E880 than the best Intel Xeon and best Oracle SPARC
results !
Nearly 1000 Users per Core with POWER8 based E870
SAP SD Standard Application Benchmark Results, 2-Tier: SD Benchmark Users per Core
SAP enhancement package 5 for SAP ERP 6.0 As of April 28, 2014
Source: http//www.sap.com/solutions/benchmark/sd2tier.epx

SD Benchmark Users per Core

2.2X
more users per core than
the best competitors!

Oracle T5-8

HP DL580 Oracle M5-32


T5
HP DL 380p
E7-4890
v2
M5
128c/1024t
E5-2699 v3
60c/120t
192c/1536t
36c/72t

IBM E870
POWER8
80c/640t

(1) IBM Power System E870 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 8 processors / 80 cores / 640 threads, POWER8; 4.19GHz, 2048GB memory, 79,750 SD benchmark users, running AIX 7.1 and DB2 10.5, dialog response: 0.97 seconds, line
items/hour:8,722,000, dialog steps/hour: 26,166,000 SAPS: 436,100 database response time (dialog/update): 0.013 sec / 0.026 sec, CPU utilization: 99%, Certification #: 2014033 Results valid as of 10/3/14. Source: http://www.sap.com/benchmark.
(2) HP ProLiant DL380 Gen9, on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 2 processors/36 cores/72 threads, Intel Xeon Processor 2699v3; 2.30 GHz, 256 GB memory; 16,101 SD benchmark users, running RHEL 6.5 and SAP ASE; Certification # 2014032.
Results valid as of September 8, 2014. Source: http://www.sap.com/benchmark.
(3) Oracle SPARC Server M5-32 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 32 processors/192 cores/1536 threads, SPARC M5; 3.60 GHz, 4,096 GB memory; 85,050 SD benchmark users, running Solaris 11 and Oracle 11g; Certification #
2012013009. Results valid as of April 28, 2014. Source: http://www.sap.com/benchmark.
(4) HP ProLiant DL580 Gen8on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 4 processors/60 cores/120 threads, Intel Xeon Processor 4890 v2; 2.80 GHz, 1024 GB memory; 24,450 SD benchmark users, running Windows Server 2012 Standard Edition and SQL
Server 2012; Certification # 2043004. Results valid as of April 28, 2014. Source: http://www.sap.com/benchmark.
(5) Oracle SPARC Server T5-8 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 8 processors/128 cores/1024 threads, SPARC T5; 3.60 GHz, 2,048 GB memory; 40,000 SD benchmark users, running Solaris 11 and Oracle 11g; Certification # 2012013008.
Results valid as of April 28, 2014. Source: http://www.sap.com/benchmark.
SAP and all SAP logos are trademarks or registered trademarks of SAP AG in Germany and in several other countries. All other product and service names mentioned are the trademarks of their respective companies.

2014 International Business Machines Corporation

40

40

Power E870 & E880


Memory

2014 International Business Machines Corporation

41

Enterprise CDIMMs

128GB CDIMM
16GB, 32GB,
64GB CDIMM

Custom DIMMs (CDIMMs)


1600 MHz DDR3 (POWER7/7+ was 1066 MHz DDR3)
Up to 4 TB per CEC Drawer (Up to 4TB / node)
Incorporates L4 cache of 16MB
Enterprise memory RAS

2014 International Business Machines Corporation

42

POWER8 Memory Buffer Chip


DRAM
Chips

L4 cache

Memory
Buffer

DDR Interfaces

16MB

Intelligence Moved into Memory

Scheduler &
POWER8
Memory
Management Cache Link

Previously on POWER7+ chip onto buffer

Processor Interface
High speed interface

Performance Value

2014 International Business Machines Corporation

43

DDR3 1600 MHz Memory Cards & Activations


feature

GB feature

Shipped cards Models


supporting
(four per feature)

#EM8J

64

4x16GB

MME / MHE

#EM8K

128

4x32GB

MME / MHE

#EM8L

256

4x64GB

MME / MHE

#EM8M

512

4x128GB

MHE

* see SOD

There is also a 4TB memory bundle feature #EMB6

Static activation features:


1 GB
#EMA5
100 GB
#EMA6
512 GB

#EMB8 (IFL only)

There is also a 4TB (8 x 512) activation bundle feature #EMB7

Mobile activation feature:


100GB
#EMA7
Mobile enabled activation feature:
100GB
#EMA9

32 slots per system node ( holds 8 memory features)


8 memory card slots per socket / SCM (holds 2 memory features)
2014 International Business Machines Corporation

47

Slide added after 18 Sept

POWER8 Memory Compared to POWER7+


50% faster (MHz)
~20-33% lower $/GB
Up to 2X larger DIMMs

POWER8

POWER7+
DDR3 1066MHz

DDR3 1600 MHz

Feature
code

GB per
$ / GB
feature 100% activated

#EM40

32 GB

#EM41

Feature
code

GB per
$ / GB
feature 100% activated

$203

--

--

--

64 GB

$203

#EM8J

64 GB

$168

#EM42

128 GB

$203

#EM8K

128 GB

$168

#EM44

256 GB

$252

#EM8L

256 GB

$168

--

--

--

#EM8M

512 GB

$180

No compare

~20% lower price


~33% lower price
No compare

Prices are USA list prices and subject to change. Reseller prices may vary.
Prices calculated using static activations, not mobile activations.
2014 International Business Machines Corporation

Prices are USA list prices and subject to change. Reseller prices may vary.

51

Memory Config Rules


Each feat code = 4 CDIMMs (4 identical memory cards)
32 card slots in each drawer --- 8 slots per SCM
Max 8 memory features per CEC drawer

Minimum one feature per SCM (50% of slots)


Memory features can differ SCM to SCM
Memory feature must be the same on the same SCM

Memory activation rule = minimum 50% of memory physically installed on server

2014 International Business Machines Corporation

52

POWER8 Memory Connect to SCM (socket)

One CDIMM card

One CDIMM card


POWER8 SCM

One CDIMM card

One CDIMM card

One CDIMM card

One CDIMM card

One CDIMM card

One CDIMM card


8 CDIMMS per SCM
Each CDIMM adds memory bandwidth
Each CDIMM adds L4 cache of 16MB

2014 International Business Machines Corporation

53

POWER8 Memory CDIMMs Rule


One optional
CDIMM card

One optional
CDIMM card
POWER8 SCM

One optional
CDIMM card

One optional
CDIMM card

One mandatory
CDIMM card
One mandatory
CDIMM card

One mandatory
CDIMM card

Min 50% GB activated

One mandatory
CDIMM card

8 CDIMM slots per SCM (2 feature codes per SCM)


Minimum one memory feat code any size (four identical CDIMM) per SCM
Optional second memory feature (four identical CDIMM) per SCM
2nd memory feature code same capacity as 1st memory feature code
2014 International Business Machines Corporation

54

Memory Bandwidth per E870/E880 Socket (SCM)

3x more than POWER7

POWER8

POWER7

POWER6

POWER5

50

100

150

200

250

GB/Sec
2014 International Business Machines Corporation

56

System Node PCIe 3

2014 International Business Machines Corporation

61

POWER8 Integrated PCI Gen 3


POWER8

POWER7

GX
Bus

PCIe Gen3

I/O
Bridge
PCIe Gen2

PCI
Device

PCI
Devices
2014 International Business Machines Corporation

62

E870/E880 System Node I/O Bandwidth


(System node or processor enclosure or CEC drawer)

POWER8 E870

POWER7+ 770

POWER7 770

POWER6 570
0

50

100

150

200

250

300

GB/Sec
2014 International Business Machines Corporation

63

System Node PCIe slots


8 PCIe Gen3 x16 low profile (LP)

Slots use a new low


profile blind swap
cassette (BSC). Server
comes fully populated
with BSC. No special
feat code associated with
BSC.

Eight Low profile (LP) adapter slots


- Used for PCIe adapters (Gen1, Gen2 or Gen3 LP adapters)
- Or used to connect to PCIe Gen3 I/O Expansion Drawer

2014 International Business Machines Corporation

66

PCIe Gen3
Gen1 x8

Gen2 x8

Gen3 x8
2.5 GHz

Though these cards physically look the same and fit in the same slots
Gen3 cards/slots have up to 2X more bandwidth than Gen2 cards/slots
Gen3 cards/slots have up to 4X more bandwidth than Gen1 cards/slots
More I/O virtualization
More I/O consolidation
saving PCI slots and I/O drawers
More I/O ports per adapter
18
16
14
12

Peak

A Gen1 x8 PCIe adapter has a theoretical max (peak)


bandwidth of 4 GB/sec.
A Gen2 x8 adapter has a peak bandwidth of 8 GB/sec.
A Gen3 x8 adapter has a peak bandwidth of 16 GB/sec.

Sustained

10
8
6
4
2
0

Gen1

Gen2

Gen3

2014 International Business Machines Corporation

67

PCIe x8 and x16

POWER8 servers have x8


AND x16 PCIe slots
Compared to POWER7+ PCIe Gen2 x8 slot, a POWER8
PCIe Gen3 x16 slot has a peak bandwidth of 4X (2X
going Gen2 to Gen3 plus 2X going x8 to x16)

x8

x1

x4

x8

x16

x16

x16 slot/card has more connections than a x8 slot/card


x16 or x8 refers to the number of lanes. More lanes = more physical
connections = more bandwidth
A x8 card can be placed in a x16 slot, but only uses half the connections
2014 International Business Machines Corporation

68

System Node PCIe Adapters


Slots use a new low profile blind
swap cassette (BSC).
Server comes fully populated with
BSC.

Description
Ethernet 2-port 10Gb
Ethernet 2-port 40Gb
Ethernet 4-port 1Gb RJ45
Ethernet 2-port 1Gb RJ45
Ethernet 4-port 10+1Gb SR+RJ45
Ethernet 4-port 10+1Gb SFP+Cu+RJ45
Fibre Channel HBA 2-port 16Gb
Fibre Channel HBA 4-port 8Gb
Fibre Channel HBA 2-port 8Gb
SAS 4-port 6Gb
SAS 4-port 6Gb
USB-3 4-port

Other info
NIC & RoCE*
NIC & RoCE*
NIC
NIC 10G BaseT
NIC FCoE* SR-IOV**
NIC FCoE* SR-IOV**

Card to connect to PCIe I/O drawer

See also larger PCIe list of supported adapters in I/O drawer

2014 International Business Machines Corporation

LP feat #
EC29
EC3A
5260
EN0X
EN0J
EN0L
EN0B
EN0Y*
5273
EJ0M
EJ11
EC45

Equiv FH #
EC30
EC3B
5899
EN0W
EN0H
EN0K
EN0A
5729*
5735
EJ0J
EN10
EC46

EJ07

n/a
* use of RoCE or FCoE optional
** SOD for POWER8
69

SOD : More PCIe Adapters for System Node


Not planned for 2014

IBM plans to support additional PCIe adapters on the Power E870/E880


to provide additional I/O configuration flexibility to clients. The following
low profile adapters are planned to be placed in the E870/E880 system
node drawers:

PCIe LP POWER GXT145 Graphics Accelerator (#5269)


PCIe LP 10GbE SR 1-port Adapter (#5275)
PCIe LP 4Gb 2-Port Fibre Channel Adapter (#5276)
PCIe2 LP 4-Port 10GbE&1GbE SR&RJ45 Adapter (#5280)
PCIe2 LP 2-Port 4X IB QDR Adapter 40Gb (#5283)
PCIe2 LP 2-port 10GbE SR Adapter (#5284)
PCIe2 LP 3D Graphics Adapter x1 (#EC41)
PCIe2 LP 4-Port (10Gb+1GbE) SR+RJ45 Adapter (#EN0T)
PCIe2 LP 4-port (10Gb+1GbE) Copper SFP+RJ45 Adapter (#EN0V)
PCIe LP 2-Port Async EIA-232 Adapter (#EN28)

IBMs statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBMs sole discretion. Information
regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.
The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or
functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any
future features or functionality described for our products remains at our sole discretion.

2014 International Business Machines Corporation

70

PCIe Gen3
I/O Expansion Drawer
2014 International Business Machines Corporation

72

PCIe Gen3 I/O Expansion Drawer

Front view

Feat #EMX0

12 PCIe Gen3 slots


4U drawer
Full high PCIe slots
Hot plug PCIe slots
Feat #EMXF
Rear view

Modules not hot plug

Feat #EMXF

Fan-out Module
6 PCIe Gen3 Slots
4 x8 & 2 x16

Fan-out Module
6 PCIe Gen3 Slots
4 x8 & 2 x16

Use same Blind Swap Cassette (BSC) as used


in #5802/5877/5803/5873 I/O drawer

2014 International Business Machines Corporation

73

PCIe Gen3 I/O Drawer


PCIe Optical Interface to
system node, 2 CXP ports

PCIe Optical Interface to


system node, 2 CXP ports

Fan-out Module

Fan-out Module

Rear view
Each fan-out module has two CXP ports
One active optical cable (AOC) connects to each port
Order one pair of cables (one feat code) per fan-out module:
#ECC6 2 meter optical cable pair
#ECC8 10 meter optical cable pair

2014 International Business Machines Corporation

74

One System Node to PCIe Gen3 I/O Drawer (o or 2, no 1)


Rear system
node

PCIe3 Optical Cable Adapter


(#EJ07)
One #EJ07 per fan-out module
Can be in any of nodes x16

PCIe slots

AOC cable pairs


#ECC6 2 meter length
#ECC8 10 meter length
One feat code ships two
identical cables

Connect top CXP port of #EJ07 to top CXP


port of fan-out module. Likewise connect
bottom port to bottom port. Do NOT
reverse !!
Do NOT mix lengths of AOC cables for the
same fan-out module
Do NOT cross cables connecting one fanout module to two different #EJ07 adapters
Each cable has two electrical-to-optical
convertors in the transceiver/CXP module
at each cable end. 12-lane optical cables
are used for bandwidth and for incremental
redundancy.

Active Optical
Cable Pair

fan-out module

Active Optical
Cable Pair

fan-out module

** Second I/O drawer not show for visual simplicity


2014 International Business Machines Corporation

75

Min/Max PCIe I/O Drawer per System : 2014


Two system node
One system node

Two system node

Two system node

One system node

+
0

1
2

+
0

2
3

4
0 or 2 PCIe Gen3 I/O
Drawers in 2014

0, 2 or 4 PCIe Gen3 I/O Drawers in 2014


(max 4 fan-out modules per node)

2014 International Business Machines Corporation

77

SOD : PCIe Gen3 I/O Drawer E870/E880


IBM plans to support up to four PCIe Gen3 I/O drawers per
Power E870/E880 system node drawer, providing additional
configuration flexibility and system growth.
IBMs statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBMs sole discretion. Information regarding potential future
products is intended to outline our general product direction and it should not be relied on in making a purchasing decision. The information mentioned regarding potential
future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be
incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.

Sample quantities of PCIe


drawers on the server
0
2
4
8
12

PCIe slots per


1-node server
8
28

PCIe slots per


2-node server
16
36

PCIe slots per 4-node


server (2015)
32
52

24 drwr + 4 node

24 drwr + 12 node

24 drwr + 28 node

48 (SOD)

56

72

48 drwr + 0 node

48 drwr + 8 node

48 drwr + 24 node

n/a

96 (SOD)

112

96 drwr + 0 node

96 drwr + 16 node

n/a

152 (SOD)

n/a

144 drwr + 8 node

16

n/a

n/a

192 (SOD)
192 drwr + 0 node

Not all possible quantities


of drawers shown
2014 International Business Machines Corporation

79

2014 Supported PCIe I/O Drawer Cabling Examples


Note the single blue/green/etc lines below each depicts two physical AOC cables
system
node

system
node

system
node

system
node

system
node

PCIe I/O
Drwr

PCIe I/O
Drwr

PCIe I/O
Drwr

PCIe I/O
Drwr

Split 50-50

No split

Split 25-75

Notes:
With two system nodes it is a good practice (but not required) to
attach the two fan-out modules in one I/O drawer to different system
nodes. Combined with placing redundant PCIe adapters in different
fan-out modules, system availability is enhanced.
PCIe I/O drawer can be in the same or different rack as the system
nodes. If large numbers of I/O cables are attached to PCIe adapters,
its nice to have the I/O drawer in a different rack for cable
management ease
System control unit not shown for visual simplicity
2014 International Business Machines Corporation

PCIe I/O
Drawers

Max 4 fan-out
modules per node
81

2014 Unsupported PCIe I/O Drawer Cabling Examples


Note the single blue/green/etc lines below each depicts two physical AOC cables
system
node

PCIe I/O
Drwr

system
node

system
node

PCIe I/O
Drwr

PCIe I/O
Drwr

Invalid in 2014
Cabling a drawer
(only one fan-out module per
drawer) not supported

2014 International Business Machines Corporation

Invalid in 2014
Just one drawer
not supported

system
node

PCIe I/O
Drwr

PCIe I/O
Drwr

PCIe I/O
Drwr

Invalid in 2014
Three drawers
per node not
supported. See
SOD

Invalid in 2014
max two, not
four drawers per
node. See SOD
82

PCIe IO Drawer Comparison


PCIe Gen3 I/O Drawer
#EMX0

12X PCIe Gen1 I/O Drawer


#5802 (or #5877)

POWER8

POWER6 & POWER7

PCIe Gen3 x16

GX++ (12X (InfiniBand DDR))

Two 32GB/s

One 20GB/s (potentially shared


with 2nd drawer)

Dual PCIe Gen3


Point to Point
Active Optical Cable x8

12X Cable Loop

Gen3 x8 & x16

Gen1 x8

N/A

System technology
Host Interface
System connection
Bandwidth
Cable
PCIe slots
PCIe Modular Bays

PCIe Slots
PCIe Card Sizes

12

(note: use 2 slots in node)

10

Full Height / Full Length

Full Height / Full Length

Size Drawer

4U

4U

# SAS Bays

18 in #5802
0 in #5877

Power Supplies

2 / Redundant

2 / Redundant

Fans

4 / Redundant

2 / Redundant

2014 International Business Machines Corporation

88

Power E870/E880 Full High PCIe Adapters Supported


as of October 2014 (page 1)
Ethernet NIC
Ethernet NIC
Ethernet NIC & FCoE
Ethernet NIC
Ethernet NIC
Ethernet NIC & RoCE
Ethernet NIC
Ethernet NIC
Ethernet NIC &
OpenOnload
Ethernet NIC & RoCE
Ethernet NIC
Ethernet NIC
Ethernet NIC
Ethernet NIC
Ethernet NIC & FCoE
Ethernet NIC & RoCE

4-port 1GbE
RJ45
2-port 10GbE
10GBase-T
RJ45
4-port 10GbE+1GbE SR+RJ45
4-port 10GbE+1GbE
SR optical
4-port 10GbE+1GbE
Copper twinax
2-port 10GbE
SR optical
2-port 10GbE
SR optical
1-port 10GbE LR optical (IBM i native)

#5899
#EN0W
#EN0H
#EN0S
#EN0U
#EC30
#5287
#5772

2-port 10GbE

#EC2J

Copper twinax

2-port 40GbE
QSFP+
2-port 1GbE
RJ45
2-port 1GbE
SX optical
4-port 1Gbe
RJ45
1-port 10GbE
SR optical
4-port 10GbE+1GbE Copper
Twinax+RJ45
2-port 10GbE
Copper twinax

#EC3B
#5767
#5768
#5717
#5769
#EN0K
#EC28

* initially announced without NIM, NIM added late Aug


2014 International Business Machines Corporation

89

Power E870/E880 Full High PCIe Adapters Supported


as of October 2014 (page 2)
Fibre Channel
Fibre Channel
Fibre Channel
Fibre Channel

2-port
4-port
2-port
2-port

Communications
Communications
Communications
Communications

1-port Bisync
(IBM i)
2-port Async/Bisync (IBM i)
4-port Async (AIX / Linux)

#EN13, #EN14
#2893, #2894
#5785

2-port Async RS232

#EN27

SAS RAID
SAS Tape/DVD
SAS RAID
SAS RAID/Tape/DVD
SAS RAID
SAS RAID

4-port no-cache PCIe3 for SSD/HDD


4-port tape/DVD PCIe3
4-port huge-cache PCIe3 for SSD/HDD
2-port no-cache PCIe1 for HDD
3-port large cache PCIe2 HDD/SSD
3-port large cache PCIe2 HDD/SSD

2014 International Business Machines Corporation

8Gb
8Gb
16Gb
4Gb

#5735
#5729
#EN0A
#5774

5289/5290 replace

#EJ0J
#EJ10
#EJ0L
#5901
#5913
#ESA3

90

Power E870/E880 Full High PCIe Adapters Supported


as of October 2014 (page 3)

Infiniband (IB)

2-port QDR IB

Graphics
Graphics

2D graphics for general use


3D graphics for RHEL7

#5748
#EC42

Encryption

Crypto Coprocessor 4765-001

#EJ28

USB

4-port USB-3

#EC46

2014 International Business Machines Corporation

SR optical

IBM & Business Partner Confidential until Announcement

#5285

91

SOD : More PCIe Adapters for PCIe Gen3 Drawer


Not planned for 2014

IBM plans to support additional PCIe adapters on the Power E870/E880


to provide additional I/O configuration flexibility to clients. The following
full high profile adapters are planned to be placed in the PCIe Gen3 I/O
drawer:

PCIe2 4-Port (10GbE & 1GbE) SR&RJ45 Adapter (#5744)


10Gb FCoE PCIe Dual Port Adapter (#5708)
PCIe 380MB Cache Dual Port 3Gb SAS RAID Adapter (#5805)
PCIe2 4-port (10Gb FCoE & 1GbE) LR&RJ45 Adapter (#EN0M)

IBMs statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBMs sole discretion. Information
regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.
The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or
functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any
future features or functionality described for our products remains at our sole discretion.

2014 International Business Machines Corporation

92

Full High PCIe Adapters NOT Supported: Oct 2014


#2054 or #2055 PCIe RAID & SSD SAS Adapter
#2728 4 port USB PCIe Adapter (use #EC46 instead)
#4808 PCIe Crypto Coprocessor Gen3 BSC 4765-001
Use EJ28 instead (also check RPQ 8A228 for exceptions)

#4809, PCIe Crypto Coprocessor Gen4 BSC 4765-001

Wrong BSC, wont fit in PCIe Gen3 I/O drawer see #4808

#5288 PCIe2 2-Port 10GbE SFP+ Copper Adapter


#5289 2 Port Async EIA-232 PCIe Adapter
#5732 10 Gigabit Ethernet-CX4 PCI Express Adapter
#5745 PCIe2 4-Port 10GbE&1GbE SFP+Copper&RJ45 Adapter
#5773, 4 Gigabit PCI Express Single Port Fibre Channel Adapter
#5903 PCIe 380MB Cache Dual - x4 3Gb SAS RAID Adapter
(use #5805 instead when #5805 supported)

#EC2K
#EJ0X
#ESA1,
#ES09,

PCIe2 2-port 10GbE SFN5162F Adapter


PCIe3 SAS Tape Adapter Quad-port 6Gb
PCIe2 RAID SAS Adapter Dual-port 6Gb
IBM Flash Adapter 90

(use #EC2J instead)


(use #EJ10 instead)
(use #EJ0J instead)

The following are currently unsupported, but see SOD


#5744 PCIe2 4-Port (10GbE & 1GbE) SR&RJ45 Adapter
#5708 10Gb FCoE PCIe Dual Port Adapter
#5805 PCIe 380MB Cache Dual Port 3Gb SAS RAID Adapter
#EN0M PCIe2 4-port (10Gb FCoE & 1GbE) LR&RJ45 Adapter
2014 International Business Machines Corporation

IBM & Business Partner Confidential until Announcement

93

Quick Reference Tool for PCIe Adapters


Quickly see first-level information on adapters, adapter slots, OS pre-req
Gen1/Gen2?, LP/FH?, equivalent feat code?, what type slot?, what drawer? etc
(Pre-req Tool and other existing documentation still the source for real detailed information)

Download your own copy of this spreadsheet (not for clients at this time)
IBMers: http://w3.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/TD105846
Partners: http://partners.boulder.ibm.com/src/atsmastr.nsf/WebIndex/TD105846

As of 25 Nov, PCIe Spreadsheet not updated yet. However in a PCIe Gen3 I/O
drawer fan-out module, bandwidth of one system node PCIe slot is shared by six PCIe
slots. It is possible to have multiple high bandwidth adapters in the fan-out module
which together require more bandwidth than available.
The PCIe Spreadsheet has sizing factors for individual adapters relating to bandwidth.
Use the same sizing factors/logic for the PCIe adapters for
POWER7/POWER7+/POWER8 servers, but instead of the max GX++ subtotal value of
60 Gb/s used for POWER7/POWER7+, use 96 Gb/s for one EMXF fan-out

module (6 slots).

2014 International Business Machines Corporation

95

Racking
Considerations
2014 International Business Machines Corporation

97

Sample Rack Configurations


9119-MHE (E880)

9119-MME (E870)
42
41
40
39
38
37
36
35
34
33
32
31
30
29
28
27
26
25
24
23
22
21
20
19
18
17
16
15
14
13
12
11
10
9
8
7
6
5
4
3
2
1

PDU location
for IO drws

PDU
PDU

24u available for


IO drws / HMC

B
e
a
r
p
a
w

5
8
9
9

E
N
0
B

B
e
a
r
p
a
w

5
8
9
9

E
N
0
B

E
N
0
J

E
N
0
J

E
N
0
B

5
8
9
9

B
e
a
r
p
a
w

5
8
9
9

B
e
a
r
p
a
w

Sys Cntrl Unit

FSP / Clk
E
N
0
J

E
N
0
J

E
N
0
B

System node
Drw 1

System node
Drw 2

PDU
PDU

2014 International Business Machines Corporation

#ER2B
2u reserved for
cable handling

42
41
40
39
38
37
36
35
34
33
32
31
30
29
28
27
26
25
24
23
22
21
20
19
18
17
16
15
14
13
12
11
10
9
8
7
6
5
4
3
2
1

PDU location
for IO drws

PDU
PDU

12u available for


IO drws

#ER16
5u space reserved for
System node
B
e
a
r
p
a
w

5
8
9
9

E
N
0
B

E
N
0
J

E
N
0
J

E
N
0
B

5
8
9
9

B
e
a
r
p
a
w

Sys Cntrl Unit

FSP / Clk
B
e
a
r
p
a
w

5
8
9
9

E
N
0
B

E
N
0
J

E
N
0
J

E
N
0
B

System node
Drw 1

5
8
9
9

B
e
a
r
p
a
w

System node
Drw 2

#ER16
5u space reserved for
System node
2u space reserved for PDUs

Note: horizontal PDUs

PDU
PDU

#ER2B
2u reserved for
cable handling
98

E870/880 Racking - Only Enterprise 42U Rack


Only the IBM Enterprise rack (7014-T42 or #0553) have been
tested/certified by IBM Development/Test with the E870/E880 as of Oct/Nov
2014. Therefore the 7014-T42 or #0553 is the only rack IBM Manufacturing
uses with E870/E880 system nodes.
If a different rack (IBM or nonIBM) is desired, work with IBM Service
organization to confirm the rack has the needed strength, rigidity, hole
spacing, clearances, etc. IBM Service does not require certification by IBM
Development/Test to be able to provide service/warranty in other racks.
FYI -- url for the specs the rack has to meet: http://www01.ibm.com/support/knowledgecenter/9119-MHE/p8had/p8had_oemrack.htm?lang=en

If OEM rack meets these specs they should work. Note, the client is responsible for
verifying with their rack manufacturer that their non-IBM racks comply with IBM
specifications.

2014 International Business Machines Corporation

100

OS
Support
2014 International Business Machines Corporation

105

Power E870/E880 Operation System Support


AIX with any valid I/O config:
AIX 7.1 TL3 SP4 and APAR IV63332 or later
AIX 7.1 TL2 SP6 or later
(planned availability January 2015)
AIX 6.1 TL9 SP4 and APAR IV63331 or later
AIX 6.1 TL8 SP6, or later
(planned availability January 2015)
AIX with virtual I/O only:
AIX 7.1 TL2 SP1 or later
AIX 7.1 TL3 SP1 or later
AIX 6.1 TL8 SP1 or later
AIX 6.1 TL9 SP1 or later
IBM i
IBM i 7.2 TR1 or later
IBM i 7.1 TR9 or later
Linux
Red Hat Enterprise Linux 6.5 or later
SUSE Linux Enterprise Server 11 SP3 and later SPs
VIOS
VIOS 2.2.3.4 with ifix IV63331 or later
Firmware 8.2.0

2014 International Business Machines Corporation

106

Upgrade path to
E870 / E880
2014 International Business Machines Corporation

114

Model Upgrades (Same Serial Number)


E880

795
780

595

E870

770
570
750
560
740

550

720 6/8 core


520 4-core

Scale-out
1-S / 2-S

720 4 core

520 2-core
730

520 1-core

710

POWER6
2014 International Business Machines Corporation

POWER7

POWER8
115

770/780 Model Upgrades (Same Serial Number)

780
B Mdl

780
C Mdl

780+
D Mdl

E880

570

770
B Mdl

POWER6

POWER7

2014 International Business Machines Corporation

770
C Mdl

POWER7

770+
D Mdl

E870

POWER7+

116

Full Set of 770+/780+ to 870/880 Processor Conversions


TO Power E870 9119-MME
EPBA 4.02GHZ
PROC (32c node)

FROM
Power 770
9117-MMD

EPBC 4.19 GHz


40c node

EPM1 (3.808 GHz


16c node)

Yes

Yes

EPM0 (4.228 GHz


12c node)

Yes

Yes

TO Power E880 9119-MHE


FROM
Power 780
9179-MHD

EPBB 4.35 GHz


32c node
EPH0 (4.42 GHz
16c node)

Yes

EPH2 (3.61 GHz


32c node)

Yes

2014 International Business Machines Corporation

118

POWER6 570 to POWER8 E8x0 Upgrades


570

780
770

E880
E870

IMPORTANT -- No one-step upgrades where two model upgrades are


implemented over one long weekend.

Must do two upgrades ideally separated by several months time


POWER6POWER7+ and then POWER7+POWER8
This is a legal / business practices requirement. This must be treated as two
steps from an accounting/financial perspective.
Note the IBM ordering/manufacturing systems key off the POWER6POWER7+ installation
before allowing the POWER7+POWER8 upgrade to be ordered

Words from IBM Business Practices: The client must buy the POWER7+ upgrade for purpose of
using the POWER7+ 770/780, not solely as a step to the E870/E880. And, they must get business
value out of the POWER7+ 770+/780 for at least 90 days. Finally, the upgrade to the POWER8 server
needs to be sold separately / independently of the upgrade to POWER7+ 770/780.

Additional notes:
Assuming historical practices maintained, upgrades from a POWER6 570 to a POWER7+
770/780 will be withdrawn when IBM withdraws the sales of new serial number 770/780.
Conversions from a POWER6 9406-MMA to a POWER6 9117-MMA are NOT considered a
step requiring a significant time pause in the above no one-step rule. However
manufacturing systems wont accept a 9117-MMA770/780 order until 94069117 MES
shows as installed.
2014 International Business Machines Corporation

120

POWER7 770/780 to POWER8 E8x0 Upgrades


E880

780
770

780+

770+

E870

IMPORTANT -- No one-step upgrades where two model upgrades are


implemented over one long weekend.
Must do two upgrades ideally separated by several months time
POWER7POWER7+ . and then POWER7+POWER8
This is a legal / business practices requirement. This must be treated as
two steps from an accounting/financial perspective.
Note the IBM ordering/manufacturing systems key off the POWER7POWER7+
installation before allowing the POWER7+POWER8 upgrade to be ordered

Words from IBM Business Practices: The client must buy the POWER7+ upgrade
for purpose of using the POWER7+ 770/780, not solely as a step to the E870/E880.
And, they must get business value out of the POWER7+ 770+/780 for at least 90
days. Finally, the upgrade to the POWER8 server needs to be sold separately /
independently of the upgrade to POWER7+ 770/780.

2014 International Business Machines Corporation

121

Existing/Older I/O Drawers Considerations


for attaching E870/E880

12X-attached PCIe I/O drawers

NOT supported

No GX++ attach on POWER8 -- move drawer content, but not drawer


19-inch #5802/5877
24-inch #5803/5873

12X-attached PCI-X I/O drawers


19-inch #5796

NOT supported

24-inch #5797/5798

#5887 EXP24S SAS I/O Drawer

Supported

(2.5-inch drives)

Older storage drawers not supported


#5886 EXP12S SAS I/O Drawer NOT supported
#5786 EXP24 SCSI I/O Drawer NOT supported
2014 International Business Machines Corporation

(3.5-inch drives)
(3.5-inch drives)
122

POWER8 I/O Migration Considerations: Disk & SSD

Drives in #5887 EXP24S I/O Drawer (SFF-2)


All disk drives supported.
All 387GB or larger SSD supported (177GB SSD not supported)
PCIe-attached drawer can move intact. Simply move attaching PCIe adapter to
POWER8 PCIe slot

Drives in POWER7 system unit or in #5802/5803 I/O drawer (SFF-1)


Drives supported but need to be retrayed. Once on SFF-2 carrier/tray can use in
#5887 EXP24S drawer.
Retraying done either in advance on POWER7 server or during upgrade/migration to
POWER8 server
All disk drives supported. All 387GB or larger SSD supported (177GB eMLC1 SSD not supported)

Drives in FC-attached SAN not impacted, just move FC card.


With PowerVM VIOS and Live Partition Mobility makes even easier

2014 International Business Machines Corporation

123

Full High PCIe Adapters NOT Supported: Oct


#2054 or #2055 PCIe RAID & SSD SAS Adapter
#2728 4 port USB PCIe Adapter (use #EC46 instead)
#4808 PCIe Crypto Coprocessor Gen3 BSC 4765-001
Use EJ28 instead (also check RPQ 8A228 for exceptions)

#4809, PCIe Crypto Coprocessor Gen4 BSC 4765-001

Wrong BSC, wont fit in PCIe Gen3 I/O drawer see #4808

#5288 PCIe2 2-Port 10GbE SFP+ Copper Adapter


#5289 2 Port Async EIA-232 PCIe Adapter
#5732 10 Gigabit Ethernet-CX4 PCI Express Adapter
#5745 PCIe2 4-Port 10GbE&1GbE SFP+Copper&RJ45 Adapter
#5773, 4 Gigabit PCI Express Single Port Fibre Channel Adapter
#5903 PCIe 380MB Cache Dual - x4 3Gb SAS RAID Adapter
(use #5805 instead when #5805 supported)

#EC2K
#EJ0X
#ESA1,
#ES09,

PCIe2 2-port 10GbE SFN5162F Adapter


PCIe3 SAS Tape Adapter Quad-port 6Gb
PCIe2 RAID SAS Adapter Dual-port 6Gb
IBM Flash Adapter 90

(use #EC2J instead)


(use #EJ10 instead)
(use #EJ0J instead)

The following are currently unsupported, but see SOD


#5744 PCIe2 4-Port (10GbE & 1GbE) SR&RJ45 Adapter
#5708 10Gb FCoE PCIe Dual Port Adapter
#5805 PCIe 380MB Cache Dual Port 3Gb SAS RAID Adapter
#EN0M PCIe2 4-port (10Gb FCoE & 1GbE) LR&RJ45 Adapter
2014 International Business Machines Corporation

IBM & Business Partner Confidential until Announcement

124

POWER6 / POWER7 / POWER8 Live Partition Mobility

AIX 7.1
AIX 7.1
AIX 6.1
AIX 6.1

AIX 7.1

AIX 7.1

AIX 7.1

AIX 7.1

AIX 6.1

AIX 6.1

AIX 6.1

AIX 6.1

AIX 5.3
AIX 5.3

AIX 5.3

IBM i 7.1

IBM i 7.1 *

IBM i 7.2

IBM i 7.2 *

Linux

POWER6/6+

Linux

Linux

POWER7

Linux

Linux

POWER8

Leverage POWER6 / POWER7 Compatibility Modes


LPAR Migrate between POWER6 / POWER7 / POWER8 Servers
Can not move POWER8 Mode partitions to POWER6 or POWER7 systems.
* shipped for POWER8 Sept 2014
2014 International Business Machines Corporation

128

Migrating to E870/E880 using


Power Enterprise Pools
2014 International Business Machines Corporation

130

POWER7+ P770D Migration to POWER8 E870


POWER7+ P780D Migration to POWER8 E880

Power Enterprise Pool


1.

Have an existing POWER7+ P770D/P780D server with Mobile CPU Cores/RAMs

2.

Purchase a new POWER8 E870/E880 server with minimum required activations of


CPU Cores/RAMs

3.

Join together existing POWER7+ P770D/P780D server & new E870/E880 with Power
Enterprise Pool (thru IBMs Power Enterprise Pool registration process)

4.

Transfer POWER7+ Mobile CPU/RAM activations to new E870/E880 as Production

5.

Migrate customers applications to POWER8 :


- can use LPM (Live Partition Mobility) for migration if there is a ready LPM environment

6.

POWER7+ server can be used as HA/DR or other purposes


131

Thanks!
2014 International Business Machines Corporation

197

Das könnte Ihnen auch gefallen