NGT113G02

NGT11
IBM PureFlex System Fundamentals
IBM Flex System Enterprise Chassis
Copyright IBM Corporation 2012, 2013

Course materials may not be reproduced in whole or in part without the prior written permission of IBM.
9.0
Unit objectives
After completing this unit, you should be able to:
Summarize the features of the IBM Flex System Enterprise Chassis
Identify the major elements of the IBM Flex System Enterprise Chassis
Explain the power features of the IBM Flex System Enterprise Chassis
Explain the cooling features of the IBM Flex System Enterprise Chassis
Explain the management features of the IBM Flex System Enterprise
Chassis
IBM Flex System Enterprise Chassis topics

IBM Flex System Enterprise Chassis overview and architecture
IBM Flex System Enterprise Chassis components
Power supplies
Fan modules
Fan logic module
Front information panel
Cooling
IBM Flex System Enterprise Chassis I/O

architecture
Chassis Management Module
At a glance
Support for technology
advancements
Current and future high performance

processors, memory, I/O, and storage
Fast, faster, fastest
Faster internal bus speeds

Faster I/O speeds
Energy efficiency
High efficiency components

Sophisticated control systems
Support for Intel and Power

Systems nodes in same chassis
Large portfolio of switch and I/O
adapter choices and speeds
Integrated management node and
chassis management elements
System specifications
10U in size
14 horizontal, half-width bays
Support for x86 and Power Systems compute nodes
IBM Flex System Manager Node
Includes Chassis Management Module
Up to six 2500 W or 2100 W power supplies
Up to four I/O modules
Two 40 mm fan modules
Up to eight 80 mm fan modules
Two fan logic modules
Product overview (1 of 3)
IBM Flex System Enterprise
Chassis
10U server platform
Front access components
Seven (full-width) horizontally
oriented bays
Height of each bay is 57 mm
Each chassis bay supports
either:
> Two half-width nodes
> One full-width node
Half-width node limited to

single height
Full-width node supports
double-height
Rear access components
Four vertically oriented, I/O
module bays
Two Chassis Management
Module bays
Two fan logic modules
Two 40 mm fan module bays
Eight 80 mm fan module bays
Six power supply bays
IBM Flex System Enterprise Chassis major components include
Chassis Management Modules
Compute nodes
Storage nodes
Expansion nodes
I/O modules
Power supply modules
Fan distribution cards
Fan modules
Fan logic modules
Front and rear LED panel
Models (type 8721)

8721-A1x
8721-LRx
Description
IBM Flex System Enterprise chassis
Chassis management module
2500 W power supply
2100 W power supply
80 mm fan module
40 mm fan module
Console Breakout Cable
C19 to C20 2M power cables
Rack mount kit

Front view
447 mm
800 mm
10U
(440 mm)
Chassis
bays
containing
half-width
node
Chassis
bays
containing
full-width
node
Front
information
panel
Rear view
Two 40 mm
fan bays
Eight
80 mm fan
bays
Two Chassis
Management
Module bays
Six power
supply bays
Four I/O
module bays
Chassis component parts
Midplane: Front view

Node power
connectors
Management
connectors
I/O adapter
connectors
Midplane: Rear view

I/O module
connectors
Chassis
Management
Module
connectors
Power supply
connectors
Personality card
connector
Fan power and

signal connectors
Compute node insertion
Chassis bay numbering (1 of 3)

Bay 13
Bay 14
Bay 11
Bay 12
Bay 9
Bay 10
Bay 7
Bay 8
Bay 5
Bay 6
Bay 3
Bay 4
Bay 1
Bay 2

Bay 13
Bay 14
Bay 11
Bay 12
Bay 9
Bay 10
Bay 7
Bay 5
Bay 6
Bay 3
Bay 1
Bay 2
Ten half-width / two full-width


Bay 13
Bay 14
Bay 11
Bay 12
Bay 7
Bay 5
Bay 6
Bay 3
Bay 1
Bay 2
Eight half-width / one full-width

One full-width double-height
Chassis air filter
Air
filter
Hot plug and hot swap components
Component
Hot plug
Hot swap
Node
Yes
Noa
I/O module
Yes
Yesb
40 mm fan pack
Yes
Yes
80 mm fan pack
Yes
Yes
Power supply
Yes
Yes
Fan logic module
Yes
Yes

Power supplies
Fan modules
Fan logic module
Cooling

architecture
IBM Flex System 2100 W power supply option

Enables a lower price point for
chassis configurations with
reduced power requirements
Maintains full support of
networking and
integrated storage options
Power supply location and numbering
Power supply
bay 6
Power supply
bay 3
Power supply
bay 5
Power supply
bay 2
Power supply
bay 4
Power supply
bay 1
Power policies
Five power management
policies can be applied.
AC power source redundancy
AC power source redundancy
with compute node throttling
allowed
Power module redundancy
Power module redundancy with
compute node throttling allowed
Basic power management
Power policies are applied

through the Chassis
Management Module.
Power supply
LEDs (left to right)
AC power
DC power
Fault
Removal
latch
Pull handle
Power supply selection matrix (1 of 3)

2100 W power supplies installed
x220 TDP
processor
rating
N+1, N=5
6 power
supplies
N+1, N=4
5 power
supplies
N+1, N=3
4 power
supplies
N+N, N=3
6 power
supplies
N+1, N=5
6 power
supplies
N+1, N=4
5 power
supplies
N+1, N=3
4 power
supplies
N+N, N=3
6 power
supplies
50W
14
14
14
14
14
14
14
14
60W
14
14
14
14
14
14
14
14
70W
14
14
14
14
14
14
14
14
80W
14
14
14
14
14
14
14
14
95W
14
14
14
14
14
14
14
14
50W
14
14
13
14
14
14
14
14
60W
14
14
12
13
14
14
14
14
70W
14
14
11
12
14
14
14
14
80W
14
14
10
11
14
14
13
14
95W
14
13
10
14
14
12
13
x222 TDP
processor
rating

x240 TDP
processor
rating
N+1, N=5
6 power
supplies
N+1, N=4
5 power
supplies
N+1, N=3
4 power
supplies
N+N, N=3
6 power
supplies
N+1, N=5
6 power
supplies
N+1, N=4
5 power
supplies
N+1, N=3
4 power
supplies
N+N, N=3
6 power
supplies
60 W
14
14
14
14
14
14
14
14
70 W
14
14
13
14
14
14
14
14
80 W
14
14
13
13
14
14
14
14
95 W
14
14
12
12
14
14
14
14
115 W
14
14
11
12
14
14
14
14
130 W
14
14
11
11
14
14
13
14
135 W
14
14
10
11
14
14
13
14
95 W
115 W
130 W
x440 TDP
processor
rating
N+1, N=5
6 power
supplies
N+1, N=4
5 power
supplies
N+1, N=3
4 power
supplies
N+N, N=3
6 power
supplies
N+1, N=5
6 power
supplies
N+1, N=4
5 power
supplies
N+1, N=3
4 power
supplies
N+N, N=3
6 power
supplies
p24L all models
14
12
10
14
14
12
13
p260 all models
14
12
10
14
14
12
13
p270 all models
14
12
14
14
12
12
p460 all models
FSM
V7000

Power supplies
Fan modules
Fan logic modules
Cooling

architecture
Fan module location and numbering

Fan module bay 10
Fan module bay 5
Fan module
bay 9
Fan module
bay 4
Fan module
bay 8
Fan module
bay 3
Fan module
bay 7
Fan module
bay 2
Fan module
bay 6
Fan module
bay 1
40 mm fan module
The 40 mm fan modules are
located at the top of the
chassis.
Location of 40 mm fan modules
Installed in fan module bays 5

and 10
They are used to distribute

cooling to:
I/O modules
Removal latch
Chassis Management Modules
LEDs on back of fan module:

Power on (green)
Fault (amber)
Pull handle
80 mm fan module
Location of 80 mm fan modules
The 80 mm fan modules are

located in two columns in the
rear of the chassis.
Installed in fan module bays
1 4 and 6 9
Removal latch
Pull handle
They are used to distribute

cooling to any components
installed in the 14 chassis
bays.
LEDs on back of fan module:

Power on (green)
Fault (amber)
Fan logic module location and numbering
Fan logic
module bay 2
Fan logic
module bay 1
Fan modules: Base configuration
Node bays
Cooling zone
Cooling zone
Fan modules: Eight nodes installed
Node bays
Cooling zone
Cooling zone
Fan modules: Maximum configuration
Node bays
Cooling zone
Cooling zone

Power supplies
Fan modules
Fan logic modules
Cooling

architecture
Rear chassis LEDs

Power supplies
Fan modules
Fan logic modules
Cooling

architecture
Upper and lower cooling apertures

Upper
cooling
apertures
Lower
cooling
apertures
Chassis air flow (1 of 3)

80 mm fan
packs
Installed
compute nodes
Cool
airflow in
Cool
airflow in
Warm
airflow out
Midplane
Installed
compute nodes

Power
supplies
Installed
compute nodes
Cool
airflow in

Installed
compute nodes
40 mm fan
modules
I/O
modules
Air flow
Chassis
Management
Modules

Power supplies
Fan modules
Fan logic modules
Cooling

architecture
I/O module location and numbering

I/O module
bay 1
I/O module
bay 4
I/O module
bay 3
I/O module
bay 2
Node I/O connectors

Each compute node connects to the midplane by way of I/O connectors.
In half-width nodes, two I/O connectors

In full-width nodes, four I/O connectors
One management connector
In some systems, an embedded 10 Gb Virtual Fabric Adapter is available
LAN on Motherboard (LOM) adapter
Connected to midplane using compute node fabric connector
Uses I/O connector 1 (half-width) or I/O connectors 1 and 3 (full-width)
Half-width compute node
I/O adapter location
Full-width compute node

I/O adapter location
Fabric
connector
I/O adapters
Management
connector
I/O adapters
I/O adapter and I/O module interconnects

LOM connector (removed when I/O
adapter is installed on the Node)
Node
bay 1
Four lanes (KX-4)

or 4 10 Gbps lanes (KR)
I/O module 1
LOM
with LOM
I/O module 3
LOM not used

Node
bay 2
LOM
I/O module 2
With I/O adapter
I/O module 4
Node
Node
bay14
14
Bay
14 internal groups (of
four lanes each), one
to each node
Node to I/O module interconnects

Node
A1
1
.. I/O module 1
.
A2
Node
A1
2
.. I/O module 2
.
A2
Node
A1
3
.. I/O module 3
.
A2
Each line between an I/O adapter and

a switch is four links.
Node
14 A1
.. I/O module 4
.
A2
I/O expansion adapter form factor

All I/O expansion adapters
share one common form
factor.
Midplane
connector
96.7 mm x 84.8 mm in size

One PCIe connector
Molex 216-pin connector that

connects to I/O expansion port
on compute node
One midplane connector
Any I/O expansion adapter

can be installed in any open
I/O expansion port in any
compute node.
Guide block
PCIe
connector
LAN on Motherboard implementation

10 Gbps KR lane
P1
P2
LOM connector
LOM
P1
P2
LOM: LAN on Motherboard

Single node/two I/O adapter interconnects
P1
2-Port
I/O adapter
in slot 1
x1 Ports
P2
x1 Ports
Half-width
node
P1
P3
P5
P7
P2
P4
P6
P8
P1
P3
I/O adapter
in slot 2
P5
P7
P2
P4
4
P6
P8
I/O modules
Installing I/O modules
I/O module LEDs

Each I/O module has three
LEDs on the rear of the I/O
module.
OK (power)
On (green): I/O module on

Off; Error LED on: Critical alert
Off; Error LED off: I/O module off
Identify
Blue LED physically identify the

I/O module
Switch error (amber)
If on, indicates POST failure or

critical alert
Chassis system error LED would

also be on
OK
Off; OK (green) on: I/O module

working correctly
Identify
Switch
error

Power supplies
Fan modules
Fan logic modules
Cooling

architecture
Chassis Management Module location and

numbering
Chassis
Management
Module bay 2
Chassis
Management
Module bay 1

The Chassis Management
Module (CMM) provides the
following functions:
Power control
Fan management
Chassis and compute node
initialization
Switch management
Diagnostics
Resource discovery and
inventory management
Resource alerts and monitoring
management
Chassis and compute node
power management
Network management
Chassis Management Module LEDs

The CMM has the following controls
and LEDs:
Reset button
When pressed for less than 5 seconds, the

CMM restarts
When pressed for more than 5 seconds (for
example 10 15 seconds), the CMM is
reset to factory defaults and restarts
Power-on LED (green)
On when CMM has power
Active LED (green)
On indicates the CMM is actively controlling

the chassis
Fault LED (amber)
On when an error has been detected in the

CMM
If on, the chassis fault LED is also on
Ethernet port link (RJ-45) LED (green)
On it indicates that there is an active

connection through the remote
management and console (Ethernet) port to
the management network
Chassis Management Module ports

The CMM supports the
following connections:
USB connection
Used for insertion of a USB

media key, for tasks like
firmware updates.
10/100/1000 Mbps RJ45

Ethernet connection
For connection to a
management network. The CMM
can be managed through this
Ethernet port.
Serial port (mini-USB)
This is reserved for engineering

debug use.
Chassis management using CMM

Chassis with CMM
Chassis with CMM
Management
network
CMM capabilities
Chassis
status
Remote
control
Firmware
updates
Server &
chassis
tasks
Manage
chassis
events
CMM
Chassis
service
data
Chassis
VPD
info
Chassis
problem
areas
CMM for IBM Flex System

Provides system management functions for all devices installed in an
Enterprise chassis
Communicate with the management controller in each compute node
Each chassis supports up to two Chassis Management Modules in
activepassive
CMM is used to:
Configure recipients for alert notification of specific events

Monitor the status of the compute nodes and other components
Find chassis component information
Discover other chassis on the network and enable access to them
Control the chassis, compute nodes, and other components
Access the I/O modules to configure them
Change the startup sequence in a compute node
Set the date and time
Use a remote console for the compute nodes
Enable multi-chassis monitoring
Set power policies and view power consumption history for chassis components
Provides user repository for compute node service processors
CMM management options
Glossary
IBM Flex System Enterprise
Chassis
Half-width node
Power supply N+N configurations

Power supply N+1 configurations
Full-width node
Midplane
Upper and lower cooling apertures

I/O connectors
LAN on Motherboard (LOM)
I/O module naming scheme
Chassis bay numbering

Power management policies
Checkpoint
1. The IBM Flex System Enterprise Chassis supports which of the
following combinations of compute nodes?
a.
b.
c.
d.
Four full-width compute nodes

Fourteen half-width compute nodes
Three full-width compute nodes and five half-width compute nodes
All of the above
2. In an N+N power configuration using 2100 W power supplies, the

minimum number of power supplies required to support four x240
compute nodes is:
a.
b.
c.
d.
Two
Three
Four
Six
3. In a base configuration of the IBM Flex System Enterprise Chassis,

four 80 mm fans are installed that support up to (blank) half-width
compute nodes.
a.
b.
c.
d.
Two
Four
Six
Eight
Checkpoint solutions
1.
The IBM Flex System Enterprise Chassis supports which of the following
combinations of compute nodes?
a.
b.
c.
d.
Four full-width compute nodes

Fourteen half-width compute nodes
Three full-width compute nodes and five half-width compute nodes
All of the above
The answer is all of the above.

2.
In an N+N power configuration using 2100 W power supplies, the minimum

number of power supplies required to support four x240 compute nodes is:
a.
b.
c.
d.
Two
Three
Four
Six
The answer is two.

3.
In a base configuration of the IBM Flex System Enterprise Chassis, four 80 mm

fans are installed that support up to four half-width compute nodes.
a.
b.
c.
d.
Two
Four
Six
Eight
The answer is four.

Unit summary
Having completed this unit, you should be able to:
Summarize the features of the IBM Flex System Enterprise Chassis
Identify the major elements of the IBM Flex System Enterprise Chassis
Explain the power features of the IBM Flex System Enterprise Chassis
Explain the cooling features of the IBM Flex System Enterprise Chassis
Explain the management features of the IBM Flex System Enterprise
Chassis

NGT113G02

Hochgeladen von

Dokumentinformationen

Copyright

Verfügbare Formate

Dieses Dokument teilen

Dokument teilen oder einbetten

Freigabeoptionen

Stufen Sie dieses Dokument als nützlich ein?

Sind diese Inhalte unangemessen?

Copyright:

Verfügbare Formate

NGT113G02

Hochgeladen von

Copyright:

Verfügbare Formate

NGT11

IBM PureFlex System Fundamentals

IBM Flex System Enterprise Chassis

Copyright IBM Corporation 2012, 2013

Copyright IBM Corporation 2012, 2013

IBM Flex System Enterprise Chassis topics

IBM Flex System Enterprise Chassis I/O

Copyright IBM Corporation 2012, 2013

Current and future high performance

Fast, faster, fastest

Faster internal bus speeds

High efficiency components

Support for Intel and Power

Copyright IBM Corporation 2012, 2013

Half-width node limited to

Copyright IBM Corporation 2012, 2013

Copyright IBM Corporation 2012, 2013

Copyright IBM Corporation 2012, 2013

Models (type 8721)

IBM Flex System Enterprise chassis

Chassis management module

2500 W power supply

2100 W power supply

Console Breakout Cable

C19 to C20 2M power cables

Rack mount kit

Chassis component parts

Copyright IBM Corporation 2012, 2013

Midplane: Front view

Midplane: Rear view

Fan power and

Copyright IBM Corporation 2012, 2013

Compute node insertion

Copyright IBM Corporation 2012, 2013

Chassis bay numbering (1 of 3)

Copyright IBM Corporation 2012, 2013

Chassis bay numbering (2 of 3)

Ten half-width / two full-width

Chassis bay numbering (3 of 3)

Eight half-width / one full-width

Chassis air filter

Hot plug and hot swap components

Fan logic module

Copyright IBM Corporation 2012, 2013

IBM Flex System Enterprise Chassis topics

IBM Flex System Enterprise Chassis I/O

Copyright IBM Corporation 2012, 2013

IBM Flex System 2100 W power supply option

Copyright IBM Corporation 2012, 2013

Power supply location and numbering

Copyright IBM Corporation 2012, 2013

Power policies are applied

Copyright IBM Corporation 2012, 2013

Power supply selection matrix (1 of 3)

2500 W power supplies installed

Copyright IBM Corporation 2012, 2013

Power supply selection matrix (2 of 3)

2500 W power supplies installed

Copyright IBM Corporation 2012, 2013

Power supply selection matrix (3 of 3)

2100 W power supplies installed

2500 W power supplies installed

p24L all models

p260 all models