DMX-3 & 5771

Aug23, 2005
1
 Scope of this presentation.

z DMX – 3 (AKA Symm 7)

– Quick summary for those in the field who are not yet trained.
– Focus is on what the CE needs to know.
– Can answer customer questions.
– Explain the differences between DMX-2 and DMX-3
– Can help yourself if you see the product.

z 5771 features were mostly covered with release of 5671.

– Review what changes due to different hardware.

2
 Physical System Layout
z Broken from the “wheel in, plug and play”, model.
– Aspects of DMX 800 are incorporated. Grow the box as required.
– This means inter-frame cabling is required.
z Base Unit is equipment bay and at least one drive bay.

2A 1A System 1B 2B

3
 DMX-3 Front view

Take note and remember how bays are numbered.

4
 System Bay (Front)
Fans

Card Cage

System Midplane

Air Intake
(8)1800W Power Supplies
KVM
Server

(8)SPS
(only 3 shown)

5
 System Bay (Rear)

(16) 8-Port Adapters

(2) XCM Boards

(8) Power Supply Cords

(UPS) Uninterruptible Power Supply

(2) (PDP) Power Distribution Panel

(2) (PDU) Power Distribution Unit
(8) (SPS) Standby Power Supplies
(only 6 shown)

6
 Midplane (Front)
Director Pairs

Mirrored Memory Pairs

Dir Dir Dir Dir Dir Dir Dir Dir M0 M1 M2 M3 M4 M5 M6 M7 Dir Dir Dir Dir Dir Dir
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16

Pos Pos Pos Pos Pos Pos Pos Pos Pos Pos Pos Pos Pos Pos Pos Pos Pos Pos Pos Pos Pos Pos
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 24

Slot Slot Slot Slot Slot Slot Slot Slot Slot Slot Slot Slot Slot Slot Slot Slot Slot Slot Slot Slot Slot Slot
ID ID ID ID ID ID ID ID ID ID ID ID ID ID ID ID ID ID ID ID ID ID
0 1 2 3 4 5 6 7 10 11 12 13 14 15 16 17 8 9 A B C F

TypeTypeTypeTypeTypeTypeTypeType TypeTypeTypeTypeType Type

BE BE FE FE BE BE FE FE FE FE BE BE FE BE
or or or or
FE FE FE FE

Rev 2.0 9/11/03

7
 Card Cage Front

• Each Director has 4 slices

•Each Slice has 2 ports

• DA’s come in pairs
• Each DA pair drives 8 DAE’s (Primary)
• Dirs 5,6,11,12 could be HA’s
• Memory comes in pairs (Mirrored)
• Both cards must be the same size
•Available memory sizes are:
8GB, 16GB, 32GB, 64GB

8
 Universal Director
CPU Selection Machine
Disable Boot Up Switch for FB Check
Interface Mode Uart, Attn. and Error on
Jtag RS232 Ethernet Switch Selection Status Display A,B,C,D

Status Processor Attn. A,B,C,D

Display Selected Switch Machine
Display Ok LED
PIC FRU
Fault Blue
LED LED

9
Cache Configuration Rules: Sym7 vs Sym6
z Restrictions 1 and 3 exist on Sym6 to avoid I/O contention
z Restrictions 4-5 are new to Sym7 due to mirroring method
z Cache Boards are available in 8GB,16Gb, 32GB, 64GB capacities.

Rule Sym 6 Sym 7

1 2 board configs must use same size board 2 board configs must use same size board

2 Largest board no more than twice size of smallest board No restriction on largest vs smallest board

3 Cannot have fewer of the larger board than the smaller board Cannot have fewer of the larger board than the smaller board

Example: (2 x 8GB + 6 x 16GB) OK Example: (2 x 8GB + 6 x 16GB) OK

Example: (4 x 8GB + 4 x 16GB) OK Example: (4 x 8GB + 4 x 16GB) OK

Example: (6 x 8GB + 2 x 16GB) not allowed Example: (6 x 8GB + 2 x 16GB) not allowed

4 Odd no. of total boards allowed Odd no. of total boards not allowed

Example: 3 x 16GB OK Example: 3 x 16GB not allowed

5 Odd no. of individual boards allowed Odd no. of individual boards not allowed

Example: (3 x 16GB + 3 x 8GB) OK Example: (3 x 16GB + 3 x 8GB) not allowed

10
 Card Cage Rear

XCM Card

Combination of the
Communications Control Module
(CCM) card and Environmental D0
Control Module (ECM) card D1
C0
C1
Handles communication
switching and card cage
environmental monitoring

Directors responsible for local B0

environmental monitoring B1
A0
A1

11
 Drive Bay

1 ‘Pod’ has 4 X DAE’s

1 X DA pair drives 8 DAE’s

Minimum upgrade granularity @ GA

Bay DAE Drive

Drive 2A 05 A

Drives count 0-E

Drive slots 0, 1, 4, 5, 8, 9, C, D are one power branch.
Drive slots 2, 3, 6, 7, A, B, E are the other branch.
0

12
DAE’s Rear View

13
 Connecting the Dae’s to Da’s

16 A1
16 D1
16 B1
16 C1 01 B1
01 D1 01 A1

01 C1

16 A0
16 D0
16 B0
16 C0 01 B0
01 D0 01 A0

01 C0

14
 Connecting Up

Yellow = Dir 1 & 16

Green = Dir 2 & 15
Orange = Dir 5 & 12
Blue = Dir 6 & 11
Note: At GA max of 4 Storage Bays, 8 Storage Bays post-GA
Minimum GA Configuration will have 3 DA pairs

15
FID 94; Symm7 only

PowerVault
z Redesign of the power-down process to dump pertinent Global
Memory information to specified Power Vault drives.
– Need a predictable, fast and consistent solution to deal with Cache
• current method of de-staging Global memory is not scaleable.
• Not predictable due to what's happening at the time.
– Increase in Global Memory sizes (512GB raw) along with stagnant battery
technology meant we could potentially run out of battery time before we had
completely de-staged memory.

z Symmwin will automatically configure Vault devices.

– Do not block move or fiddle with Vault devices.
– Power Vault requirement is 4 unprotected volumes per DA slice.
– Must be on primary DAE’s which cannot be configured with less than 4 drives.
– Current Size is 5gb but appear as 0 cyls in bin file.
– Power Vault devices are formatted as raw FBA drives and cannot be read using D0
commands using Cyl and HD because of this.
– Vault Devices are assigned to be the first logical position on a physical drive.
• This is the fastest part of the physical drive (Outer Diameter)
• Insures the highest possible throughput

16
FID 94; Symm7 only

PowerVault

DAE

DAF1 LCC

o 4 Vault Drives per DA slice

o 5 GB per Vault drive

DAF16 LCC To Daisy Chain DAE

SPS

17
 Vault Save Allocation Example
Region …
.
Dir 1D . Dir 16D
Region UVW
Dir 1C Dir 16C
Region DEF

Dir 16B
Dir 1B Region ABC

Region 0 Dir 16A

Dir 1A

Each region is
saved twice.
PV PV PV PV This is for PV PV PV PV
DEV DEV DEV DEV redundancy. DEV DEV DEV DEV
A B C D You do NOT get a A B C D
Dir Dir Dir Dir copy of each mirror Dir Dir Dir Dir
1A 1B 1C 1D image of memory 16D 16C 16B 16A

18
 Changes to IML
z Restore Global Memory from previously successful Vault Save image.
– This is done in step 14 of the IML
z Step 14 also incorporates an extensive Sanity Check of global memory
– Error codes that may be seen will reported as ECxx errors
z Drive availability Sanity Check
– Check that all Drives previously in the System are in the same place by comparing
the S/N of the drives since the last successful restore.
– Error DD10.01 will be issued if we find the drives in a different slot than before.
z At the end of the Restore check that both images of GM match by
calculating the CRC’s for the 2 matching Vault regions of memory
– Error 3310.00

19
 Vault Implications

z System VTOC: the Vault drives will be formatted and a Vault Save
operation will take place at the end of a successful VTOC.
z When a System is taken Offline (DA’s) a Vault Save operation will take
place.
– The Front End and RDF can be taken offline and back online without a Vault.
– Can not take one DA offline, all or none.
z Environmental triggers
– loss of a sufficient number of Fans
– loss of a sufficient number of Vault drives
– loss of Battery hold up time meaning we would not be able to Vault if AC Power was
lost.
– If the system determines there’s not enough power to vault it wont come up.
– A lack of SPS Battery hold up time will prevent the box from coming online
• The box will still complete IML.
• The state would remain in Post Restore IML.

20
 Init Screen

•Model name DMX3-24 or DMX3-6

•Power vault wait time
•Raid-S no longer supported

21
Dir Map tab Changes

22
 DAE

Much like adding disks use the

wizard or type in the letter

23
 Split Screen

• Unlike the Hosts tab this one is compulsory

• Helps to maintain addressing rules.

24
Addressing CKD devices
Gives the capability to
address multiple CU images
at the same time.

25
 Disks

Add new option as to where you want

to place disks.
Note as you change DAE the colours
change.
Physical view functionality added.
26
Physical view from Vols Map

27
 Vols Request

•128 Vault devices. 16 per DA director. 4 per DA slice.

•VCM data base now lives on SFS volumes so the device is same
size as a gatekeeper.
•New protection type CDEV (cache only device)
VDEV lives in Cache, no longer takes up Physical disk space.
•Raid-S no longer supported.
•Be Careful traditionally this would be a 9Gb drive –
Now it’s double that, remember this when playing with SRDF.
•FBA track size Doubled to 64KB
•Fewer tracks or slots per GB of user data
•Both FBA and CKD will use a 64KB track, so any system
can mix FBA and CKD devices
28
FIDs 420,662,663,664; Symm6 & Symm7

SRDF Inter-platform Support

Platform RDF Configuration Level of Support

Symm 4 5267 to 5x71 Migration only

Symm 5 5567 to 5x71 Migration only

5568 to 5671 Full support

5568 to 5771 Full support

Symm 6 5669 to 5x71 none

5670 to 5671 Full support

5670 to 5771 None

5671 to 5x71 Full support

Symm 7 5771 to 5771 Full support

Includes all link types: ESCON, FC, GigE

29
 Numbers

5670 5671 5771

Volumes Supported 8,000 16,000 64,000*
CUs in a box 64 64 250
MF LPARs per slice 64 64 128
MF ESCON concurrent I/O 4 8 8
MF Aliases 7 15 255
iSCSI Initiators per Slice 128 128 512

* 32,000 if everything is Raid 7+1

30
 New and Noteworthy

z Cable diagnostics
– Runs automatically during configure and install Symmetrix
– Checks out basic cabling connectivity & functionality
– Steps CE through a sequence where the DAE’s are lit up First vertically then
horizontally 1 frame at a time.
– Provides opportunity to correct any problems before moving on.
– Can also be run anytime from menu.
z Drive replacement script
– Drive replacement script has been improved to run mostly unattended.
– After testing basic drive functionality CE is released.
– Script monitors and will dial home if problems occur.
z SCSI code load
– Planning script and a load script.
– Gives CE options on how when and where to load.
– Can run in flavors ranging from ‘Big Bang’ Mode to unattended “Super safe” mode.

31
5771 Procedure Wizard changes

Symm 7
specific
options
No offline
changes

Global sparing not

yet available

Starts vaulting
New cable process prior to
options power down.

32
33