DATA CENTRE CONNECTIVITY CENELEC EN 50173-5

How the physical infrastructure is changing

Data Centre Design Requirements

Correct management of the data centers physical layer infrastructure can have a direct impact on network operation and facilities Advanced cabling solutions that allow for adaptive design of the physical infrastructure to meet unique data centre requirements is the key to success Solutions that provide data centers with a flexible solution that will extend the life of the cable plant, reduce obsolescence, and offer a clear upgrade path to future applications

Challenges of a Data Centre

Managing Downtime Planned or Outages
Assessing remote back up requirements

Company Technology Roadmap

Current & future technology requirements Mainstream or early adopter

Environmental Control / Fire Prevention

Use of high-density storage & server technologies Increased demand for power and cooling Ventilation Hot Spots

Challenges of a Data Centre

Redundancy and diversity
For HVAC, electrical, water, etc.

Tiered Security
Push-button entry pads, electronic swipe cards, advanced biometric scanning devices

EN50173-5 Data Centre Cabling IT Cabling only as an extension to the main EN 50173 standard Approval expected Mid 2006

EN 50173-5 Standards Referenced

EN 50173-5 Information technology Generic cabling Data Centres
EN 50174-1 Information technology Cabling installation Specification and quality assurance
EN 50346 Information technology Cabling installation Testing of installed cabling

EN 50173-1 Information technology Generic cabling General requirements

EN 50174-2 Information technology Cabling installation: Installation planning and practices inside buildings
EN 50310 Application of equipotential bonding and earthing in buildings with information technology equipment

EN50174-3 Information technology Installation planning and practices outside buildings

EN 50173-5: Data Centre Cabling Overview

ENI MD ZD LDP EO EQP

Distributor in accordance with EN 50173-1

Network Access Cabling subsystem

Main distribution Cabling subsystem

Zone distribution Cabling subsystem

Equipment Cabling

Generic cabling system

ENI: External Network Interface MD: Main Distributor ZD: Zone Distributor LDP: Local Distribution Point EO: Equipment Outlet EQP: Equipment

Hierarchical structure of generic cabling

ENI
Distributor in accordance with EN 50173-1

ENI Network access cabling subsystem

MD Main distribution cabling subsystem ZD ZD

Zone distribution cabling subsystem LDP EO EO EO LDP EO EO EO LDP EO EO LDP EO EO Optional cables

EN 50173-5: Data Centre Cabling Overview

Class E minimum performance balanced copper channel plus Alien Crosstalk requirements Physical length of channel shall not exceed 100 metres, 90 metre fixed cable length shall depend on the length of cords used. When using an LDP these should be positioned at least 15 metres from the ZD. When 4 connections are used in a channel the physical length of the network access cable should be at least 15 metres Recommended patch cord length extended from 5 to 10m Optional links allowed between LDPs for added resilience

EN 50173-5: Data Centre Cabling Overview

Industry standard duplex SFF connector for use at ENI telecom services require >55dB return loss for Singlemode LC connector expected to be used in majority of cases Industry standard duplex SFF connector for use at EO either LC or MT-RJ connectors may be used OF-300 (OM2 or OM3) minimum performance fibre channel RJ-45 Cat 6 connector adopted for use at EO with 4 pairs Terra & RJ-45 Cat 7 connectors for use at EO with 4 pairs Wish to support up to 8 optical connectors per channel

Critical Considerations for Physical Infrastructure

Security

Safe from external and internal attacks Reduce risk: likelihood, frequency & impact of loss events to meet required service levels more critical applications reduce operating costs provide a complete view if the network reduce capital expenditure ease expansion support new applications

Reliability Management

Scalability

Data Centre Connectivity Requirements

Network Efficiency - High performance, reliable, stable, high density (low profile) solution. Effective overall operation. Manageability - Increased control of the data centre infrastructure. Flexibility - Quick and easy moves and changes Scalability - Fast and easy provisioning of connectivity equals a more efficient deployment of system equipment. Scalable bandwidth 10/100/1G/10G

Ventilation Hot Spots

COLD AISLE

HOT AISLE

Area of a data center where heat builds up due to one or more contributing factors such as heat dissipation from equipment Eliminate or a poor cooling design
Hot Spots

Equipment layout- Front to front on cold aisle w/perforated floor tiles blowing cool air dissipated w/equipment fan Back to back on hot aisle w/solid floor tiles using fan exhausts

Fibre Cabling in Todays Data centre LAN/SANSAN Environment Cabinet Server MDA
Edge Switch
SD

SAN Switch
S S G R = N= D 6

5411 Enterprise Switch 1

h

1000 BASE X AMBER ACTIVITY = GREEN LINK OK = DISABLED FLASHING GREEN =

10/100 BASE TX 4 5 6 7 8 9 10 11 SD 1 1 2 2 3 3 3 3 R

POWER MGMT 3R 3

10

11

5411 Enterprise Switch 1

1000 BASE X ACTIVITY AMBER = GREEN LINK OK = DISABLED FLASHING GREEN =

10/100 BASE TX 4 5 6 7 8 9 10 11 1 1 2 2 3 3 3 3 R

POWER MGMT 3R 3

10

11

CISCOS YSTEMS

Power Supply 0

Distribution Switch
Power Supply 1
SD

Catalyst 8500SERIES

Switch Processor

Server(s)
PROLIANT

1850R

SD

LAN

SAN

Router
CONSOLE LOOP OK BRI S/T DSU CPU S3 LP B1 B2 WIC 0 OK FDX 100 LNK AUX WIC 1 OK

SD

PROLIANT

1850R

SD

Cisco 1720

PROLIANT

1850R

SD

LAN
Storage

Structured vs. Unstructured Cabling Solutions

Server racks

The cabling starts with a few connections . . . And this is how it ends up . . .
No defined cable paths Changes made at active equipment Problem determination difficult System growth can be impacted

Switch racks

Mess under the floor

Storage

Star Topology Back to MDA

SAN Server Cabinet
1 2 3 4 5 6
7 8

MDA
9 10 11 12
13 14 15 16 17 18
19 20 21 22 23 24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48

Equip Distribution
SD

Equip Distribution
10/100 BASE TX

5411 Enterprise Switch 1

1000 BA SE X AMBER ACTIVITY = GRE EN LINK OK = DISABLED FLASHING GREEN =

4 5 6 7 8 9 10 11

1 1

2 2

SD

10

11

3 3 3 3 R

P OWER MGMT

3R

5411 Enterprise S witch 1

1000 BASE X AMBER ACTIVITY = GREEN LINK OK = FLASH ING GREEN = LED DISAB

10/100 BAS E TX

4 5 6 7 8 9 10 11

1 1

2 2

10

11

3 3 3 3 R

POWE R MGMT

3R

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24
CISCOS YSTEMS
Power Supply 0 Power Supply 1
SD

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48
Catalyst 8500SERIES

Equip Distribution

Equip Distribution

PROLIANT

1850R

SD

Switch Processor

PROLIANT

1850R

SD

SD

PROLIANT

1850R

SD

CONSOLE

LOOP
OK
BRI S/T

DSU CPU S3

WIC 0 OK

FDX

100

LNK

LP

B1

B2

AUX

WIC 1 OK

Cisco 1720

Cabling/Access

Structured vs. Unstructured Cabling Solutions

Value Proposition
Point-to-Point Jumper Cable Installation Structured Optical Cabling Solution

200 Jumper Cables

3 Trunk Cables

Source: IBM

Careful Planning of Data Centres

Careful Planning is essential All components used should be designed to work together Flexibility is key to ensure future requirements are met Poor planning can lead to extra costs when changes are required

New Challenges for the Heart of the Enterprise

New and retro-fit designs Cooling, power, and grounding become even more critical
Cable management in premium space Rack space conservation - BIG hardware Security is top of mind
Bullet-proof glass Biometric authentication 24x7 video surveillance Redundant generators (90 day fuel supply) 50k sq. ft. bunker for 25 megaton nuke blast

THANK YOU FOR LISTENING