Huawei OceanStor 9000 V100R001C10 Product Description

OceanStor 9000
V100R001C10
Product Description
Issue
01
Date
2014-06-10
HUAWEI TECHNOLOGIES CO., LTD.
Copyright Huawei Technologies Co., Ltd. 2014. All rights reserved.

No part of this document may be reproduced or transmitted in any form or by any means without prior written
consent of Huawei Technologies Co., Ltd.
Trademarks and Permissions

and other Huawei trademarks are trademarks of Huawei Technologies Co., Ltd.
All other trademarks and trade names mentioned in this document are the property of their respective holders.
Notice
The purchased products, services and features are stipulated by the contract made between Huawei and the
customer. All or part of the products, services and features described in this document may not be within the
purchase scope or the usage scope. Unless otherwise specified in the contract, all statements, information,
and recommendations in this document are provided "AS IS" without warranties, guarantees or representations
of any kind, either express or implied.
The information in this document is subject to change without notice. Every effort has been made in the
preparation of this document to ensure accuracy of the contents, but all statements, information, and
recommendations in this document do not constitute a warranty of any kind, express or implied.
Huawei Technologies Co., Ltd.

Address:
Huawei Industrial Base

Bantian, Longgang
Shenzhen 518129
People's Republic of China
Website:
http://enterprise.huawei.com
Issue 01 (2014-06-10)
Huawei Proprietary and Confidential

Copyright Huawei Technologies Co., Ltd.
OceanStor 9000
Product Description
About This Document
About This Document
Intended Audience
This document describes the appearance, configuration, networking, application scenarios,
functions, hardware structure, software structure, technical specifications, standard compliance,
and granted certifications of the product.
This document is intended for:
l
Marketing engineers
Planning engineers
Maintenance engineers
Training engineers
Symbol Conventions
The symbols that may be found in this document are defined as follows.
Symbol
Description
DANGER
WARNING
Indicates an imminently hazardous situation which, if not

avoided, will result in death or serious injury.
Indicates a potentially hazardous situation which, if not
avoided, could result in death or serious injury.
avoided, may result in minor or moderate injury.
avoided, could result in equipment damage, data loss,
performance deterioration, or unanticipated results.
NOTICE is used to address practices not related to
personal injury.
Issue 01 (2014-06-10)

ii
OceanStor 9000
Product Description
About This Document
Symbol
NOTE
Description
Calls attention to important information, best practices and
tips.
NOTE is used to address information not related to
personal injury, equipment damage, and environment
deterioration.
Change History
Changes between document issues are cumulative. The latest document issue contains all the
changes made in earlier issues.
Issue 01 (2014-06-10)
This issue is the first official release.
Issue 01 (2014-06-10)

iii
OceanStor 9000
Product Description
Contents
Contents
About This Document.....................................................................................................................ii
1 Positioning......................................................................................................................................1
2 Characteristics................................................................................................................................3
3 Architecture....................................................................................................................................6
3.1 Hardware Architecture....................................................................................................................................................7
3.1.1 Hardware Components and Typical Configurations...................................................................................................7
3.1.2 Storage Nodes............................................................................................................................................................10
3.1.3 Switches.....................................................................................................................................................................38
3.1.4 Cabinets.....................................................................................................................................................................42
3.1.5 Optional Hardware....................................................................................................................................................45
3.2 Software Architecture...................................................................................................................................................47
4 Typical Applications and Networking....................................................................................51

4.1 High-Performance Storage for Structured Data...........................................................................................................52
4.2 Large-Capacity Storage for Structured Data................................................................................................................53
4.3 Unstructured Data Storage and Metadata Management...............................................................................................54
4.4 Unstructured Data Storage and Analysis......................................................................................................................55
4.5 Storage and Analysis of Structured and Unstructured Data.........................................................................................56
5 Features..........................................................................................................................................59
5.1 Basic Features...............................................................................................................................................................60
5.1.1 MPP-based SQL Engine (WushanSQL)....................................................................................................................60
5.1.2 CIFS/NFS/FTP Sharing.............................................................................................................................................61
5.1.3 Hadoop-based Data Analysis (FusionInsight Hadoop).............................................................................................62
5.1.4 InfoProtector..............................................................................................................................................................62
5.1.5 Permission Control....................................................................................................................................................64
5.1.6 Unified Namespace....................................................................................................................................................65
5.1.7 Flexible Expansion....................................................................................................................................................65
5.1.8 High-Performance Access.........................................................................................................................................65
5.1.9 Centralized Management...........................................................................................................................................65
5.2 Value-added Features...................................................................................................................................................66
5.2.1 InfoEqualizer.............................................................................................................................................................66
Issue 01 (2014-06-10)

iv
OceanStor 9000
Product Description
Contents
5.2.2 InfoTier......................................................................................................................................................................66
5.2.3 InfoAllocator.............................................................................................................................................................67
5.2.4 InfoExplorer...............................................................................................................................................................68
6 Operation and Maintenance......................................................................................................69

7 Technical Specifications.............................................................................................................71
7.1 WushanFS Indicators ...................................................................................................................................................72
7.2 WushanSQL Indicators.................................................................................................................................................74
7.3 FusionInsight Hadoop Indicators..................................................................................................................................75
7.4 Reliability Specifications..............................................................................................................................................76
7.5 Overall System Hardware Specifications.....................................................................................................................77
7.6 Environmental Specifications.......................................................................................................................................79
8 Standards Compliance................................................................................................................81
Issue 01 (2014-06-10)

OceanStor 9000
Product Description
1 Positioning
Positioning
HUAWEI OceanStor 9000 Big Data Storage System (OceanStor 9000 for short) adopts the fully
symmetric distributed architecture that incorporates storage, archiving, and analysis capabilities
of massive data storage. With its cutting-edge performance, enormous scale-out capability, and
large-capacity single file system, the OceanStor 9000 is capable of storing both structured and
unstructured data. The OceanStor 9000 is applicable to multiple big data scenarios such as radio
and television industry, satellite mapping, gene sequencing, energy resource exploration,
carriers, and research and education. Presenting the industry's best processing performance and
full data lifecycle management, the OceanStor 9000 helps build an optimal platform for big data
storage.
In the era of big data, enterprise IT application systems are facing the challenge of how to transfer,
store, manage, and protect PB-level data, and how to instantly extract valuable information from
the massive volumes of data.
With flexibility and scalability being the core design concepts, HUAWEI OceanStor 9000 uses
the following functions to address the challenge:
l
WushanFS distributed file system that adopts the fully symmetric architecture to store
massive volumes of unstructured data and support seamless scaling from 3 to 288 nodes
and up to 40 PB of single file system.
WushanSQL components that adopt Massively Parallel Processing (MPP, also named
Shared Nothing) to store massive volumes of structured data, supports data distribution,
data partition, data compression and transaction management.
FusionInsight Hadoop components that are developed by encapsulating and enhancing the
open source Hadoop components, helping customers build an enterprise-level big data
analysis platform and search for insights competitors do not see.
Figure 1-1 shows the roles and applications of the OceanStor 9000 on the network.
Issue 01 (2014-06-10)

OceanStor 9000
Product Description
1 Positioning
Figure 1-1 Roles and applications of the OceanStor 9000 on the network
As a NAS storage product,
the OceanStor 9000 delivers
high-speed file access for
multiple application servers
and clients and supports a
variety of functions such as
load balancing, dynamic
storage tiering, and quota
management.
NFS clients
CIFS clients
As an MPP SQL engine, the

high-performance OceanStor
9000 provides large capacity
to archive structured data,
provides the search and
retrieval capabilities, and
offers the interface for
concurrent data import.
Application serves
As a data analysis system,

the OceanStor 9000
analyzes and queries
massive amounts of
unstructured data in a
distributed manner from
multiple dimensions.
Data analysis application

systems or third-party
development platforms
Front-end service
network
Management
network
Administrator
Manages and maintains the
system using either the GUI
or CLI.
OceanStor 9000
Issue 01 (2014-06-10)

OceanStor 9000
Product Description
2 Characteristics
Characteristics
The OceanStor 9000 has multiple characteristics including solid reliability, outstanding
performance, resilient space, and simplified management. These characteristics help cut
enterprises' capital expenditure (CAPEX) and total cost of ownership (TCO).
Solid Reliability
The OceanStor 9000 works in a distributed cluster architecture where the system is deployed in
full-redundancy mode, eliminating single points of failure. Key components are redundantly
deployed, such as fan modules, power modules, and interface modules for enhanced hardware
reliability. Other reliability designs include:
l
N+M data protection level

Erasure Code is applied to the WushanFS to implement inter-node RAID, which ensures
data integrity even though a node fails. Multiple protection levels are supported, such as N
+1, N+2, N+3, N+4, N+2:1, and N+3:1. You can specify a protection level for any empty
directory.
Mirroring
Mirroring used in the WushanFS helps store multiple copies of metadata to multiple storage
nodes for enhanced security.
Data recovery
If the data recovery function is used to recover data on a faulty disk or node, no data loss
occurs when another disk or node fails.
Physical division of domain

Physical division of domain is an effective way to isolate faulty domains from normal ones.
When a disk or node in a domain (node pool or node pool group) fails, physical division
of domain ensures that reliability and security of data in other domains are not affected,
and I/O performance of other domains is not compromised during data recovery.
High data reliability of the WushanSQL components

All service data stored on Datanodes is backed up on different storage nodes in duplicates;
therefore, even if a storage node is faulty, data stored on it will not be lost.
On each storage node, WushanSQL stores service data to data disks in RAID 5 and stores
system data and metadata to system disks in RAID 1; therefore, even if a disk is faulty,
data stored on it will not be lost.
Issue 01 (2014-06-10)

OceanStor 9000
Product Description
2 Characteristics
High reliability of the WushanSQL components

All WushanSQL components work on storage nodes in active-standby or all-active mode.
When a heartbeat exception is detected, the system automates a service switchover to
prevent running services from being adversely affected.
High reliability of the FusionInsight Hadoop components

The reliability of open-source Hadoop components is further improved, eliminating single
points of failure.
Outstanding Performance
The OceanStor 9000 delivers industry-leading I/O performance, meeting demanding
performance requirements of media editing and high-performance computing (HPC) sectors.
To provide optimal performance, the OceanStor 9000 adopts the following key technologies:
l
Solid-state drive (SSD) acceleration and dynamic storage tiering (DST)

SSDs provide low latency and high throughput to eliminate I/O performance bottlenecks.
The OceanStor 9000 uses SSDs to store metadata, improving metadata access efficiency
and processing capability.
The OceanStor 9000 can automatically distinguish between hot data and cold data and
migrate them to specific storage tiers based on preset storage policies for increased resource
utilization.
Global cache
The data access speed in cache is much faster than that in disks, but the cache space of a
single node is limited. If the cache of one node is independent from that of another node,
it is difficult to increase the cache hit ratio and ensure data consistency.
All node caches are incorporated into one cache pool. Only one copy of data of the same
file is stored in the cache pool and is accessible to any node. This increases the data hit
ratio, reduces the number of disk reads and writes, and shortens the access latency. The
overall system performance is improved as a result.
High-speed interconnectivity
The OceanStor 9000 supports 10GE, and each node provides four 10GE ports.
By interconnecting nodes in a high speed, the OceanStor 9000 can adapt to different
networking requirements for reduced system latency and improved overall performance.
Concurrent access
A traditional NAS system consists of engines and storage units. All concurrent access
requests are processed by engines. Therefore, engines tend to become performance
bottlenecks.
The OceanStor 9000 employs a symmetric logical architecture where each node can provide
services. The load balancing design enables data accesses to be evenly distributed in a
cluster, greatly improving the access concurrency capability.
Massively Parallel Processing (MPP)

After being analyzed and optimized, access requests in WushanSQL are concurrently
processed by multiple nodes. The processing performance is linearly increased as a result.
Resilient Space
The OceanStor 9000 adopts the distributed architecture that provides the ability to expand
capacity online. WushanFS supports seamless capacity expansion and enables performance to
Issue 01 (2014-06-10)

OceanStor 9000
Product Description
2 Characteristics
be linearly improved as the capacity is increased. A maximum of 40 PB single file system is

supported. WushanSQL allows for flexible expansion from 3 to 32 nodes.
Simplified Management
The OceanStor 9000 supports visualized automatic deployment, comprehensive performance
monitoring, unified topology management, and unified namespace for ease-of-use and
centralized management and maintenance.
Issue 01 (2014-06-10)

OceanStor 9000
Product Description
3 Architecture
Architecture
About This Chapter

This chapter describes the hardware architecture and the software architecture of the OceanStor
9000.
3.1 Hardware Architecture
This section describes the hardware architecture of the OceanStor 9000.
3.2 Software Architecture
The OceanStor 9000 combines all physical storage device nodes (storage nodes or nodes for
short) into a cluster using WushanFS, WushanSQL, and FusionInsight Hadoop to provide such
functions as file access, capacity management, data protection, and data analysis.
Issue 01 (2014-06-10)

OceanStor 9000
Product Description
3 Architecture
3.1 Hardware Architecture

This section describes the hardware architecture of the OceanStor 9000.
3.1.1 Hardware Components and Typical Configurations

The OceanStor 9000 hardware components contain storage nodes, switches, keyboard, video,
and mouse (KVM) devices, and modems.
Hardware Components
The Table 3-1 lists the OceanStor 9000 hardware components.
Table 3-1 Hardware components
Hardware Type
Model
Description
(Recommended)
Cabinet
FR42611
Providing 42 U (1866.9 mm/73.5 in.) of

installation space
Storage node
Insight node
(Performance)
2 U (88.9 mm/3.5 in.) high-performance

analysis engine housing 25 SAS disks
(either fully loaded or not loaded) and
installing WushanSQL or FusionInsight
Hadoop
Insight node
(Capacity)
2 U (88.9 mm/3.5 in.) large-capacity

analysis engine housing 12 SATA disks
and installing WushanSQL
Performance node
2 U (88.9 mm/3.5 in.) OPS-intensive node

housing 25 disks (4 x SSDs + 21 SAS
disks) and installing WushanFS
Mini-capacity node
2 U (88.9 mm/3.5 in.) small-capacity

balanced node housing one SSD and 12
SATA disks and installing WushanFS
Capacity node
4 U (177.8 mm/7 in.) large-capacity node

housing 36 disks (1 x SSD + 35 SATA
disks) and installing WushanFS
CE6850-48S4Q-EI
10GE switch
S5700-52C-SI/
S5352C-SI
GE switch
Switch
Issue 01 (2014-06-10)
8-port KVM controller
Eight KVM ports
Modem
Providing alarm notification by short

message service (SMS)

OceanStor 9000
Product Description
3 Architecture
Typical Configurations
Table 3-2 shows the typical AC configurations. Storage nodes of different types can be deployed
in the same cabinet when requirements for load bearing capacity and cabling are met.
Table 3-2 Typical configurations
Type
Typical Configuration
Insight node
(Performance) cabinet
S5752/S5352-01
CE6850-02
CE6850-01
Insight node
Performance
12
Remarks
In 42U
a maximum
configuration, the Insight
node (Performance)
cabinet can house 12
storage nodes, two 10GE
switches, one GE switch,
and one KVM.
10
KVM
21U
09
Insight node
Performance
01
1U
Insight node
(Capacity) cabinet
In 42U
a maximum
configuration, the Insight
node (Capacity) cabinet
can house 12 storage nodes,
two GE switches, and one
KVM.
S5752/S5352-02
S5752/S5352-01
Insight node
Capacity
12
10
KVM
21U
09
Insight node
Capacity
01
1U
Issue 01 (2014-06-10)

OceanStor 9000
Product Description
3 Architecture
Type
Performance node
cabinet
Remarks
In a42Umaximum
configuration, the
Performance node cabinet
can house 12 storage nodes,
two 10GE switches, one
GE switch, and one KVM.
S5752/S5352-01
CE6850-02
CE6850-01
12
Performance node
10
KVM
21U
09
Performance node
01
1U
Mini-capacity node
cabinet
In a 42U
maximum
configuration, the Minicapacity node cabinet can
house 12 storage nodes,
two 10GE switches, one
GE switch, and one KVM.
S5752/S5352-01
CE6850-02
CE6850-01
12
Mini-capacity node
10
KVM
21U
09
Mini-capacity node
01
1U
Issue 01 (2014-06-10)

OceanStor 9000
Product Description
3 Architecture
Type
Capacity node cabinet

S5752/S5352-01
CE6850-02
CE6850-01
08
Remarks
In42Ua maximum
configuration, the Minicapacity node cabinet can
house 8 storage nodes, two
10GE switches, one GE
switch, and one KVM.
Capacity node
06
KVM
21U
05
Capacity node
01
1U
3.1.2 Storage Nodes

The OceanStor 9000 supports multiple types of storage nodes: Insight node (Performance),
Insight node (Capacity), Performance node, Mini-capacity node, and Capacity node.
Insight node (Performance)

Appearance
Overall appearance
Figure 3-1 shows the Insight node (Performance) overall appearance.
Issue 01 (2014-06-10)

10
OceanStor 9000
Product Description
3 Architecture
Figure 3-1 Insight node (Performance) overall appearance
Front view
Figure 3-2 shows the front view of the Insight node (Performance).
Figure 3-2 Front view of the Insight node (Performance)
System power indicator/startup

button
System alarm indicator
System location indicator
USB port
Disk running indicator
Disk alarm/location indicator
Issue 01 (2014-06-10)

11
OceanStor 9000
Product Description
3 Architecture
The Insight node (Performance) front panel provides 25 service disk slots numbered from 0 to
24 from left to right, as shown in Figure 3-3.
Figure 3-3 Disk slots on the Insight node (Performance) front panel
0
24
Rear view
Figure 3-4 shows the Insight node (Performance) rear panel.
Figure 3-4 Rear view of the Insight node (Performance)
16 15 14 13
12 11
10
3
0
2
1
17
18
19
20
Power socket
Power running/alarm indicator
Power module handle
PCE-E expansion slot, with two 2-port 10GE cards separately

inserted into slots A0 and B3
2-port RAID GE card
GE network port
IPMI management network

port
USB port
Serial port
10
VGA port
Issue 01 (2014-06-10)

12
OceanStor 9000
Product Description
3 Architecture
11
12
13
LNK indicator of the IPMI

management network port
14
ACT indicator of the IPMI management network port
15
ACT indicator of the GE

network port
16
LNK indicator of the GE network port
17
18
19
Indicator of the 10GE SFP+

Ethernet optical port
20
10GE SFP+ Ethernet optical port
Insight node (Performance)The rear panel provides two operating system disk slots, numbered
SYSTEMDISK0 and SYSTEMDISK1 from left to right. Figure 3-5 shows the disk slots on the
rear panel of the Insight node (Performance).
Figure 3-5 Disk slots on the Insight node (Performance) rear panel
SYSTEMDISK0 SYSTEMDISK1
Physical Structure
Figure 3-6 shows the basic structure of the Insight node (Performance).
Issue 01 (2014-06-10)

13
OceanStor 9000
Product Description
3 Architecture
Figure 3-6 Basic structure of the Insight node (Performance)

4
1
2
Enclosure
Power module
Main control board enclosure
Service disk module
Service disk backplane
Technical Parameters
Table 3-3 shows the technical parameters of the Insight node (Performance).
Table 3-3 Technical specifications of the Insight node (Performance)
Category
Parameter
Value
Physical parameters
Dimensions (H x W x D)
86.1 mm x 446 mm x 582 mm (3.39 in.

x 17.56 in. x 22.91 in.), 2 U (88.9 mm
or 3.5 in.)
Weight
l Max. weighta: 35 kg (77.18 lb)

l Unloaded weightb: 10.65 kg (23.48
lb)
l Shipment weightc: 43 kg (94.82 lb)
Environment
parameters
Issue 01 (2014-06-10)
Operating temperature
5C to 35C (40 F to 95 F)
Operating humidity
20% RH to 80% RH

14
OceanStor 9000
Product Description
3 Architecture
Category
Parameter
Value
Power supply
parameter
AC input voltage
l Rated input voltage: 100 V AC to

127 V AC or 200 V AC to 240 V
AC
l Rated frequency: 50 Hz or 60 Hz
Power consumption
parameter
Max. power consumption
567.2 W
Typical configuration
parameters
Processor
Model: Intel Xeon 8-core 2.1 GHz

Quantity: 2
Memory
96 GB
Disk
l 2 x 300 GB 2.5-inch operating

system SAS disks
l 25 x 600 GB 2.5-inch service SAS
disks, either fully loaded or not
loaded
a: Maximum weight refers to the weight of the Insight node (Performance) that is equipped
with 25 service disks, two operating system disks, two power modules, and 12 memory
modules.
b: Unloaded weight refers to the weight of the Insight node (Performance) that is not equipped
with any component.
c: Shipment weight refers to the sum of the maximum weight of the Insight node
(Performance) and the maximum weight of the shipping materials.
Insight node (Capacity)

Appearance
Overall appearance
Figure 3-7 shows the Insight node (Capacity) overall appearance.
Issue 01 (2014-06-10)

15
OceanStor 9000
Product Description
3 Architecture
Figure 3-7 Insight node (Capacity) overall appearance
Front view
Figure 3-8 shows the Insight node (Capacity) front view.
Figure 3-8 Front view of the Insight node (Capacity)
Issue 01 (2014-06-10)
System power indicator/startup

button

16
OceanStor 9000
Product Description
3 Architecture
3
USB port
The Insight node (Capacity) front panel provides 12 service disk slots, numbered from 0 to 11
from top to bottom and from left to right with the bottom right one numbered 11.
Figure 3-9 shows the disk slots on the front panel of the Insight node (Capacity).
Figure 3-9 Disk slots on the front panel of the Insight node (Capacity)
Rear view
Figure 3-10 shows the Insight node (Capacity) rear panel.
Figure 3-10 Rear view of the Insight node (Capacity)
16 15 14 13
12 11
10
4
3
LNK
ACT
LNK
ACT
17
18
Power socket
Power running/alarm indicator
Power module handle
PCE-E expansion slot, with a 2-port GE card inserted into slot

B3
2-port RAID GE card
GE network port
Issue 01 (2014-06-10)

17
OceanStor 9000
Product Description
3 Architecture
7
IPMI management network

port
USB port
Serial port
10
VGA port
11
12
13

management network port
14
ACT indicator of the IPMI management network port
15

network port
16
17
18
Insight node (Capacity)The rear panel provides two operating system disk slots, numbered
SYSTEMDISK0 and SYSTEMDISK1 from left to right. Figure 3-11 shows the disk slots on
the rear panel of the Insight node (Capacity).
Figure 3-11 Disk slots on the Insight node (Capacity) rear panel
LNK
ACT
LNK
ACT
Physical Structure
Figure 3-12 shows the basic structure of the Insight node (Capacity).
Issue 01 (2014-06-10)

18
OceanStor 9000
Product Description
3 Architecture
Figure 3-12 Basic structure of the Insight node (Capacity)
Enclosure
Power module
Service disk module
Table 3-4 shows the technical parameters of the Insight node (Capacity).
Table 3-4 Technical parameters of the Insight node (Capacity)
Category
Parameter
Value
Physical parameters
86.1 mm x 446 mm x 585 mm (3.39 in.

x 17.56 in. x 23.03 in.), 2 U (88.9 mm
or 3.5 in.)
Weight
l Max. weighta: 32 kg (70.56 lb)

lb)
Environment
parameters
Issue 01 (2014-06-10)
5C to 35C (40 F to 95 F)
Operating humidity
20% RH to 80% RH

19
OceanStor 9000
Product Description
3 Architecture
Category
Parameter
Value
Power supply
parameter
AC input voltage

127 V AC or 200 V AC to 240 V
AC
Power consumption
parameter
296.1 W
parameters
Processor

Quantity: 2
Memory
64 GB
Disk

system SAS disks
l 12 x 2 TB 3.5-inch service SATA
disks in slots 0 to 11
a: Maximum weight refers to the weight of the Insight node (Capacity) that is equipped with
12 service disks, two operating system disks, two power modules, and four memory modules.
b: Unloaded weight refers to the weight of the Insight node (Capacity) that is not equipped
with any component.
c: Shipment weight refers to the sum of the maximum weight of the Insight node
(Capacity) and the maximum weight of the shipping materials.
Performance node
Exterior
Overview
Figure 3-13 shows the exterior overview of the Performance node.
Issue 01 (2014-06-10)

20
OceanStor 9000
Product Description
3 Architecture
Figure 3-13 Performance node overview
Front view
Figure 3-14 shows the front view of the Performance node.
Figure 3-14 Front view of the Performance node
Issue 01 (2014-06-10)
System power indicator/power

button

21
OceanStor 9000
Product Description
3 Architecture
3
USB port
Disk status indicator
The front panel of the Performance node provides 25 service disk slots, numbered from 0 to 24
from top to bottom and left to right, as shown in Figure 3-15.
Figure 3-15 Layout of disk slots on the front panel of the Performance node
24
Rear view
Figure 3-16 shows the rear panel of the Performance node.
Issue 01 (2014-06-10)

22
OceanStor 9000
Product Description
3 Architecture
Figure 3-16 Rear panel of a Performance node with a SAS HBA and 2-port TOE 10GE network
adapter
16 15 14 13
12 11
10
3
0
2
1
17
18
19
20
Power socket
Power status/alarm indicator
Power module handle
PCI-E expansion slot
SAS HBA
GE network port
IPMI
USB port
Serial port
10
VGA port
11
12
13
14
ACT indicator of the IPMI
15

network port
16
17
18
19

20
PCI-E expansion slots of the Performance node are available to 2-port GE network adapters and
2-port IB network adapters. Each 2-port GE network adapter provides two GE network ports,
as shown in Figure 3-17.
Issue 01 (2014-06-10)

23
OceanStor 9000
Product Description
3 Architecture
Figure 3-17 2-port GE network adapter
LNK
LNK
ACT
ACT
ACT
LNK ACT
LNK
LNK ACT
Each 2-port IB network adapter provides two 40 QSFP+ Ethernet optical ports, as shown in
Figure 3-18.
Figure 3-18 2-port IB network adapter
PORT 1
LNK
ACT
PORT 1
PORT 2
PORT 2
The rear panel of the Performance node has two system disk slots, numbered as SYSTEMDISK
0 (left) and SYSTEMDISK 1 (right). Figure 3-19 shows disk slots on the rear panel of the
Performance node with a SAS HBA and 2-port TOE 10GE network adapter.
Figure 3-19 Layout of disk slots on the rear panel of the Performance node
Physical Structure
Figure 3-20 shows the basic structure of the Performance node.
Issue 01 (2014-06-10)

24
OceanStor 9000
Product Description
3 Architecture
Figure 3-20 Basic structure of the Performance node

4
1
2
Enclosure
Power module
Service disk module
Technical Specifications
Table 3-5 lists the technical specifications of Performance node.
Table 3-5 Technical specifications of Performance node
Category
Parameter
Value
Physical parameters
Dimensions (height x width x

depth)
86.1 mm x 446 mm x 582 mm

(3.39 in. x 17.6 in. x 22.9 in.),
2 U (88.9 mm = 3.5 in.)
Weight
l Maximum weighta: 35 kg
(77.18 lb)
l Unloaded weightb: 10.65
kg (23.48 lb)
l Shipment weightc: 43 kg
(94.82 lb)
Environmental parameters
Issue 01 (2014-06-10)

5C to 35C (41F to 95F)

25
OceanStor 9000
Product Description
3 Architecture
Category
Power parameters
Parameter
Value
Operating humidity
20% RH to 80% RH
AC input voltage
l Rated input voltage: 100

V AC to 127 V AC or 200
V AC to 240 V AC
l Rated frequency: 50 Hz or
60 Hz
Power consumption
parameters
650 W
parameters
Processor
Model: Intel Xeon 6-core 1.9

GHz
Quantity: 2
Memory
DDR3 RDIMM: 48 GB
NVDIMM: 2 GB
Disk
l 2 x 300 GB 2.5-inch
operating system SAS
disks
l 1 x 200 GB 2.5-inch
service SSD in slots 0
l 24 x 600 GB 2.5-inch
service SAS disks in slots
1 to 24
a: Maximum weight refers to the weight of a Performance node that houses 25 service disk
modules, two operating system disks, two power modules, and 12 memory modules.
b: Unloaded weight refers to the weight of a Performance node that houses no component.
c: Shipment weight refers to the sum of the maximum weight of the Performance node and
the maximum weight of the shipping materials.
Mini-capacity node
Exterior
Overview
Figure 3-21 shows the exterior overview of the Mini-capacity node.
Issue 01 (2014-06-10)

26
OceanStor 9000
Product Description
3 Architecture
Figure 3-21 Mini-capacity node overview
Front view
Figure 3-22 shows the front view of the Mini-capacity node.
Figure 3-22 Front view of the Mini-capacity node
Issue 01 (2014-06-10)
System power indicator/start button 2
Alarm indicator of the system

27
OceanStor 9000
Product Description
3 Architecture
3
USB ports
Hard disk running indicator
The front panel of the Mini-capacity node provides 12 service disk slots, numbered from 0 to
11 from top to bottom and left to right, as shown in Figure 3-23.
Figure 3-23 Layout of disk slots on the front panel of the Mini-capacity node
Rear view
Figure 3-24 shows the rear panel of the Mini-capacity node.
Figure 3-24 Rear panel of a Mini-capacity node with a SAS HBA and 2-port TOE 10GE network
adapter
16 15 14 13
12 11
10
3
0
2
1
17
18
19
20
Power socket
Power module handle
SAS HBA
GE network port
IPMI
USB port
Issue 01 (2014-06-10)

28
OceanStor 9000
Product Description
3 Architecture
9
Serial port
10
VGA port
11
12
13
14
15

network port
16
17
18
19

20
PCI-E expansion slots of the Mini-capacity node are available to 2-port GE network adapters
and 2-port IB network adapters. Each 2-port GE network adapter provides two GE network ports,
as shown in Figure 3-25.
LNK
LNK
ACT
ACT
ACT
LNK ACT
LNK
LNK ACT
Figure 3-26.
PORT 1
LNK
ACT
PORT 1
PORT 2
PORT 2
Issue 01 (2014-06-10)

29
OceanStor 9000
Product Description
3 Architecture
The rear panel of the Mini-capacity node has two system disk slots, numbered as SYSTEMDISK
0 (left) and SYSTEMDISK 1 (right). Figure 3-27 shows disk slots on the rear panel of the Minicapacity node with a SAS HBA and 2-port TOE 10GE network adapter.
Figure 3-27 Layout of disk slots on the rear panel of the Mini-capacity node
Physical Structure
Figure 3-28 shows the basic structure of the Mini-capacity node.
Figure 3-28 Basic structure of the Mini-capacity node
Enclosure
Power module
Service disk module
Table 3-6 shows the technical specifications of the Mini-capacity node.
Issue 01 (2014-06-10)

30
OceanStor 9000
Product Description
3 Architecture
Table 3-6 Technical specifications of the Mini-capacity node

Category
Item
Specifications
Physical parameters
86.1 mm x 446 mm x 585 mm (3.39 in.

x 17.56 in. x 23.03 in.), 2 U (88.9 mm
or 3.5 in.)
Weight
l Maximum weighta: 32 kg (70.56 lb)

lb)
Environment
parameters
5C to 35C (41F to 95F)
Operating humidity
20% RH to 80% RH
Power supply
parameter
AC input voltage

127 V AC or 200 V AC to 240 V
AC
Power consumption
parameter
526.6 W
parameters
Processor

Quantity: 2
Memory
DDR3 RDIMM: 32 GB
NVDIMM: 2 GB
Disk

system SAS disks
l 1 x 200 GB 3.5-inch service SSD in
slot 0
l 11 x 2 TB 3.5-inch service SAS
disks in slots 1 to 11
a: Maximum weight refers to the weight of the Mini-capacity node that is equipped with 12
service disks, two operating system disks, two power modules, and four memory modules.
b: Unloaded weight refers to the weight of the Mini-capacity node that is not equipped with
any component.
c: Shipment weight refers to the sum of the maximum weight of the Mini-capacity node and
the maximum weight of the shipping materials.
Capacity node
Exterior
Overview
Issue 01 (2014-06-10)

31
OceanStor 9000
Product Description
3 Architecture
Figure 3-29 shows exterior overview of the Capacity node.

Figure 3-29 Capacity node overview
Front view
Figure 3-30 shows the front view of the Capacity node.
Issue 01 (2014-06-10)

32
OceanStor 9000
Product Description
3 Architecture
Figure 3-30 Front view of the Capacity node
4
3
2
1
5 6
System power indicator/power

button
USB port
The front panel of the Capacity node provides 24 service disk slots, numbered from 0 to 23 from
top to bottom and left to right, as shown in Figure 3-31. Slot 0 is located at the top left corner.
Figure 3-31 Layout of disk slots on the front panel of the Capacity node
Rear view
Issue 01 (2014-06-10)

33
OceanStor 9000
Product Description
3 Architecture
Figure 3-32 shows the rear panel of the Capacity node.

Figure 3-32 Rear panel of a Capacity node with a SAS host bus adapter (HBA) and 2-port TOE
10GE network adapter
16 15 14 13
6
4
12 11
10
4 5
3
0
2
1
17
18
17
18
19
20
Power module handle
Power socket
SAS HBA
GE network port
IPMI
USB port
Serial port
10
VGA port
11
12
13
14
15

network port
16
17
18
19

20
PCI-E expansion slots of the Capacity node are available to 2-port GE network adapters and 2port IB network adapters. Each 2-port GE network adapter provides two GE network ports, as
shown in Figure 3-33.
Issue 01 (2014-06-10)

34
OceanStor 9000
Product Description
3 Architecture
LNK
LNK
ACT
ACT
ACT
LNK ACT
LNK
LNK ACT
Figure 3-34.
PORT 1
LNK
ACT
PORT 1
PORT 2
PORT 2
The rear panel of the Capacity node provides 2 system disk slots and 12 service disk slots.
l
The two system disk slots are SYSTEMDISK 0 (left) and SYSTEMDISK 1 (right).
Service disk slots follow front panel ones and are numbered from 24 to 35 from top to
bottom and left to right. Slot 35 is located at the lower right corner.
Figure 3-35 shows disk slots on the rear panel of the Capacity node with a SAS HBA and 2port TOE 10GE network adapter.
Issue 01 (2014-06-10)

35
OceanStor 9000
Product Description
3 Architecture
Figure 3-35 Layout of disk slots on the rear panel of the Capacity node
Physical Structure
Figure 3-36 shows the basic structure of the Capacity node.
Figure 3-36 Basic structure of the Capacity node
4
1
2
5
6
2
Enclosure
Power module
Service disk module
Issue 01 (2014-06-10)

36
OceanStor 9000
Product Description
3 Architecture
5
Fan module
Table 3-7 lists the technical specifications of Capacity node.
Table 3-7 Technical specifications of Capacity node
Category
Parameter
Value
Physical parameters
Dimensions (height x width x

depth)
175 mm x 446 mm x 582 mm

(6.9 in. x 17.6 in. x 22.9 in.),
4 U (177.8 mm or 7.0 in.)
Weight
l Maximum weighta: 70 kg
(154.35 lb)
l Unloaded weightb: 20.1
kg (44.32 lb)
l Shipment weightc: 80 kg
(176.4 lb)
Environmental parameters
Power parameters
5C to 35C (41F to 95F)
Operating humidity
20% RH to 80% RH
AC input voltage
l Rated input voltage: 100

V AC to 127 V AC or 200
V AC to 240 V AC
l Rated frequency: 50 Hz or
60 Hz
Power consumption
parameters
878.2 W
parameters (of a highbandwidth node)
Processor
Model: Intel Xeon 6-core 1.9

GHz
Quantity: 2
Memory
DDR3 RDIMM: 48 GB
NVDIMM: 2 GB
Disk
l 2 x 300 GB 2.5-inch
operating system SAS
disks
l 1 x 200 GB 3.5-inch
service SSD in slot 0
l 35 x 4 TB 3.5-inch service
SAS disks in slots 1 to 35
Issue 01 (2014-06-10)

37
OceanStor 9000
Product Description
3 Architecture
Category
Parameter
Value
a: Maximum weight refers to the weight of a Capacity node that houses 36 service disk
modules, two operating system disks, two power modules, and 12 memory modules.
b: Unloaded weight refers to the weight of a Capacity node that houses no component.
c: Shipment weight refers to the sum of the maximum weight of the Capacity node and the
maximum weight of the shipping materials.
3.1.3 Switches
The OceanStor 9000 uses multiple models of switches such as CE6850-48S4Q-EI (CE6850 for
short) and S5700-52C-SI (S5752 for short)/S5352-SI (S5352 for short).
CE6850-48S4Q-EI
CE6850 switches provide 10GE access.
Function
A CE6850 switch provides 10GE ports for node interconnection and communication and
supports 40GE upstream ports for connecting to the front-end network. The CE6850 switch can
provide forty-eight 10GE SFP+ Ethernet optical ports and four 40GE QSFP+ Ethernet optical
ports, each of which can be divided into four 10GE ports.
Exterior
Front view
Figure 3-37 shows the front view of a CE6850 switch.
Figure 3-37 Front view of a CE6850 switch (housing AC power modules)
3 4
Power module 1
Fan module 1
Console port
ETH management network port
USB port
Fan module 2
Power module 2
Issue 01 (2014-06-10)

38
OceanStor 9000
Product Description
3 Architecture
Rear view
Figure 3-38 shows the rear view of the CE6850 switch.
Figure 3-38 Rear view of the CE6850 switch
1
1
48 x 10GE SFP+ Ethernet optical ports
2
2
4 x 40GE QSFP+ Ethernet optical ports
Ports
Table 3-8 lists the port functions of the CE6850 switch.
Table 3-8 Port descriptions
Name
Description
10GE SFP+ Ethernet optical

port
Used for receiving and sending services when the network

speed is 1 Gbit/s or 10 Gbit/s
40GE QSFP+ Ethernet

optical port
Used for switch stacking or as an upstream port
Console port
Connecting to the console for onsite device configuration
ETH management network

port
Connecting to the configuration terminal or network

management workstation for building up an onsite or remote
configuration environment
Table 3-9 describes the technical specifications of a CE6850 switch.
Table 3-9 Technical specifications of a CE6850 switch
Parameter
Physical
parameters
Issue 01 (2014-06-10)
Value
Dimensions (height x width
x depth)
43.6 mm x 442.0 mm x 600.0 mm
Fan quantity
272 W
Max. load
11 kg

39
OceanStor 9000
Product Description
3 Architecture
Parameter
Value
System
configuration
parameters
Processor
Main frequency: 1.5 GHz
Switching capacity
1280 Gbit/s
Packet forwarding
capability
952.32 Mpps
DDR memory
2 GB
NOR Flash Memory
8 MB
Power
parameters
Rated voltage range
100 V AC to 240 V AC; 50 Hz or 60 Hz
Input voltage range
90 V AC to 290 V AC; 45 Hz or 65 Hz
Environmenta
l parameters
Temperature
l Operating temperature: 0C to 40C

l Storage temperature: -40C to +70C
Relative humidity
5% RH to 95% RH
Altitude
0 m to 1800 m
S5700-52C-SI/S5352C-SI
S5752 switches provide GE access.
Function
S5700-52C-SI/S5352C-SI Ethernet switch (S5752/S5352 for short) is a device interconnecting
servers and a plane for data communication and active/standby configuration.
Exterior
Front view
Figure 3-39 shows the front panel of S5752/S5352.
Figure 3-39 Front panel of S5752/S5352
1
2 3 4 5
Forty-eight 10/100/1000Base-T Ethernet ports 2
One console port
One management network port
One USB port
Subcard slot
Issue 01 (2014-06-10)

40
OceanStor 9000
Product Description
3 Architecture
NOTE
l An optical subcard with two 10GE 10 Gigabit small-form factor pluggable (XFP) optical ports is
configured for an S5352C-SI switch.
l An optical subcard with two 10GE SFP+ optical ports is configured for an S5700-52C-SI switch.
Rear view
Figure 3-40 shows the rear panel of S5752/S5352.
Figure 3-40 Rear panel of S5752/S5352 equipped with AC power modules
1
ESD jack
Rear slot, with two stack ports
Fan module
Power supply unit
Ports
Table 3-10 describes ports provided by S5752/S5352.
Table 3-10 S5752/S5352 ports
Name
Description
10/100/1000Base-T
Ethernet ports
10/100/1000 Mbit/s Ethernet electrical interfaces used to

transmit and receive Ethernet services.
Console port
Connects the console for onsite device configuration.
Management network port
For users to access and manage an Ethernet switch.
10 Gbit/s optical port
Used to transmit and receive Ethernet services at 10 Gbit/s.
Table 3-11 describes the technical parameters of S5752/S5352.
Table 3-11 Technical parameters of S5752/S5352
Item
Physical
parameters
Issue 01 (2014-06-10)
Parameter
43.6 mm x 442.0 mm x 420.0 mm
Fan quantity

41
OceanStor 9000
Product Description
3 Architecture
Item
System
parameters
Power
parameters
Parameter
Maximum power
78 W
Weight
Full loaded weight 8.5 kg
Processor
Frequency: 800 MHz
Switching capacity
176 Gbit/s
Packet forwarding capacity
130.94 Mpps
DDR memory
256 MB
Flash Memory
32 MB
Input voltage
AC input voltage:
l Rated input voltage: 100 V AC to 240 V
AC; 50 Hz or 60 Hz
l Maximum input voltage: 90 V AC to 264
V AC; 47 Hz to 63 Hz
Environmenta
l parameters
Temperature
l Working temperature: 0C to 50C

l Storage temperature: -40C to +70C
Relative humidity
10% RH to 90% RH
Altitude
0 m to 2000 m
3.1.4 Cabinets
It is recommended that the OceanStor 9000 be installed in FR42611 cabinets.
Function
An FR42611 cabinet provides 42 U (1866.9 mm or 73.5 in.) of internal space for accommodating
devices and protects the devices from electromagnetic interference.
Exterior
Figure 3-41 shows an FR42611 cabinet.
Issue 01 (2014-06-10)

42
OceanStor 9000
Product Description
3 Architecture
Figure 3-41 Exterior of an FR42611 cabinet
Structure
An FR42611 cabinet consists of a top cover, a front door, a rear door, side panels, a racks, and
columns, as shown in Figure 3-42.
Issue 01 (2014-06-10)

43
OceanStor 9000
Product Description
3 Architecture
Figure 3-42 Structure of an FR42611 cabinet

1
Top cover
Rear door
Side panel
Column
Rack
Front door
Table 3-12 lists the technical parameters of an FR42611 cabinet.
Table 3-12 Technical parameters of an FR42611 cabinet
Issue 01 (2014-06-10)
Parameter
Value
Dimensions (height x
width x depth)
2000 mm x 600 mm x 1100 mm (78.74 in. x 23.62 in. x 43.31 in.)

44
OceanStor 9000
Product Description
3 Architecture
Parameter
Value
Capacity
42 U (1866.9 mm or 73.5 in.) of internal space
Weight
120 kg (with only the front and rear doors)
Cabling mode
Overhead and underfloor cabling
Installation mode
and scenario
Installation mode: fastening installation and non-fastening

installation
Installation scenario: concrete ground installation and ESD floor
installation
Material
High-intensity G-A quality carbon cold-rolled steel plates and

galvanized sheets that comply with restriction of the use of certain
hazardous substances (RoHS) and Underwriter Laboratories (UL)
Heat dissipation
Front-to-rear cooling and underfloor ventilation
Operating
temperature
l Long term: 0C to 50C (32F to 122F)
Operating humidity
l Long term: 5% RH to 85% RH
l Short term: 5C to +50C (23F to 122F)
l Short term: 5% RH to 95% RH
NOTE
l Operating temperature and humidity are measured 1.5 m above the floor and 0.4 m in front of the device
in the equipment room.
l For short term operation, the consecutive operating time does not exceed 48 hours, and the annual
accumulative operating time does not exceed 15 days.
3.1.5 Optional Hardware

Short message service (SMS) modems and keyboard, video, and mouse (KVM) can be
configured for the OceanStor 9000 to achieve easy device maintenance.
SMS Modems
The SMS modems are used to implement alarm notification by SMS, a function designed for
customers who require remote maintenance. When this function is enabled, maintenance
engineers are notified of a system event by SMS as soon as the event happens.
Figure 3-43 shows the exterior of an SMS modem.
Issue 01 (2014-06-10)

45
OceanStor 9000
Product Description
3 Architecture
Figure 3-43 Exterior of an SMS modem
KVMs
An 8-port KVM can be configured for the OceanStor 9000 so that users can access and control
the OceanStor 9000.
Figure 3-44 shows the exterior of a KVM.
Figure 3-44 Exterior of a KVM
Table 3-13 lists the technical specifications of the KVM.

Issue 01 (2014-06-10)

46
OceanStor 9000
Product Description
3 Architecture
Table 3-13 Technical specifications of the KVM

Parameter
Value
Height
1U
Power input range
90 V AC to 264 V AC
Type
8-port KVM switcher (automatic)
Switchover mode
Shortcut keys
0C to 50C (32F to 122F)
Operating humidity
0% RH to 90% RH
3.2 Software Architecture

The OceanStor 9000 combines all physical storage device nodes (storage nodes or nodes for
short) into a cluster using WushanFS, WushanSQL, and FusionInsight Hadoop to provide such
functions as file access, capacity management, data protection, and data analysis.
General Software Architecture

Figure 3-45 shows the OceanStor 9000 software architecture. WushanFS, WushanSQL, and
FusionInsight Hadoop independently run on multiple storage nodes. OceanStor eSight can be
deployed on the same storage node as WushanSQL or FusionInsight Hadoop (WushanSQL takes
precedence over FusionInsight Hadoop). OceanStor SystemReporter is an optional report tool
and can be deployed on a Windows server on the customer network.
Figure 3-45 Software architecture
High-performance file
storage and archiving
Unstructured
data analysis
NFS/CIFS/FTP
interface
NFS/CIFS/FTP
Structured data
storage and retrieval
JDBC/ODBC/concurrent
data import
MapReduce/Hive/HBase
OceanStor
DeviceManager
FusionInsight
Hadoop Manager
OceanStor
SystemReporter
OceanStor
DeviceManager
FusionInsight
Hadoop
WushanSQL
WushanFS
InfoEqualizer
OceanStor
eSight
InfoExplorer
InfoAllocator
InfoProtector
InfoTier
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Node
Node
Node
Node
Disk
...
OceanStor 9000
Table 3-14 describes each software module shown in Figure 3-45.

Issue 01 (2014-06-10)

47
OceanStor 9000
Product Description
3 Architecture
Table 3-14 Software module description
Issue 01 (2014-06-10)
Name
Description
WushanFS
Adopts a fully symmetric architecture that enables data to be evenly

distributed, eliminating performance bottlenecks, provides Network
File System (NFS) and Common Internet File System (CIFS)
interfaces, and supports multiple functions such as data protection
(InfoProtector), client connection load balancing (InfoEqualizer),
dynamic tiered storage (InfoTier), and space quota management
(InfoAllocator).
WushanSQL
Develops from the open-source database PostgreSQL, adopts MPP,

and implements high-speed storage and retrieval of structured data. If
WushanFS is also deployed, WushanSQL can quickly retrieve
massive files in WushanFS using the quick retrieval function
(InfoExplorer) and support automatic tiered storage (InfoTier) that
can be performed based on more migration policies.
FusionInsight
Hadoop
Incorporates high availability (HA), query, analysis functions to

HBase and MapReduce components based on the open-source
Hadoop to optimize performance and implement unstructured data
analysis.
NFS/CIFS/FTP
Provides NFS/CIFS/FTP file sharing services.
WushanFS
OceanStor
DeviceManager
Configures and manages the WushanFS subsystem.
WushanSQL
OceanStor
DeviceManager
Configures and manages the WushanSQL subsystem.
FusionInsight
Hadoop Manager
Configures and manages the FusionInsight Hadoop subsystem.
eSight
Manages the OceanStor 9000, monitors WushanFS, WushanSQL,

and FusionInsight Hadoop, and enables redirection to WushanFS
OceanStor DeviceManager, WushanSQL OceanStor
DeviceManager, and FusionInsight Hadoop Manager by single logon.
OceanStor
SystemReporter
Serves as the performance analysis tool of the WushanFS. It employs

multiple approaches including data collection, archiving, analysis,
and prediction to provide real-time monitoring, historical trend
analysis, comparison analysis, diagnosis analysis, and capacity
prediction. In this way, users can intuitively learn about the
performance of the WushanFS with ease and optimize the system in
a timely manner.

48
OceanStor 9000
Product Description
3 Architecture
WushanSQL Architecture
Figure 3-46 shows the WushanSQL architecture.
Figure 3-46 WushanSQL architecture
External application
programs
Datanode
Coordinator
Coordinator
Coordinator
Datanode
...
OceanStor
DeviceManager
GTM
eSight
Datanode
WushanSQL
Table 3-15 describes each software module of WushanSQL.

Table 3-15 Description of WushanSQL software modules
Name
Description
Coordinator
Provides application interfaces, optimizes global execution plans,

distributes execution plans to Datanode, and summarizes and
processes execution results.
Datanode
Stores service data, implements node execution plans, and returns

execution results to Coordinator.
Global Transaction
Manager (GTM)
Generates and maintains global unique information such as the global

transaction ID, transaction snapshot, and time stamp.
When SQL statements are used, the interaction process is as follows:

1.
An application sends a request to the Coordinator and builds a connection with it.
2.
The Coordinator sends the request to the GTM and obtains a transaction ID.
3.
The Coordinator generates an execution plan based on the SQL statement, optimizes the
execution plan (including the transaction ID), and then distributes it to multiple Datanodes.
4.
After a Datanode receives the execution plan, it sends an acknowledgement to the

Coordinator.
5.
After receiving the acknowledgement from each Datanode, the Coordinator summarizes
them and send the summary result to the application.
Issue 01 (2014-06-10)

49
OceanStor 9000
Product Description
3 Architecture
FusionInsight Hadoop Architecture

Figure 3-47 shows the FusionInsight Hadoop architecture. The analysis object of FusionInsight
Hadoop is stored in WushanFS.
Figure 3-47 FusionInsight Hadoop architecture
External data source
(such as data
warehouses)
Third-party
development
platform
Application system (historical

data management)
Data analysis layer interface
Real-time data service layer

interface
HBase
(Massive data random access)
MapReduce
(basic data analysis)
ZooKeeper
(distributed
coordination
service)
Batch data load
Hadoop File System Plugin
FusionInsight Hadoop Manager
Hive
(statistics analysis)
Loader
(data import
tool)
Northbound
interface
API
API
Third-party
management system
FusionInsight Hadoop
WushanFS
Issue 01 (2014-06-10)

50
OceanStor 9000
Product Description
4 Typical Applications and Networking
Typical Applications and Networking
About This Chapter

The OceanStor 9000 is applicable to multiple scenarios such as high-performance storage for
structured data, large-capacity storage for structured data, unstructured data storage and
metadata management, unstructured data storage and analysis, and storage and analysis of
structured and unstructured data.
4.1 High-Performance Storage for Structured Data
The OceanStor 9000 provides professional high-performance storage and query solution
specifically for x Detail Record (xDR) data of the same structural height. Compared with a largecapacity storage solution, a high-performance storage solution brings higher performance but
also higher cost and smaller capacity.
4.2 Large-Capacity Storage for Structured Data
The OceanStor 9000 provides a professional large-capacity storage and query solution
specifically for x Detail Record (xDR) data of the same structural height. Compared with a highperformance storage solution, a large-capacity storage solution brings higher cost and larger
capacity but also lower performance.
4.3 Unstructured Data Storage and Metadata Management
The OceanStor 9000 provides a professional storage solution specifically for massive amounts
of unstructured data (files). File metadata can be extracted and stored to WushanSQL, increasing
query efficiency and enhancing analysis capability.
4.4 Unstructured Data Storage and Analysis
of unstructured data (files). Integrated with FusionInsight Hadoop that develops from the
encapsulated and enhanced open-source Hadoop, the OceanStor 9000 builds an enterprise-level
data analysis platform.
4.5 Storage and Analysis of Structured and Unstructured Data
The OceanStor 9000 provides a professional storage solution specifically for structured and
unstructured data. Integrated with FusionInsight Hadoop that develops from the encapsulated
and enhanced open-source Hadoop, the OceanStor 9000 builds an enterprise-level data analysis
platform.
Issue 01 (2014-06-10)

51
OceanStor 9000
Product Description
4.1 High-Performance Storage for Structured Data

The OceanStor 9000 provides professional high-performance storage and query solution
specifically for x Detail Record (xDR) data of the same structural height. Compared with a largecapacity storage solution, a high-performance storage solution brings higher performance but
also higher cost and smaller capacity.
xDR is an application for recording data on the user plane and control plane in details. xDR is
widely applied to the IT application systems. Typical similar applications include Call Detail
Record (CDR), User Flow Detail Record (UFDR), Transaction Detail Record (TDR), and
Statistics Detail Record (SDR).
Figure 4-1 shows the OceanStor 9000 typical networking for the xDR high-performance
application. This solution has the following features:
l
When the massively parallel processing (MPP) architecture is used and the SQL statements
are executed, requests are distributed to multiple insight nodes (Performance) for
concurrent processing. Each insight node (Performance) features high performance and can
provide excellent processing capability as a result.
At least three insight nodes (Performance) are available. More insight nodes (Performance)
provide higher performance and larger capacity.
Data can be fast and concurrently imported into multiple insight nodes (Performance)
through CE6850 switches (that can be connected only to two nodes for reduced cost) of
the OceanStor 9000 or user switches.
Issue 01 (2014-06-10)

52
OceanStor 9000
Product Description
Figure 4-1 Typical networking of high-performance storage for structured data
User
management
network
User service network
User switch
Stacking
User switch
S5752
switch
WushanSQL
...
Insight node
(Performance)
CE6850
switch
10GE SFP+
high-speed cable
40GE QSFP+
high-speed cable
Stacking
CE6850
switch
OceanStor 9000
10GE optical fiber or GE cable

(The cable type varies depending on
the user switch model.)
GE cable
4.2 Large-Capacity Storage for Structured Data

The OceanStor 9000 provides a professional large-capacity storage and query solution
specifically for x Detail Record (xDR) data of the same structural height. Compared with a highperformance storage solution, a large-capacity storage solution brings higher cost and larger
capacity but also lower performance.
xDR is an application for recording data on the user plane and control plane in details. xDR is
widely applied to the IT application systems. Typical similar applications include Call Detail
Record (CDR), User Flow Detail Record (UFDR), Transaction Detail Record (TDR), and
Statistics Detail Record (SDR).
Figure 4-2 shows the OceanStor 9000 typical networking for the xDR large-capacity
application. This solution has the following features:
l
Insight nodes (Capacity) use SATA disks and can provide large capacity as a result.
At least three insight nodes (Capacity) are available. More insight nodes (Capacity) provide
larger capacity and higher performance.
Data can be fast and concurrently imported into multiple insight nodes (capacity) through
user switches.
Issue 01 (2014-06-10)

53
OceanStor 9000
Product Description
are executed, requests are distributed to multiple insight nodes (Capacity) for concurrent
processing. Therefore, an outstanding service performance can be delivered.
Figure 4-2 Typical networking of large-capacity storage for structured data
User
management
network
User switch
Stacking
User switch
S5752
switch
S5752
switch
Stacking
WushanSQL
...
Insight node
Capacity
OceanStor 9000
GE cable
Stack cable
4.3 Unstructured Data Storage and Metadata Management

of unstructured data (files). File metadata can be extracted and stored to WushanSQL, increasing
query efficiency and enhancing analysis capability.
To cope with massive files, the OceanStor 9000 provides three types of nodes: Performance
node, Mini-capacity node, and Capacity node, and solutions combined by these three types of
nodes. The WushanFS distributed file system is used to integrate these storage nodes into a
cluster, facilitating file access, capacity management, and data protection.
Metadata of a file system is stored in a tree structure and is managed in directory mode. Nondirectory management, such as migrating .jpg files to a high-performance storage node, is not
supported. If the number of files under a single directory exceeds 200,000, the file access speed
obviously slows down. To address this issue, the OceanStor 9000 provides a metadata
management solution.
Figure 4-3 shows the typical networking for unstructured data storage and metadata
management. This solution has the following features:
Issue 01 (2014-06-10)

54
OceanStor 9000
Product Description
Different types of storage nodes can be separately selected or selected together to meet the
scenarios that have different requirements on storage performance and capacity.
Global search is supported. If the number of files does not exceed 10 billion (the maximum
number of files contained in a single file system), the response time is less than 0.5s.
Metadata tables are accessible to external application systems, facilitating customization

of the data analysis function.
Figure 4-3 Typical networking for unstructured data storage and metadata management
User
management
network
User switch
User switch
Stacking
S5752
switch
WushanFS
WushanSQL
...
...
Insight node
Performance
Performance node/
Mini-capacity node/
Capacity node
CE6850
switch
Stacking
CE6850
switch
10GE SFP+ highspeed cable
10GE optical fiber
40GE QSFP+ highspeed cable
GE cable
OceanStor 9000
4.4 Unstructured Data Storage and Analysis

of unstructured data (files). Integrated with FusionInsight Hadoop that develops from the
encapsulated and enhanced open-source Hadoop, the OceanStor 9000 builds an enterprise-level
data analysis platform.
FusionInsight Hadoop meets the following data analysis requirements posed by the massive
amounts of data in a single file system:
l
Issue 01 (2014-06-10)
Instantly consolidates and manages different types and massive volumes of data.
55
OceanStor 9000
Product Description
Carries out advanced analysis for native information.
Visualizes all available data for special analysis.
Provides a development environment for building a new analysis application.
Optimizes and schedules workload distribution.
Figure 4-4 shows the typical networking for unstructured data storage and analysis. This solution
has the following features:
l
Based on the open-source Hadoop, some functions like high Availability (HA), query, and
analysis are incorporated to HBase, MapReduce, and other components for optimized
performance.
Figure 4-4 Typical networking for unstructured data storage and analysis
User
management
network
User switch
User switch
Stacking
S5752
switch
FusionInsight
Hadoop
WushanFS
...
...
Insight node
Performance
Performance node/
Mini-capacity node/
Capacity node
CE6850
switch
Stacking
CE6850
switch
10GE SFP+
high-speed cable
10GE optical fiber
40GE QSFP+
high-speed cable
GE cable
OceanStor 9000
4.5 Storage and Analysis of Structured and Unstructured

Data
The OceanStor 9000 provides a professional storage solution specifically for structured and
unstructured data. Integrated with FusionInsight Hadoop that develops from the encapsulated
and enhanced open-source Hadoop, the OceanStor 9000 builds an enterprise-level data analysis
platform.
Issue 01 (2014-06-10)

56
OceanStor 9000
Product Description
To deal with unstructured data, the OceanStor 9000 provides high-performance storage, and
allows metadata in a file system to be stored to the database for improved query efficiency and
enhanced analysis capabilities.
FusionInsight Hadoop meets the following data analysis requirements posed by the massive
amounts of data in a single file system:
l
Consolidates and manages different types of massive volumes of data instantly.
Carries out advanced analysis for native information.
Visualizes all available data, preparing for special use.
Provides a development environment for building a new analysis application.
Optimizes and schedules workload distribution.
Figure 4-5 shows the typical networking for storage and analysis of structured and unstructured
data. This solution has the following features:
l
are executed, requests are distributed to multiple insight nodes (Performance) for
concurrent processing. Each insight node (Performance) features high performance and can
provide excellent service capability when storing and querying structured data.
Global search is supported. If the number of files does not exceed 10 billion (the maximum
number of files contained in a single file system), the response time is less than 0.5s.

analysis are incorporated to HBase, MapReduce, and other components for optimized
performance.
Issue 01 (2014-06-10)

57
OceanStor 9000
Product Description
Figure 4-5 Typical networking for storage and analysis of structured and unstructured Data
User
management
network
User switch
User switch
Stacking
S5752
switch
WushanSQL and
FusionInsight
Hadoop
WushanFS
...
...
Insight node
Performance
Performance node/
Mini-capacity node/
Capacity node
CE6850
switch
Issue 01 (2014-06-10)
Stacking
CE6850
switch
10GE SFP+
high-speed cable
10GE optical fiber
40GE QSFP+
high-speed cable
GE cable

OceanStor 9000
58
OceanStor 9000
Product Description
5 Features
Features
About This Chapter

The OceanStor 9000 provides basic features and value-added features.
5.1 Basic Features
Basic features of the OceanStor 9000 include WushanSQL, CIFS/NFS/FTP sharing,
InfoProtector, permission control, unified namespace, flexible expansion, high-performance
access and centralized management.
5.2 Value-added Features
The OceanStor 9000 provides three value-added features: InfoTier, InfoAllocator,
InfoEqualizer and InfoExplorer.
Issue 01 (2014-06-10)

59
OceanStor 9000
Product Description
5 Features
5.1 Basic Features

Basic features of the OceanStor 9000 include WushanSQL, CIFS/NFS/FTP sharing,
InfoProtector, permission control, unified namespace, flexible expansion, high-performance
access and centralized management.
5.1.1 MPP-based SQL Engine (WushanSQL)

WushanSQL develops from the open-source database PostgreSQL. With massive paralleling
processing (MPP) used, WushanSQL boasts outstanding scalability and is capable of processing
massive amounts of data, achieving high-sped storage and retrieval of structured data.
In additional to solid reliability, excellent performance, resilient space, and simplified
management, the OceanStor 9000 offers the following advantages:
l
Compatible with the latest SQL2011

SQL is a standard language used in relational databases. WushanSQL is compatible with
the up-to-date SQL2011 standard.
Support data distribution

Data distribution is a major advantage of the MPP architecture database. It distributes data
stored in a large-sized table to multiple Datanodes according to a proper distribution policy,
and greatly improves database performance. The data distribution policies supported by
WushanSQL include:
Hash
Calculates a Hash value based on the specified field value in a tuple, and then obtains
the target storage location of the tuple based on the mapping between Datanodes and
Hash values.
Application scenario: Scenarios that contain large-sized tables and are sensitive to query
performance.
Replication
Replicates tuples to all Datanodes.
Application scenario: Scenarios that contain small-sized tables and are sensitive to
parallel analysis performance.
Support data partitioning

WushanSQL supports the Range Partitioning function that divides records in one or more
columns of a table into multiple ranges. (These ranges cannot overlap.) Each range has a
dedicated partition for data storage.
Support data compression

The data compression function can greatly save storage space, especially for tables with
large data volume and repeated data. The supported data compression algorithms include:
Dictionary encoding
Creates a separate dictionary order and saves the index values in the dictionary order.
Delta value encoding
Saves the first value and the differences between each value and its prior value.
Issue 01 (2014-06-10)

60
OceanStor 9000
Product Description
5 Features
Prefix compression
Saves the prefix index and data after the prefix for column values with the same prefix.
l
Support transaction management

Transaction management ensures that the operations related to a transaction will be batch
submitted or canceled.
Support for JDBC and ODBC interfaces
Support for the data concurrency import function. The supported import modes included:
Installs the dedicated import tool on the external server.
Imports data using NFS when an external NFS file server is available.
Uploads files to storage nodes and then import data.
Multiple client and server tools available

Such tools include PLSQL IDE and gsql. Graphical user interface (GUI) and commandline interface (CLI) management modes are both supported.
5.1.2 CIFS/NFS/FTP Sharing

The WushanFS provides reliable file sharing service.
File sharing is a basic feature of a network attached storage (NAS) storage system. The
WushanFS supports file system sharing with various operating systems over Common Internet
File System (CIFS), Network File System (NFS) or FTP, as shown in Figure 5-1.
Figure 5-1 CIFS/NFS sharing
Windows
Mac
CIFS
Linux
CIFS/NFS
Windows
NFS
FTP
Shared
directory
NAS
The CIFS/NFS/FTP sharing feature shares data by directory. A shared directory can be accessed
by multiple clients. All nodes of the WushanFS are clustered into one system to provide sharing
service. Each node is responsible for monitoring the other nodes' service status.
Issue 01 (2014-06-10)

61
OceanStor 9000
Product Description
5 Features
The WushanFS balances data access requests among nodes according to the service and node
status to ensure stable performance in a high-concurrency scenario. When a node is faulty, the
WushanFS fails over services of the faulty node to a normal one to ensure service continuity.
5.1.3 Hadoop-based Data Analysis (FusionInsight Hadoop)

analysis are incorporated into HBase, MapReduce, and other components to optimize
performance and implement unstructured data analysis.
FusionInsight Hadoop has the following features:
l
Deep insight
Based on Hadoop, FusionInsight Hadoop improves the commercial intelligent analysis
capability. By integrating with the traditional commercial intelligent analysis platform and
incorporating different data analysis components, FusionInsight Hadoop helps enterprises
search for new commercial opportunities by digging for insights buried inside massive
amounts of data.
Solid reliability
In additional to enabling all components to achieve HA and eliminate single points of
failure, FusionInsight Hadoop helps implement cluster-level backup and recovery and
disaster recovery.
High security
FusionInsight Hadoop uses Role-Based Access Control (RBAC) to eliminate plaintext
storage risks. Based on the community, FusionInsight Hadoop meets finance-level security
requirements by supporting multiple security mechanisms such as unified authentication,
secure operation auditing, data encryption and decryption, and malicious attack prevention,
eliminating customers' worries about big data security issues.
Ease-of-use
To suit customers' demands, FusionInsight Hadoop allows customers to maintain it online,
to customize Dashboard, and to use the automated secondary development assistant. This
significantly simplifies big data deployment in traditional enterprises, helping them easily
run big data services.
5.1.4 InfoProtector
The unique InfoProtector in WushanFS ensures high data reliability.
With InfoProtector in use, the OceanStor 9000 ensures that data remains accessible even though
the physical device is faulty, while automatically restoring data on the faulty physical device.
Data protection level (data redundancy ratio) can be flexibly configured for optimal data
reliability and storage space utilization.
Under traditional RAID-based protection, data resides on different disks of a single node and
cannot be restored when the entire node fails. The OceanStor 9000 implements inter-node data
redundancy to prevent data loss.
The OceanStor 9000 protects file data in original data count (ODC)+redundant data count (RDC)
mode (N+M mode for short). ODC or N represents the number of original data fragments, and
RDC or M represents the number of redundant data fragments. In N+M mode, the OceanStor
9000 allows a maximum of M disks or M nodes to fail at the same time without affecting data
Issue 01 (2014-06-10)

62
OceanStor 9000
Product Description
5 Features
access and automatic data recovery. Figure 5-2 shows the data protection process for a 6-node
OceanStor 9000 cluster protected in 4+2 mode.
Figure 5-2 Process of file data protection
File data
1
Original
data
fragment
Original
data
fragment
Original
data
fragment
Original
data
fragment
Redundant
Redundant
data
data
+
fragment
fragment
3
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Disk
Node 1
Node 2
Node 3
Node 4
Node 5
Node 6
1.
The written file data is divided into multiple original data fragments. ODC ranges from 2
to 16. The specific ODC is automatically calculated and cannot be configured. In this
example, ODC is 4.
2.
Redundant fragments are generated based on original data fragments. RDC can be
configured for specific empty directories. The value ranges from 1 to 4. In this example,
RDC is the default value 2.
3.
Data fragments are stored on different disks on all nodes after being load balanced among
the nodes.
There is another data protection mode, ODC+RDC:RDN (N+M:B for short). RDN or B
represents the number of redundant data nodes. In this mode, the OceanStor 9000 allows a
maximum of M disks or B nodes to fail at the same time without affecting data access and
automatic data recovery. The N+M:B data protection helps reduce the number of required nodes.
NOTE
In the V100R001 version, B is 1.
The OceanStor 9000 protects metadata in mirrors. The protection level of the metadata is higher
than that of the file data.
The services on a faulty node or disk are taken over by another node for continuous system
operation. When the node or disk is recovered, the OceanStor 9000 can quickly recover lost data
by reconstructing data across nodes for solid data reliability of the overall system.
l
Issue 01 (2014-06-10)
If a faulty disk is recovered within 10 minutes after it became faulty, the system
automatically enables the disk data recovery function to recover the data generated during
the 10 minutes.
63
OceanStor 9000
Product Description
5 Features
If a faulty disk is recovered 10 minutes later after it became faulty, the system automatically
enables the disk data recovery function to recover the data that has been stored when the
disk is normal and the data generated when the disk is faulty.
After a faulty node is recovered, the system automatically enables the node data recovery
function to recover the data generated when the node is faulty. Meanwhile, the user can
perform full data recovery using the network management system to recover the data that
has been stored when the node is normal and the data generated when the node is faulty.
5.1.5 Permission Control

The OceanStor 9000 supports permission control for enhanced access security.
Permission control includes system access permission control and directory access permission
control. With the permission control feature, the OceanStor 9000 allows access from only
authorized users and provides storage space for only specific users, protecting users' private data
against unauthorized access and facilitating construction of the upper-layer services.
System access permission control means controlling permission of a user on network attached
storage (NAS) services. When the user tries to access the NAS services, the OceanStor 9000 or
authentication server will authenticate the user first. The OceanStor 9000 supports multiple
authentication modes, as described in Table 5-1.
Table 5-1 Authentication modes
Authentication Mode
Description
Application Scenario
Anonymous access
Access without identity

authentication
CIFS sharing
Local user
Authenticated by the OceanStor

9000
Active directory (AD)

domain
Authenticated by the AD domain

server
Client IP address
Authenticated according to the

client IP address
Client host name

authentication
Authenticated according to the

name of the host accessing the
client
Lightweight Directory
Access Protocol (LDAP)
Authenticated by the LDAP

server
Network Information
Service (NIS)
Authenticated by the NIS server
NFS sharing
Directory access permission control means controlling permission of a user on directories. The
system administrator has the right to set the read-only or read/write permission of other users
on a directory.
Issue 01 (2014-06-10)

64
OceanStor 9000
Product Description
5 Features
5.1.6 Unified Namespace

WushanFS provides a unified namespace to facilitate allocation, maintenance, and expansion
of storage resources.
WushanFS provides a unified file system namespace that contains all operation objects that you
want to store, share, and manage. Additionally, the unified namespace can use and manage all
available capacity of the current system.
The namespace is automatically created upon startup of WushanFS. All shared directories are
subdirectories in the unified namespace. As a root directory, the unified namespace can be shared
and accessed.
The unified namespace provides a unified storage pool where storage space can be centrally
managed and allocated. The resource pool can be expanded by adding storage devices, free
maintenance personnel from maintaining multiple sets of storage systems.
5.1.7 Flexible Expansion

The WushanFS supports flexible expansion for easy deployment and capacity expansion.
The WushanFS adopts a distributed cluster architecture where all nodes are symmetrical and
each node is capable of providing services.
The WushanFS evenly distributes metadata and file data to all clustered nodes for processing,
implementing the clustered management of metadata and the clustered storage of file data.
Clustered management of metadata helps improve reliability and processing capabilities of the
WushanFS and achieve linear performance improvement with capacity.
The WushanFS supports seamless scale-out from 3 to a maximum of 288 nodes. You can deploy
three nodes in the initial setup phase and scale the system out later on demand. Capacity
expansion causes no service interruption or migration and makes full use of existing devices.
5.1.8 High-Performance Access

The OceanStor 9000 provides high-performance access processing to fulfill demanding service
requirements.
Employing critical technologies including the high-speed interconnection, concurrent access,
and SSD acceleration, the OceanStor 9000 provides high-bandwidth, low-latency, and highconcurrency service processing capabilities. The OceanStor 9000 performance improves
linearly as the number of nodes increases, meeting requirements of high-performance application
scenarios.
5.1.9 Centralized Management

The OceanStor 9000 can be centrally managed and maintained remotely.
The OceanStor 9000 provides both a graphical user interface (GUI) and a command-line
interface (CLI).
An administrator can log in to the centralized management interface from float OM IP address
to monitor or configure the OceanStor 9000, allocate resources, collect performance statistics,
and view alarms. The OceanStor 9000 has integrated the network management (NM) function.
Therefore, there is no need to separately deploy an NM server for the OceanStor 9000. The
failure of any node does not affect the user's login to and use of the NM function.
Issue 01 (2014-06-10)

65
OceanStor 9000
Product Description
5 Features
The OceanStor 9000 supports various remote maintenance methods and remote management on
the NM interface. Equipment room maintenance involves only hardware installation and
replacement.
5.2 Value-added Features

The OceanStor 9000 provides three value-added features: InfoTier, InfoAllocator,
InfoEqualizer and InfoExplorer.
5.2.1 InfoEqualizer
The OceanStor 9000 offers InfoEqualizer, a feature that enables the management client to
connect to the OceanStor 9000 and implement load balancing and failover.
InfoEqualizer provides the following functions for improved availability, performance, and
reliability of the OceanStor 9000:
l
InfoEqualizer enables a client to access the OceanStor 9000 using only a domain name,
facilitating the client connection process.
InfoEqualizer intelligently allocates client requests to idle nodes to balance workload,

ensuring high access efficiency.
InfoEqualizer enables failover of services running on faulty nodes to other nodes,

improving system reliability.
InfoEqualizer is a value-added and license-controlled feature. Without the license for

InfoEqualizer activated, the OceanStor 9000 provides only round-robin load balancing where
nodes process client connection requests in turn.
With the required license activated, the following load balancing functions are available:
l
CPU usage: The node with the lowest CPU usage processes client connection requests.
Number of node connections: The node that is connected to the least number of clients
processes client connection requests.
Node throughput: The node with the lowest throughput processes client connection
requests.
Comprehensive node load capability: The node with a high comprehensive node capability
is selected with a high probability to process client connection requests. The OceanStor
9000 calculates a comprehensive node load capability based on the node CPU and
bandwidth. If the node is overloaded, the OceanStor 9000 decreases the capability. For
example, in a zone that contains node A whose capability value is 30 and node B whose
capability value is 70, node A is selected with a 30% probability, and node B is selected
with a 70% probability.
5.2.2 InfoTier
The OceanStor 9000 delivers InfoTier, an automatic storage tiering feature.
InfoTier migrates files between different storage tiers based on the file storage policy for
optimized storage space utilization, increased data access performance, and reduced total cost
of deployment. InfoTier provides the following functions:
Issue 01 (2014-06-10)

66
OceanStor 9000
Product Description
5 Features
Node Pool: A node pool consists of nodes of the same physical type. A node pool contains
3 to 20 nodes. If the number of nodes exceeds 20, the extra nodes will form a new node
pool.
DiskPool: A disk pool consists of disks of the same type in all nodes in a node pool for
storing metadata and common data.
Tier: A tier is specified for a node pool based on service requirements.
File Pool Policy: A file pool policy is used to define data storage and migration policies
across storage tiers by setting a mapping between each file property and storage tier.
Watermark Policy: You can set a high watermark for each node pool for controlling data
storage and migration. You can also set a read-only watermark for specifying whether a
node is in the read-only state.
The OceanStor 9000 can configure node pools based on physical types of storage servers and
specifies the mapping between node pools and storage tiers.
l
For the data to be written, the OceanStor 9000 determines the initial data storage location
based on the mapping between the file storage path, file name, user name, or user group
name, and storage tier and stores the data in the specified location.
For the stored data, the OceanStor 9000 monitors file property changes and automatically
migrates data to a corresponding tier in accordance with the preset data migration policy.
The license-required InfoTier is an optional function of the OceanStor 9000.
5.2.3 InfoAllocator
The OceanStor 9000 supports InfoAllocator, a space quota management feature.
InfoAllocator enables the OceanStor 9000 to:
l
Manage and monitor storage space that a user or a group consumes to prevent that some
users occupy large storage space.
Make statistics on and check storage space consumed by a user or a group.
Plan storage space consumed by a user or a group in a proper way.
The quota types supported by the OceanStor 9000 contain:

l
Capacity quota: manages and monitors storage space usage.
File number quota: manages and monitors file number.
The available quota types contain:

l
Calculate quota: only monitors storage capacity usage or file number and does not monitor
storage resource usage.
Mandatory quota: monitors storage capacity usage or file number and storage resource
usage based on the preset thresholds.
Table 5-2 describes the thresholds of the mandatory quota.
Issue 01 (2014-06-10)

67
OceanStor 9000
Product Description
5 Features
Table 5-2 Thresholds of a mandatory quota

Threshold Type
Description
Recommended threshold
When storage space usage or file number reaches a

recommended threshold, the OceanStor 9000 allows
writes while raising an alarm.
Soft threshold
When storage space or file number reaches a soft

threshold, the OceanStor 9000 allows writes before the
grace period expires. After the grace period expires, the
OceanStor 9000 forbids writes immediately and raises an
alarm.
You need to configure a soft threshold and grace period at
the same time.
Hard threshold
When storage space usage or file number reaches a hard

threshold, the OceanStor 9000 forbids writes while raising
an alarm.
The license-required InfoAllocator is an optional function of the OceanStor 9000.
5.2.4 InfoExplorer
The OceanStor 9000 supports the InfoExplorer metadata management function.
The InfoExplorer function brings the following benefits:
l
Global fuzzy search for massive files in WushanFS. If the number of files does not exceed
10 billion, the response time is less than 0.5s.

Issue 01 (2014-06-10)

68
OceanStor 9000
Product Description
6 Operation and Maintenance
Operation and Maintenance
The OceanStor 9000 can be remotely operated, monitored, and maintained using a unified
network management (NM) system.
Cluster System Management

The OceanStor 9000 enables you to complete the following cluster management operations using
the NM system:
l
Monitors the cluster system topology.
Monitors node running status.
Manages system time, such as you can configure the time zone and network time protocol
(NTP) settings.
Monitor system performance, such as you can view key indexes such as capacity usage and
throughput.
Maintains and manages devices, such as you can start, stop, restart, disable, enable, freeze,
unfreeze, delete, and expand devices.
Maintains and manages the overall system, such as you can start, restart, and shut down
the system. This eliminates the need to perform these operations on each device and helps
enhance system manageability.
File System Management

The OceanStor 9000 enables you to complete the following file system management operations
using the NM system:
l
Set an authentication mode.
Set service sharing.
Set quotas.
Set a redundancy ratio.
The OceanStor 9000 provides a resource manager for easily creating, deleting, browsing
directories and setting attributes for them.
Issue 01 (2014-06-10)

69
OceanStor 9000
Product Description
6 Operation and Maintenance
Software Management
The OceanStor 9000 provides a software deployment tool that can implement automatic software
installation, software upgrade, and on-demand expansion of the OceanStor 9000.
User Management
The OceanStor 9000 supports NM user management. NM users can be created, deleted, locked,
and unlocked for secure NM user access.
Fault Management
The OceanStor 9000 supports faulty management. As an exception occurs, the OceanStor
9000 reports an alarm to maintenance personnel by short message service (SMS) or email in
real time and provides a recommended action so that the alarm can be dealt with in time.
Additionally, the OceanStor 9000 supports threshold setting, as well as export, clearance, and
automatic dump of alarms.
Issue 01 (2014-06-10)

70
OceanStor 9000
Product Description
7 Technical Specifications
About This Chapter

The technical specifications of the OceanStor 9000 include performance specifications, capacity
specifications, overall system specifications, reliability specifications, and environmental
specifications.
7.1 WushanFS Indicators
7.2 WushanSQL Indicators
7.3 FusionInsight Hadoop Indicators
7.4 Reliability Specifications
7.5 Overall System Hardware Specifications
7.6 Environmental Specifications
Issue 01 (2014-06-10)

71
OceanStor 9000
Product Description
7.1 WushanFS Indicators

Performance Indicators
Table 7-1 lists the performance specifications of the WushanFS.
Table 7-1 Performance specifications of the WushanFS
Parameter
Value
OPS
A single high-performance node supports a maximum of 25,000

(CIFS)/20,000 (NFS) OPS.
Sequential read and

write bandwidth
A single high-bandwidth node supports a maximum of 800 MB/s

of bandwidth.
Capacity Indicators
Table 7-2 lists the capacity specifications of the WushanFS.
Table 7-2 Capacity specifications of the WushanFS
Parameter
Value
Max. number of clustered nodes
288
Max. file system capacity
40 PB
Max. size of a single file
240 TB
Number of files/subdirectories under a

single directory
10,000,000
Max. number of files (including

directories)
10 billion
Client Compatibility Matrix

Table 7-3 shows client compatibility matrix of the WushanFS.
Issue 01 (2014-06-10)

72
OceanStor 9000
Product Description
Table 7-3 Client Compatibility Matrix of the WushanFS

Operati
ng
System
Version
Linux
Mac OS
X
Issue 01 (2014-06-10)
NFS
CIFS
NFSv2
NFSv3
NFSv4
SMB 1.0
SMB
2.0
SMB
2.1
SLES 10 SP2
SLES 10 SP3
SLES 10 SP4
SLES 11
SLES 11 SP1
SLES 11 SP2
SLES 11 SP3
RHEL 5.4
RHEL 5.5
RHEL 5.6
RHEL 5.7
RHEL 5.8
RHEL 6
RHEL 6.1
RHEL 6.2
RHEL 6.3
RHEL 6.4
Oracle Linux
5.8
Oracle Linux
5.9
Oracle Linux
6.3
Oracle Linux
6.4
10.6.7
10.6.8
10.7.2
10.7.3

73
OceanStor 9000
Product Description
Operati
ng
System
Microsoft
Windows
Version
NFS
CIFS
NFSv2
NFSv3
NFSv4
SMB 1.0
SMB
2.0
SMB
2.1
10.7.4
10.7.5
10.8.1
10.8.2
10.8.3
10.8.4
10.8.5
XP x86
Server 2003
x86
Server 2008
x86
7 x86
8 x86
8.1 x86
XP x64
Server 2003
x64
Server 2008
x64
Server 2008
R2 x64
7 x64
2012 x64
Note: Tested and supported; Not tested
7.2 WushanSQL Indicators

Performance Indicators
Table 7-4 shows performance indicators of WushanSQL.
Issue 01 (2014-06-10)

74
OceanStor 9000
Product Description
Table 7-4 WushanSQL performance indicators

Item
Indicator
Point query response

time
500 ms
Association query
response time
5 minutes
Max. speed of a batch

update
1.8 million records per minute
Max. bandwidth for data

import on a single node
80 MB/s
Service recovery time

upon a single node
failure
1 minute
Data recovery time upon

a single node failure
Insight node (Performance): 5 hours

Insight node (Capacity): 12 hours
Capacity Indicators
Table 7-5 shows capacity indicators of WushanSQL.
Table 7-5 WushanSQL capacity indicators
Item
Indicator
Number of nodes
Min. number of nodes: 3

Max. number of nodes: 32
Max. capacity
768 TB
7.3 FusionInsight Hadoop Indicators

Performance Indicators of the Hadoop File System Plugin
Table 7-6 shows performance indicators of the Hadoop file system plugin.
Table 7-6 Performance indicators of the Hadoop file system plugin
Issue 01 (2014-06-10)
Parameter
Value
Max. read bandwidth of

a single node
600 MB/s

75
OceanStor 9000
Product Description
Parameter
Value
Max. write bandwidth of

a single node
350 MB/s
HBase Performance Indicators

Table 7-7 shows HBase performance indicators.
Table 7-7 HBase performance indicators
Parameter
Value
Max. batch insertion speed of a single

node
50,000 per second
Max. service processing bandwidth of a

single node
40 MB/s
Max. Get operation speed of a single node
400 per second
Max. Scan operation speed of a single

node
500 MB/s
Capacity Indicators
Table 7-8 shows HBase capacity indicators.
Table 7-8 Capacity indicators
Parameter
Value
Number of nodes
Min. number of nodes: 3

Max. number of nodes: 29
7.4 Reliability Specifications

Table 7-9 lists the reliability specifications of the OceanStor 9000.
Table 7-9 Reliability specifications
Issue 01 (2014-06-10)
Parameter
Value
System availability
99.999%

76
OceanStor 9000
Product Description
Parameter
Value
Mean time between failures

(MTBF)
100,000 hours
Mean time to repair

(MTTR)
5 minutes
7.5 Overall System Hardware Specifications

Table 7-10, Table 7-11, Table 7-12, Table 7-13, and Table 7-14 show the overall system
hardware specifications of the OceanStor 9000 in a typical configuration environment.
Table 7-10 Overall system hardware specifications of an Insight node (Performance) cabinet
Category
Parameter
Value
Capacity
Number of storage nodes
12
Power supply
AC input voltage
100 V to 127 V or 200 V to

240 V
AC input current
63 A
Power consumption
Max. power consumption of an

AC cabinet
7428.4 W
Weight
Weight of an AC cabinet
576.7 kg
Floor load capacity of the

equipment room
Fully-configured uniform load
> 600 kg/m2 (0.85 bf/in.2)
Table 7-11 Overall system hardware specifications of an Insight node (Capacity) cabinet
Issue 01 (2014-06-10)
Category
Parameter
Value
Capacity
12
Power supply
AC input voltage
100 V to 127 V or 200 V to

240 V
AC input current
63 A
Power consumption

AC cabinet
3709.2 W
Weight
604 kg

equipment room
> 600 kg/m2 (0.85 bf/in.2)

77
OceanStor 9000
Product Description
Table 7-12 Overall system hardware specifications of a Performance node cabinet

Category
Parameter
Value
Capacity
12
Power supply
AC input voltage
100 V to 127 V or 200 V to

240 V
AC input current
63 A
Power consumption

AC cabinet
7398.8 W
Weight
576.7 kg

equipment room
> 600 kg/m2 (0.85 bf/in.2)
Table 7-13 Overall system hardware specifications of a Mini-capacity node cabinet

Category
Parameter
Value
Capacity

inside a cabinet
12
Power supply
AC input voltage
100 V to 127 V or 200 V to

240 V
AC input current
63 A
Power consumption

AC cabinet
6961.2 W
Weight
617.5 kg (1361.6 lb)
Bearing capacity of the

equipment room
> 600 kg/m2 (0.85 bf/in.2)
Table 7-14 Overall system hardware specifications of a Capacity node cabinet

Category
Parameter
Value
Capacity
Power supply
AC input voltage
100 V to 127 V or 200 V to

240 V
AC input current
63 A

AC cabinet
7754 W
Power consumption
Issue 01 (2014-06-10)

78
OceanStor 9000
Product Description
Category
Parameter
Value
Weight
725.5 kg

equipment room
> 600 kg/m2 (0.85 bf/in.2)
7.6 Environmental Specifications

Table 7-15 lists the environmental specifications of the OceanStor 9000.
Table 7-15 Environmental specifications of the OceanStor 9000
Parameter
Value
Operating temperaturea
5C to 35C (41F to 95F)
Storage temperature
-40C to +70C (-40F to +158F)
Transportation temperature
-40C to +70C (-40F to +158F)
Temperature gradient
10C/h (18F/h)
Operating humidity
20% RH to 80% RH
Storage humidity
5% RH to 95% RH
Transportation humidity
5% RH to 95% RH
Particle contaminants
ISOb 14664-1 Class8
Corrosive airborne
contaminants
l The corrosion rate of the copper test wafer is lower than

300 c per month in compliance with gas corrosion G1
requirements of ANSId/ISAe-71.04-1985.
l The corrosion rate of the silver test wafer is lower than
200 per month.
Issue 01 (2014-06-10)
Operating altitude
-30.5 m to +3000 m
Storage altitude
-30.5 m to +3000 m
Transportation altitude
-30.5 m to +3000 m
Noisef
< 72 dBA

79
OceanStor 9000
Product Description
Parameter
Value
a: The operating temperature ranges from 5C to 35C (41F to 95F) when the system runs
at an altitude lower than 1800 m, and the upper threshold for operating temperature decreases
by 1C every 300 m altitude increment when the system runs at an altitude higher than 1800
m.
b: International Organization for Standardization
c: a unit of length equal to 1/10000000000 (one ten billionth) of a meter
d: American National Standards Institute
e: Instrument Society of America
f: the maximum noise generated by the storage node when the ambient temperature is lower
than 25C (77F).
Issue 01 (2014-06-10)

80
OceanStor 9000
Product Description
8 Standards Compliance
Standards Compliance
The standards that the OceanStor 9000 complies with contain protocol standards, safety and
electromagnetic compatibility (EMC) standards, and industry standards.
Protocol Standards
Table 8-1 lists the protocol standards that the OceanStor 9000 complies with.
Table 8-1 Protocol standards followed by the OceanStor 9000
Name
Standards No.
IPMI2.0
Intelligent Platform Management Interface Specification Second Generation

v2.0, Document Revision 1.0, February 12, 2004
SMBIOS
System Management BIOS (SMBIOS) Reference Specification, Version 2.5,

Status: Final Standard, September 5, 2006
SAS2.1
Information technology - Serial Attached SCSI - 2
ACPI
Advanced Configuration and Power Interface Specification, Revision 3.0,

September 2, 2004
IP
RFC0791: Internet Protocol
Safety and EMC Standards

Table 8-2 lists the safety and EMC standards that the OceanStor 9000 complies with.
Table 8-2 Safety and EMC standards followed by the OceanStor 9000
Issue 01 (2014-06-10)
Name
Standards No.
IT Equipment Safety Standard
GB4943-2001
ICE standard
IEC 60950-1

81
OceanStor 9000
Product Description
Name
Standards No.
North America compliance and safety

standards
UL 60950-1
US EMC standard
FCC, 47 CFR Part 15, Subpart B
European safety standard
EN 60950-1
European EMC directive
EMC Directive 2004/108/EC
European EMC standard
EN 55024: 1998+A1+A2
European safety directive
LVD Directive 2006/95/EC
Industry Standards
Table 8-3 lists the industry standards that the OceanStor 9000 complies with.
Table 8-3 OceanStor 9000 compliant industry standards
Name
Standards No.
Ethernet-based standard
IEEE 802.3
Standard for fast Ethernet
IEEE 802.3u
Standard for GB Ethernet
IEEE 802.3z
IEEE standard test interface and boundary

scan structure
IEEE 1149.1-2001
Fault mode effect analysis (FMEA)
IEC 812
Standard for reliability, maintainability and

availability
IEC 863
Environmental protection
ECMA TR/70
Clean room and related controlled

environments
ISO 14664-1 Class8
Airborne contaminants and environment

standards
ANSI/ISA-71.04-1985 G1 gas corrosion level
Certifications
Table 8-4 lists the certifications that have been granted to the OceanStor 9000.
Issue 01 (2014-06-10)

82
OceanStor 9000
Product Description
Table 8-4 Certifications granted to the OceanStor 9000
Issue 01 (2014-06-10)
Certificate
Description
CB
The CB Scheme is operated by the Worldwide System for Conformity

Testing and Certification of Electrotechnical Equipment and Components
(IECEE) System. The IECEE member body agencies in different countries
test the safety of electrical equipment based on the IEC standard. The test
results (the CB test report and the CB test certificate) are recognized by the
IECEE member bodies. The CB Scheme aims at reducing trade barriers
caused by different approval or certification standards in different countries.
CCC
China Compulsory Certification (CCC) enforces compulsory certification

on products relating to human health, animal life and health, environmental
protection, and public safety.
CE
Conformite Europeenne (CE) refers to the certification required for products

to be sold in Europe. The products marked CE comply with the
electromagnetic compatibility (EMC) regulations (2004/108/EEC) and low
voltage regulations (2006/95/EEC) released by the European Commission.
C-Tick
C-Tick is an identification trademark registered to the Australian

Communications and Media Authority (ACMA). Currently, the C-Tick is
only applicable to products with electromagnetic interference and becomes
effective from January 1, 1999.
FCC
According to Chapter 15 in Federal Communications Commission (FCC)

Rules and Regulations, the device conforms to the standard for level A digital
device.
GOST
Russia national standard certification requiring CE or CB.
IC
Industry Canada (IC) sets up the test standards for analog and digital terminal
devices and specifies corresponding EMC certificates that all import
electronic products must obtain.
REACH
REACH is the European Community Regulation on chemicals and their safe

use (EC 1907/2006). It deals with the Registration, Evaluation,
Authorization and Restriction of Chemical substances.
RoHS
Restriction of the Use of Certain Hazardous Substances (RoHS) is published

by EU in 2003. It applies to the management of environmental impact created
by electric and electronic products when produced and scrapped. RoHS
stipulates the maximum amount of hazardous substances arising from
production.
SASO
Saudi Arabian Standards Organization (SASO) is the cooperation partner in

maintaining the safety and public health protecting the consumer and
environment and enhancing the competitive of national products through the
application of the best international practices in different standardization
fields in accordance with the Islamic law. The International Conformity
Certification Programme (ICCP) was implemented by MoCI of the Kingdom
of Saudi Arabia to ensure the compliance of imported products, with
applicable Saudi Arabian technical regulations.

83
OceanStor 9000
Product Description
Issue 01 (2014-06-10)
Certificate
Description
SONCAP
According to the Standards Organization of Nigeria Conformity Assessment

Programme (SONCAP), all goods imported into Nigeria conform to Nigeria
Industrial Standards (NIS) or equivalent acceptable international standards.
UL
Underwriters Laboratories (UL) is a non-profit agency engaged in product

safety testing in the USA.
VCCI
Voluntary Control Council for Interference (VCCI) is an identification

trademark registered to Japan.
WEEE
Electrical and electronic products sold in the EU market must comply with
the EU Directive on Waste of Electric and Electronic Equipment (WEEE)
and have the symbol of cross-out wheeled bin.

84

Huawei OceanStor 9000 V100R001C10 Product Description

Hochgeladen von

Dokumentinformationen

Copyright

Verfügbare Formate

Dieses Dokument teilen

Dokument teilen oder einbetten

Freigabeoptionen

Stufen Sie dieses Dokument als nützlich ein?

Sind diese Inhalte unangemessen?

Copyright:

Verfügbare Formate

Huawei OceanStor 9000 V100R001C10 Product Description

Hochgeladen von

Copyright:

Verfügbare Formate

OceanStor 9000

HUAWEI TECHNOLOGIES CO., LTD.

Copyright Huawei Technologies Co., Ltd. 2014. All rights reserved.

Trademarks and Permissions

Huawei Technologies Co., Ltd.

Huawei Industrial Base

Huawei Proprietary and Confidential

About This Document

About This Document

Indicates an imminently hazardous situation which, if not

Huawei Proprietary and Confidential

About This Document

Huawei Proprietary and Confidential

4 Typical Applications and Networking....................................................................................51

Huawei Proprietary and Confidential

6 Operation and Maintenance......................................................................................................69

Huawei Proprietary and Confidential

Huawei Proprietary and Confidential

As an MPP SQL engine, the

As a data analysis system,

Data analysis application

Huawei Proprietary and Confidential

N+M data protection level

Physical division of domain

High data reliability of the WushanSQL components

Huawei Proprietary and Confidential

High reliability of the WushanSQL components

High reliability of the FusionInsight Hadoop components

Solid-state drive (SSD) acceleration and dynamic storage tiering (DST)

Massively Parallel Processing (MPP)

Huawei Proprietary and Confidential

be linearly improved as the capacity is increased. A maximum of 40 PB single file system is

Huawei Proprietary and Confidential

About This Chapter

Huawei Proprietary and Confidential

3.1 Hardware Architecture

3.1.1 Hardware Components and Typical Configurations

Providing 42 U (1866.9 mm/73.5 in.) of

2 U (88.9 mm/3.5 in.) high-performance

2 U (88.9 mm/3.5 in.) large-capacity

2 U (88.9 mm/3.5 in.) OPS-intensive node

2 U (88.9 mm/3.5 in.) small-capacity

4 U (177.8 mm/7 in.) large-capacity node

8-port KVM controller

Eight KVM ports

Providing alarm notification by short

Huawei Proprietary and Confidential

Huawei Proprietary and Confidential

Huawei Proprietary and Confidential

Capacity node cabinet

3.1.2 Storage Nodes

Insight node (Performance)

Huawei Proprietary and Confidential

Figure 3-1 Insight node (Performance) overall appearance

System power indicator/startup

System alarm indicator

System location indicator

Disk running indicator

Disk alarm/location indicator

Huawei Proprietary and Confidential

Power running/alarm indicator

Power module handle

PCE-E expansion slot, with two 2-port 10GE cards separately

2-port RAID GE card