Beruflich Dokumente
Kultur Dokumente
Ash Mate
WW Senior Solutions Architect
mate@us.ibm.com
Note: SMB, NFS, Object Store Interfaces supported through Cluster Export Services
© 2016 IBM Corporation
Simple Cluster Model Overview
Single Cluster/Single Filesystem*
General Purpose
Big Data & Analytics Cloud
Computing
File
NFS SMB
Hadoop Cinder Swift
GPFS Block Object
Connector
POSIX
UFO Support - Unified File (POSIX, NFS, CIFS) and Object (Swift S3) with Integrated Analytics (HDFS)
© 2016 IBM Corporation
Spectrum Scale Protocol Nodes
• NFS Server supports NFS v3 and the mandatory features in NFS v4.0.
• SMB server support SMB 2, SMB 2.1, and the mandatory features of SMB 3.0.
• Object server supports the Kilo release of Openstack Swift along with Keystone v3.
• The CES infrastructure is responsible for
– managing the setup for high-availability clustering used by the protocols
– monitoring the health of these protocols on the protocol nodes and raising events/alerts in the
event of failures
– managing the addresses used for accessing these protocols including failover and failback of
these addresses because of protocol node failures
• For more details see the "Implementing Cluster Export Services" chapter of the IBM
Spectrum Scale: Advanced Administration Guide.
13
14
Spectrum Scale Placement Spectrum Scale Volume Spectrum Scale Object Driver
Driver Driver
Spectrum Scale: A Reliable, Scalable, POSIX-Compliant Enterprise File System that stores
Compute images, Volumes and Objects
Leverages Spectrum Scale as a common storage layer for images, volumes and objects
– Avoids data copy
– Local access of data
Adds enterprise storage management features to OpenStack
– Rapid volume and virtual machine provisioning using file system level copy-on-write
function
– Scale out IO performance through support for shared nothing clusters
– Resilient volumes through transparent pipeline replication
In-Place Analytics
Object
(http)
Results returned
in place
Spectrum Scale
Explicit Data movement Hadoop Connectors
Data ingested
as Objects
Results Published
as Objects with
<SOF_Fileset>/<Device> no data movement
Spectrum Scale
Platform
Platform LSF Platform
Symphony Platform LSF
(SaaS) Symphony
(SaaS)
Workload
& Data Spectrum Scale, based on
Spectrum Scale on Cloud
Spectrum Scale
Spectrum Scale servers and storage are isolated inside each organization's
private VLAN no sharing for maximum security
© 2016 IBM Corporation
Additional Industry Use Cases
• Enterprise File Archive Solution: Data from various sources (NAS, DBs, wikis, etc.)
classified by StoredIQ ingested into Spectrum Scale via File Interface can be tiered
to Cleversafe on-prem active archive via Transparent Cloud Tiering
• Enterprise Content Managenment Soltuion: Data ingested into Scale via FileNet
for tiering to Tape / Cloud.
• Medical Images Archive Solution: MRI, X-Ray, CT Scans ingested via Merge
PACS as files during active use can be later stored as immutable objects with
searchable meta-data.
• Broadcast Production and Archive Solution: Video data ingested as files during
active use can be later stored as tagged objects.
• CCTV Cam / Dash Cam / Body Cam Solution: Images & video data captured,
tagged and stored as evidence for long term retention & e-discovery.
• Genomic Research Solution: Genomic Sequencer data stored for Analysis & later
23
retained for Analytics & Research. © 2016 IBM Corporation
Spectrum Scale Multi-Site
• GPFS™ allows users shared access to files in either the cluster where the file
system was created, or other GPFS clusters.
• Ability to access and mount GPFS file systems owned by other clusters in a network
of sufficient bandwidth
• Accomplished using the mmauth, mmremotecluster and mmremotefs commands.
• Each site in the network is managed as a separate cluster, while allowing shared file
system access.
• The cluster owning the file system is responsible for administering the file system and
granting access to other clusters on a per cluster basis.
• After access to a particular file system has been granted to nodes in another GPFS
cluster, the nodes can mount the file system and perform data operations as if the file
system were locally owned.
GPFS
• Speeds data access to collaborators and resources
around the world
GPFS
Choice: Spectrum Scale offered the only object-storage solution with ability to use Active File
management (AFM) for object movement between Japan & US sites. Lab Services
collaborated with Development & Research Lab to design a feasible solution and performed
Proof of Concept (PoC) prototyping and bench marking with IBM Spectrum Scale 4.2, AFM
Caching/Parallel IO, and Protocol Server (Object). IBM met client requirements by combining
multiple IBM Spectrum Scale functions.
Solution:
Phase 1 is implementing Spectrum Scale Object with AFM for 2 cache sites in Japan with 1
home site in US. In phase 2 multiple cache sites will be supported with 1 home and in phase
3 multiple cache sites with multiple home sites will be supported.
Benefits: Spectrum Scale with AFM Parallel IO solution – provides the required high data
transfer rates and the ability to expand capacity up to tens of petabyte of objects with single
endpoint.
Thank you!
For more information:
Website: http://www-03.ibm.com/systems/storage/spectrum/index.html
Traditional SWIFT
ibm/gpfs0/
ibm/gpfs0/
<Sof_policy_fileset>/<device>/
object_fileset/
AUTH_acctID/cont/
o/z1device108/objects/7551/125
39
75fc66179f12dc513580a239e92c3125 a.jpg
Object NFS/SMB/POSIX
(http)
2
1
Objects accessed as Files
Data ingested as Objects
<SOF_Fileset>/<Device>
Object NFS/SMB/POSIX
(http)
1
3 Data ingested as Files
Files accessed as Objects
2
objectization
42
43
44
45
46