Sie sind auf Seite 1von 46

IBM STG - Understanding IBM Cloud

Storage and Software-Defined Storage


(SDS) Solutions
May 16th 2014 - STG Enablement Webinar

2014 IBM Corporation

Purpose of Todays Webinar


Understand IBM
STGs Cloud Storage
and SDS Strategy
Deliver Vision and
Strategy to your
Clients
Technical and Sales
Enablement &
Roadmap

2014 IBM Corporation

Major shifts occurring at our clients in place of


traditional IT Infrastructure models. Understand
these changes and IBMs vision

Content designed such that this presentation (or


subset) can be used by you to deliver our vision,
strategy, and solutions to your clients

Introduce Experts available on Technical


Leadership Council (TLC), and create basis for
ongoing deeper dive webinar series

Cloud is a growth engine for business

2x

more companies will use the cloud for


significant innovations by 2015.1

Cloud helps you deliver solutions


faster and realize benefits sooner

2.4x

higher gross profit for enterprises aggressively


adopting cloud for competitive advantage.2

Rapidly optimize data architectures yielding


creative and unrealized business insights

1 IBM, The power of cloud: Driving business model innovation, February 2012.
2 IBM Center for Applied Insights, Global Cloud Enterprise Study, 2013.
3

2014 IBM Corporation

Infrastructure
Matters!

Cloud Delivery Models


The IT department is in
direct competition with
Public Cloud alternatives
for Lines of Business
funding

A public cloud is one in which the


consumer of cloud services and the
provider of cloud services exist in
separate enterprises. The ownership
of the assets used to deliver cloud
services remains with the provider.

A hybrid cloud combines multiple


elements of public and private cloud,
including any combination of providers
and consumers, and may also contain
multiple service layers.
A private cloud is one in which the
cloud infrastructure is provisioned for
exclusive use by a single organization,
comprising multiple consumers. It may
be owned, managed and operated by
the organization itself or a third party,
and may exist on or off premises.
4

2014 IBM Corporation

IBM STG - Understanding IBM Cloud Storage


and Software-Defined Storage (SDS)
Solutions

Open Cloud Platforms


OpenStack, VMWare, Hyper-V

Brian Sherman Distinguished Engineer

2014 IBM Corporation

IBM Comprehensive Storage Management in Cloud


Complete Storage Integration

All Storage APIs consumed


Co-development on vVol and VASA Automation
SRM enablement
Disk Management from vCenter and vCenter Operations
Suite (vCOPs)

Storage Enablement
Manage XIV in Microsoft System Center Virtual
Machine Manager (SCVMM)
Space Reclamation

Cinder and Horizon Automation


Deploy XIV and Storwize storage in Horizon
Automated volume, host and initiator creation
Cinder development contributor

Smart Cloud
User portal for self service
Proven IBM services platform and SLAs
6

2014 IBM Corporation

Enable and Build Better Clouds: RESTful API


Maximum flexibility in automating your custom cloud
Benefits:
Management API for automating your cloud
Integrates XIV natively with your cloud
What the XIV RESTful API offers:
management software
Agnostic/Common to OS and cloud
Delivered through IBM Hyper-Scale
platform programming language
Manager (this is your web server)
Uses http in browser
Offers flexibility to meet needs beyond
Doesn't need a client (like other APIs)
Every object has a unique identifier
standard cloud tools
(URL)

Uses the following http actions:


XIV RESTful API is one
of the first on the
market!

Get (Read)
Put (Create)
Delete (Delete)
Post (Update)
SnapShot and Copy Services support
plus more

EX :
GET XIV/ (lists XIVs)
PUT XIV/:xiv1/volumes/:vol1 size:,pool
7

2014 IBM Corporation

Overview of OpenStack: Key components


Horizon
Oslo

Shared Services

Neutron
Nova

Glance

Swift

Storage Tiers New in Icehouse :

Cinder
Keystone

2014 IBM Corporation

Use for performance or Quality of


Service
Achieved through volume "types
Ability to retype
Host or Volume will handle the
conversion depending on driver

IBM is working to accelerate OpenStack Foundation success


Mar Exponential growth in ~1 YR April
2013
2014
2130
859

Contributors
8,500 Individuals

Contributors
15,800+ Individuals

Platinum Sponsors

15

IBM has 15 core contributors

IBM is #2 in contributions to
integrated projects

107

IBMers active in the projects

Gold Sponsors

OpenStack Participant Growth

380
9

Because an open interoperable Cloud


is critical for flexible cloud deployment
and customer success

2014 IBM Corporation

IBMers working on OpenStack from formation of


the Foundation to Code Quality and New Function

IBM Storage and OpenStack


Storage for the Cloud
IBM is a leading contributor to
OpenStack Cinder

Cinder

IBM SVC/Storwize family, IBM XIV,


TPC/VSC, Elastic Storage and IBM DS8870
Supports Essex to Icehouse releases
iSCSI or Fibre Channel
Full ability to leverage Easy Tier, Real Time
Compression, volume movement, etc
Software defined placement via OpenStackIBM Storwize family IBM DS8000
filter scheduler

IBM XIV

IBM is driving forward OpenStack


storage:
Extending with volume migration
Adding enterprise attributes to OpenStack
Object Store (Swift)

Managing IBM Storwize V7000 Storage with OpenStack


http://www.youtube.com/watch?v=JWMm6-zwrMw

Juno
10/17/2014

Austin

Bexar

Cactus

Diablo

Essex

Folsom

Grizzly Havana Icehouse

10/21/2010
10

3/3/2011

4/15/2011

9/22/2011

4/2/2012

9/27/2012

4/4/2013

2014 IBM Corporation

10/17/2013 4/17/2014

OpenStack Deployment at eBay

eBay

Host all
environments

Watch the video

Production
Magento GO
Magento Commerce
Various Public Products

Test
OpenStack Test
Upgrades
Performance

Development

Mirror sites for HA


between Colos

X.Commerce QA
LnP
Development

XIV is able to ingest any workload without having to


configure LUNsother vendors do not give the same level
of ease of use, performance, or predictability of I/O as XIV.
11

2014 IBM Corporation

Roark Hilomen, eBay, at Edge2013

OpenStack Production Example

MySQL Performance
Performance improvement on XIV and OpenStack private cloud
Bare Metal (BM) = Standard server with local storage
Based on Production workloads

12

2014 IBM Corporation

Cloud Economics Infrastructure Matters


OPEX: Up to 75% of
Cloud Storage Costs

OPEX

Cloud Optimized Storage


Commodity Storage

Simplified Management
Improved admin productivity
Lower skills required

Fewer Servers and Network Connections

Fewer cores and connections


No need for Fibre Channel SAN

Cloud Optimized Storage


TIME/CAPACITY

Higher Storage Utilization

Deliver SLAs with increased utilization

Lower Software License Costs


Fewer cores
Database, infrastructure, SW

CAPEX
Commodity Storage

Lower Environmental Costs


Power / cooling, floor space

Commodity Storage
Cloud Optimized Storage
TIME/CAPACITY

13

2014 IBM Corporation

Lower Entry Costs; Inefficient at Scale


Increasing Complex and Inefficient for
Cloud and Big Data Needs

IBM Hyper-Scale Vision support large growth without overhead


IBM Hyper-Scale
Elastic, scale-out data store of
multiple XIV frames
Managed as a single system; easily
add or remove frames;
XIV SW license all inclusive

IBM Hyper-Scale Mobility


Cross-system data mobility that is
transparent to host applications and
governed by QoS and management
policies
13
2Q 20

IBM Hyper-Scale Manager


An application that provides a single
point of management planning,
monitoring, configuring, setting QoS
and management policies
12
4Q 20
14

2014 IBM Corporation

IBM Hyper-Scale Consistency


Smart, store-aware software
ensures application consistency
upon cross-system data mobility
13
4Q 20

Advanced System Placement (Frame Ahead) for XIV


Machine 1

Machine 2

100% Authorized for


performance and
capacity

Delivered when
Machine 1 hits
expansion threshold

Initial payment of
60% of total price

(70% utilization)

$1 Initial invoice for


Machine 2
Remaining 40%
payment for
Machine 1

Machine 3 to N
Delivered when
prior Machine hits
expansion
threshold
$1 Initial invoice for
current Machine
Remaining
payment (100%
less $1) for prior
machine
(at end of 1 yr term,
client pays for any
delivered system)

Ideally suited for Cloud environments, often


providing the ability to charge out to clients well in
advance of IBM acquisition costs
Typically provides optimal acquisition structure for
variable workloads
IBM installs a full system with partial payment based
on initial usage
Depending on client growth rates and SLA, IBM pre
positions subsequent systems in advance of client
needs typically at 70% Utilization
Simple acquisition model:
Minimal CE involvement in capacity upgrades
Detailed capacity monitoring not required

Key points:

Client enjoys full benefit of system well in advance of payment


Fully populated system not detuned!
Fully Authorized Capacity and Performance! No need for key activation
Ability to run several parallel ASP tracks for multi-site data centers and
client needs
Ability to construct offering as a Capital Acquisition Model or, in many
cases, as an Opex model with payments spread over 36 months (60%
stepping up to 100%, or no payments stepping up to 100%)

15

Overview:
New program launching in 2Q 2014 separate from
existing CUoD / Utility programs

2014 IBM Corporation

Best for clients with rapidly growing storage


requirements needing highly flexible acquisition
models
Can be structured as CAPX and OPEX offering via IGF
May be sold direct today with Partner Channel in 2Q
Available for 15 module XIVs and fully configured
FlashSystem 840s.

IBM STG - Understanding IBM Cloud Storage


and Software-Defined Storage (SDS)
Solutions

A Path to Cloud with


Software Defined
Storage (SDS)
Chris Vollmar - Client Technical Specialist

16

2014 IBM Corporation

Software Defined Environments are the foundation for building a


Dynamic Cloud
Application
Aware
Service
Driven

Resource
Smart

Dynamic Cloud

On or Off Premise

17

2014 IBM Corporation

The new era of Systems of Interaction transforms how companies


engage, interact and transact with their customers

Integrate front-office Systems of Engagement with back-office Systems of Record


Rapidly develop services for new interactions beyond the four walls of the enterprise
Quickly and easily scale to capture all of the different endpoints from front-office engagements
Act immediately on data from real-time integration to enable continuous insights

Systems of Interaction

Exploding
Data Volumes
18

2014 IBM Corporation

Diverse
Data Types

Increasing Value
of Information

Mobile and Social


Engagement

Application Aware infrastructure leverages best practices with


patterns of expertise

Solution
Definition

Define business needs


Identify service opportunities and
requirements
Quickly experiment and test new
services
19

2014 IBM Corporation

Continuous Optimization

What the business wants:

What Software Defined


Environments provides:

Patterns of Expertise to link solution to


infrastructure based on business rules
Automated orchestration of workloads
Analytics-based optimization of workload
to maximize outcomes

What are Software Defined Environments (SDE)?


Software

Abstracted and virtualized IT infrastructure resources


managed by software

Defined

Applications that define infrastructure requirements


and configuration

Environments

IT infrastructure that extends multiple environments


to go beyond the data center

With IBMs Software Defined Environment,


infrastructure is fully programmable to rapidly
deploy workloads on optimal resources and to
instantly respond to changing business
demands

20

2014 IBM Corporation

Software Defined Storage (SDS) as a component of SDE


Workloads

SDE uses a Resource Abstraction layer to


make Compute, Network, and Storage
facilities appear as needed by Workloads
SDE relies on virtualized physical resources,
which can be configured to match the SLAs of
services defined in the Service Catalogue
SDS creates smarter interactions between
workloads and storage by:
Exposing storage capabilities for the workloads to
dynamically provision storage with the most
suitable characteristics (i.e. OpenStack, VMWare)
Introducing new operations and concepts
between workloads and storage to let storage
better adapt to the needs of workloads (i.e.
Applied Analytics)
Moving some of the storage functions closer to
the workloads to leverage higher-level knowledge
and/or lower cost (i.e. Ability to lift storage
services off of disk systems)
increasing reliance on commodity hardware
21

2014 IBM Corporation

Traditional
Middleware Based

Cloud Based
Services

Software Defined Environment

2
Workload Definition and Orchestration
Workload Definition
Workload Orchestration

Software Defined Infrastructure


Resource Abstraction

Software
Defined
Compute

Software
Defined
Network

Software
Defined
Storage

Virtualized Network
Virtual Storage Layer

Heterogeneous Compute
Resources

Software Define Storage Control and Data Planes


Workload Optimized and
Transaction Integrity

Agility and
Rapid Scale

IBM SDS Control Plane


Storage
Virtualization

Integration
and API
Services

Policy
Automation

Backup and
Copy
Management

Analytics and
Optimization

Storage Cloud

Open Common Control Plane to Manage Storage Services for the Workloads
ISIS

VMWare
integration

SCSA

Cloud service
portal

OpenStack
APIs

Cinder support

VSC

Virtual Storage
Center

IBM SDS Data Plane


Scalable storage Capacity
Virtual Storage

22

2014 IBM Corporation

Storage
Systems

TPC, FCM, TSM


Enterprise Storage
management

Current SDS Building Blocks in the Control and Data Planes

IBM SmartCloud
Orchestrator

VMware

OpenStack

Self-Service Portal

IBM Storage Integration Server


Storage integration for virtualized
environments (VMWare)

SDS Control Plane

VSC

Backup Integration
and Automation

SDS Data Plane

Object
Storage
File and Hadoop
Storage
23

2014 IBM Corporation

IBM and 3rd Party Block Storage

Why SDS? SDS addresses top storage pain points

Controlling out-of-control
storage growth
Reducing Costs
Minimizing performance
bottlenecks
Integration of
Provisioning
Supporting Server
Virtualization

Source: The Info Pro 2012


24

2014 IBM Corporation

IBM STG - Understanding IBM Cloud Storage


and Software-Defined Storage (SDS)
Solutions

IBM SmartCloud
Virtual Storage
Center (VSC)
Chris Vollmar - Client Technical Specialist

25

2014 IBM Corporation

Storage services in a block Software Defined Storage Solution


Real-time
Compression
Non-disruptive data
migration

Common
Management

Cloud
Ready

Advanced Mirroring
and
Copy Services

Integration with
Server Hypervisor's

26

2014 IBM Corporation

Thin Provisioning

EasyTier

Application Integration
with FlashCopy
Manager

PCS / IBM Confidential

Storage Analytics
Engine

IBM SmartCloud Virtual Storage Center (VSC)

IBM SmartCloud Virtual Storage Center


Enables storage for cloud computing
Easy to buy and deploy
Pay-as-you-go pricing

SAN

Storage Virtualization

27

Infrastructure
Resource Management

2014 IBM Corporation

Snapshot
Data Protection

Storage Optimization,
Provisioning and
Transformation

IBM SmartCloud Virtual Storage Center (VSC) - Portfolio

Storage as the Cloud or Storage for the Cloud


IBM SmartCloud

IBM SmartCloud

IBM SmartCloud

Virtual Storage Center

VSC -Entry

VSC for Storwize

Global Enterprise License


Structure

Restricted to 250 TBs and 2


SVC I/O groups

Restricted to the Storwize


V7000 and V5000 hardware

Storage profile of 200TB to


1PB +

Per TB price metric

Includes all features of


standard VSC license
(virtualization, FlashCopy,
Mirroring, Advanced
Analytics)

Per Enclosure price metric


for all internal and externally
virtualized Storage
enclosures

Includes all features of VSC


(external virtualization,
Mirroring, Advanced
Analytics);

License does not include


base SW license for Storwize
HW

Leverages IBM SVC Engines or


I/O groups
Single per TB license to
include:
SVC Virtualization
SVC FlashCopy
SVC Remote Mirroring
TPC
FCM
Storage Analytics Engine

28

2014 IBM Corporation

Leverage Real-Time
Compression to extend
capacity management
beyond 250 TB

Advanced Analytics and Cloud Functionality in VSC


Automated Storage Tiering:
Automatically migrate volumes between service
classes / storage pools based on user defined policy
schedule recurring analysis

Dynamic Storage Pool Utilization


Real-time view of storage pool utilization with additional
tags for attributes like name and location

Storage Volume Transformation


Ability to transform an existing storage volume into a
different type of volume to take advantage of built-in
efficiency features of the storage virtualization layer
within VSC

Service Classes / Storage Pools


Manage service classes and storage pools within the
graphical interface with ability to create, modify, and
delete resources

Self-Service Provisioning
Improved interfaces for submitting storage requests
either via the user interface (with role-based
authorization) or via external tools like SmartCloud
Storage Access via integration through available APIs

29

2014 IBM Corporation

Advanced Analytics

IBM STG - Understanding IBM Cloud Storage


and Software-Defined Storage (SDS)
Solutions

SmartCloud Storage
Access (SCSA) Self
Service Storage
Chris Vollmar - Client Technical Specialist

30

2014 IBM Corporation

IBM SmartCloud Storage Access R1.2 at a glance


Self-service
Capacity provisioning, monitoring, reporting

Web-based access
Simple GUI via Internet

Monitoring and reporting capability


End-user and administrator
Usage metrics export function

Service Class customization


Control
Complete approval control process
Automatic expiration policy control

Open
Storage cloud integration API (REST) for 3rd party application
integration

Support

31

File (CIFS/NFS) storage


Block (FC) storage
SCSA Instrumentation Layer (powered by TPC)
Federated authentication

2014 IBM Corporation

Designed to offer a simple cloud storage architecture

Cloud,
Dept
admin

Authentication
Server

Cloud
service
users

End to end private cloud storage solution


Self service portal
Required elements that may already exist at customer
2014 IBM Corporation

Testers

Instrumentation Layer (SCSAIL) powered by TPC


or
Tivoli Storage Productivity Center
or
Virtual Storage Center

Storwize
family

32

Develop
ers

XIV

SONAS

IBM STG - Understanding IBM Cloud Storage


and Software-Defined Storage (SDS)
Solutions

Software Defined
Storage for Unstructured
data Code name:
Elastic Storage
Leonard Degollado Client Technical Specialist

33

2014 IBM Corporation

Storage services in an Unstructured Software Defined Storage


Solution
File Placement
Optimization

Non-disruptive data
migration

Advanced Mirroring
and
Caching Services

Common
Management

PPPPPP PPPPPPPPP

Cloud
Ready

Commodity Hardware

Global Active
File
Management

Storage Resource
PPPPP

Flash
Acceleration

34

2014 IBM Corporation

Native Encryption
and
Secure Erase

PCS / IBM Confidential

Network
performance
monitoring

Elastic Storage
Proven, scalable, high-performance software defined storage solution
Simplified data management and automated information lifecycle tools
Capable of managing petabytes of data and billions of files

15 years in the marketplace


Broad adoption across many industries
Technical computing
Electronic Design Automation, Life Sciences, Oil and Gas Exploration, Government,
Media, Financial Services, HPC
Enterprise computing
Business Analytics, OLTP

Over 3,000 customers with 100K+ systems world-wide


Industry proven, minimizing risk

35

2014 IBM Corporation

Elastic Storage deployment models

36

2014 IBM Corporation

Cold Storage In the Industry Facebook, Google and IBM


Facebook Crafts Cold Storage Library From Blu-ray Discs
The setup can cram an amazing 1 PB of data into a single 48U rack
(seven feet high).2
.the as-yet-unnamed Blu-ray library would burn 80 percent less energy
than the Open Vault cold storage, and would be 50 percent less expensive
than that disk-based setup as well.2

Google reveals TAPE-TASTIC data centre


"We store another copy of the most important data on digital tape. 3

Tape Rescues Big Data


Tape will never be the whole answer to storing data,
according to Dr Eleftheriou. But it forms a crucial part
of a storage hierarchy.1

37

2 Facebook Crafts Cold Storage Library From Blu-ray Discs


EnterpriseTech Storage Edition
http://www.enterprisetech.com/2014/01/28/facebook-crafts-cold-storage 2014 IBM Corporation
library-blu-ray-discs/

3. Google reveals TAPE-TASTIC data centre in saucy vid


Say it loud: We've tape and we're proud
The Register 28, 01, 2013
http://www.theregister.co.uk/2013/01/28/google_oracle/

1 Tape Rescues Big Data


The Economist, Blogs, Science and Technology September 2013
http://www.economist.com/blogs/babbage/2013/09/informationstorage

Linear Tape File System Enterprise Edition (LTFS EE)


LTFS EE integrates LTFS LE with
Elastic Storage
Policy based migration

Elastic Storage provides global


name space
LTFS EE is installed on one or
more Elastic Storage nodes

Users and applications

User data

Global name space

Elastic Storage
Elastic Storage
Node
NodeStorage
1
Elastic
file systems (user
data2and metadata)
LTFS EE

Workload is distributed over all


LTFS EE nodes and tape drives

TSxxxx Tape
Library
38

2014 IBM Corporation

LTFS EE

Self Service and Elastic Storage


Dept Admin work with virtual resources
Mission: - Manage virtual resources;
-Manage business processes;
Tools: SCSA (User)

End User work with virtual


resources
Mission: Use virtual resources
Tools: SCSA (User)

Cloud Admin - work with virtual resources


Mission - Connect virtual resource pool to Cloud
Management;
-Manage virtual resources;
-Manage business processes;
Tools: SCSA (Admin)

Storage Cloud
NFS

Elastic Storage Architecture


Node 1
Node
2
Node N
Node k EE
with
LTFS
ES

ES

ES

LTF
S

LTF
S

LTF
S

Storage Infrastructure Admin work with physical devices


Mission: Monitor/manage physical devices; Create virtual
resource pool
Tools: LTFS EE CLI

39

2014 IBM Corporation

SCSA
Authentication
Server

ES

Mgmt flow
Data flow
http://www.redbooks.ibm.com/Redbooks.nsf/Redbook
Abstracts/tips1129.html?Open

IBM STG - Understanding IBM Cloud Storage


and Software-Defined Storage (SDS)
Solutions

Storage Cloud
Focus Plays
Chris Vollmar - Client Technical Specialist

40

2014 IBM Corporation

Software Defined Anything (SDx) is transforming the market

41

2014 IBM Corporation

Five Cloud Storage and Software Defined Storage Conversations


.you can have today
XIV for Cloud Providers and MSPs
Featuring the Frame ahead offering for
GridScale
IBM Virtual Storage Center (VSC) for
Private Storage Clouds Featuring 3 VSC license offerings
Self Service Modular Cloud Storage
Storwize with Active Cloud Engine (ACE)
and SmartCloud Storage Access (SCSA)
Cold Storage for Private Clouds
With LTFS EE Rapid Application
Configurations
Software Defined Storage for
Unstructured Data
Code name: Elastic Storage
42

2014 IBM Corporation

Infrastructure matters because business outcomes matter and new


outcomes entail new infrastructure demands.

A wide range of innovations is happening


at the infrastructure layer, as continued
hardware improvements drive new
capabilities for compute, storage, and
networking and combine with new
innovations in software. These will
recombine in numerous ways to create
much more capable infrastructure and
application platforms.
-- Brian Hopkins et al., Forrester Research, Forresters Top 15 Emerging
Technologies To Watch: Now To 2018, February 2013.

43

2014 IBM Corporation

Resources Cloud Storage and SDS IBM Technical Leadership Council

Matt Bedernjak Storage CTM


Brian Sherman Distinguished Engineer
Leonard Degollado Client Technical Specialist
Pete Kisich - Client Technical Specialist
Mike Lovering - Client Technical Specialist
Todd Nordquist - Client Technical Specialist
Jim Rogers - Storage Architect
Chris Vollmar - Client Technical Specialist
Mike Grove - Client Technical Specialist

44

2014 IBM Corporation

45

2014 IBM Corporation

46

2014 IBM Corporation