SAP HANA SPS 09 - Dynamic Tiering

SAP HANA SPS 09 - Whats New?
HANA Dynamic Tiering

(Delta from SPS 08 to SPS 09)
SAP HANA Product Management
2014 SAP SE or an SAP affiliate company. All rights reserved.
November 2014
Disclaimer
This presentation outlines our general product direction and should not be relied on in making
a purchase decision. This presentation is not subject to your license agreement or any other
agreement with SAP.
SAP has no obligation to pursue any course of business outlined in this presentation or to
develop or release any functionality mentioned in this presentation. This presentation and
SAPs strategy and possible future developments are subject to change and may be changed
by SAP at any time for any reason without notice.
This document is provided without a warranty of any kind, either express or implied, including
but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or
non-infringement. SAP assumes no responsibility for errors or omissions in this document,
except if such damages were caused by SAP intentionally or grossly negligent.
Public
Agenda
Positioning
What is SAP HANA Dynamic Tiering, and what is its value to the customer?
Technical Details
Implementation choices
Use Cases
SAP BW and native HANA applications
Future Direction
Where are we headed?
Public
Positioning
What is SAP HANA Dynamic Tiering, and what is its value to the customer?
IDC predictions for 2014

Demand
Mobile
Sales Order
Cloud spending will surge by 25%, reaching

over $100 billion. There will be a doubling of
cloud data centers.
Instant Messages
Big Data
Transactions
Customer
Cloud
Sales
Order
CRM Data
Things
Planning
CRM Data
Things
Inventory
Opportunities
Demand
Mobile
Big Data
Planning Transactions
30 billion devices, sensors in 2020 driving

$8.9 Trillion in revenue
Customer
Data explosion
Data volumes will continue to explode to 6 billion petabytes
Internet of Things
Social networking
Social networking will become embedded
in cloud platforms and most enterprise
apps and processes
Public
SAP End to End Data Management for Real Time Business

Cloud
Workforce of
the Future
Big Data
Internet of
Things
Industries
Business & Consumer Applications

Custom
Development
TRANSACT
ISVs & OEMs
STORE
ERP
ANALYZE
PREDICT
SAP DATA MANAGEMENT
Public
SAP Data Management Portfolio

End-to End Data Management & App Platform for Real-Time Business
REAL-TIME APPLICATIONS
Consumer
Engagement
Sense &
Respond
SAP ASE
REAL-TIME ANALYTICS
Planning &
Optimization
Operational
Analytics
SAP HANA PLATFORM
e
Real-time transactions + end-to-end analytics
Extended Application Services
Big Data
Warehousing
Predictive, Spatial &

Text Analytics
SAP SQL
Anywhere
Processing Engine
SAP ESP
Replication
Server
SAP HANA platform
Database
Services
SAP HANA
dynamic tiering
Application Function Lib. & Data Models

Integration Services
SAP IQ
SAP Data
Services
Public
Time Value of Data
When you
need it again
Last time
accessed
Value
Archive Access Event

Regulatory audit
Business critical reference data
Source data
Value of
immediate
data access
declines
Time
Public
Multi-Temperature Storage Options with SAP HANA
Data Temperature
Storage Option
SAP BW
on HANA
SAP Business Suite on

HANA
SAP HANA
Native
hot
SAP HANA
In-Memory
SAP HANA
dynamic tiering
(1)
(2)
Data Aging
(Next Gen ILM)
Near-line Storage
(NLS)
Data Archiving
(ADK)
cold
frozen
Generally available
Combination not available
1
Early shipment available for SAP BW 7.4; General availability planned Q4/2014
2 General
3 For
availability with limited scope planned Q4/2014
selected business objects
Public
SAP HANA Dynamic Tiering

Key aspects at a glance
Add-on Product to SAP HANA
SPS 9 release focus
Manage data of different temperatures
Operational integration
Hot data (always in memory) classical HANA

Cold data (disk based data store)
Introducing a new type of table:
Common installer
Unified monitoring and administration
Integrated backup/recovery
Extended table disk-based columnar table
Initial functional scope
SAP HANA Database

Hot
Data for daily reporting,

other high-priority data
Warm
Other data required to

operate the application
Transparent query processing

Cross-store optimizer
Use extended table in calculation views
Applications manage data temperatures
(no active support for aging)
Public
10
Introducing SAP HANA Dynamic Tiering

Requirements from our customers
Manage data cost effectively, yet with desired performance based on SLAs
Handle very large data sets terabytes to petabytes
Update and query all data seamlessly via HANA tables
Application defines which data is hot, and which data is warm
Native Big Data solution to handle a large percentage of enterprise data needs without Hadoop
SAP HANA Database System

SAP HANA
hot store
(in-memory)
Hot table
(definition/data)
Extended table
(definition)
Fast data movement and optimized push

down query processing
SAP HANA warm store

(dynamic tiering)
Extended table
(data)
All data of extended table resides in warm store
Public
11
Hot/Warm Data Management

Questions about SAP HANA Dynamic Tiering
Why is warm data management

important for SAP HANA?
Size and cost constraints may prohibit all in-memory solution

Not all data has the same value
Warm data has lower latency requirements than hot data
Why is SAP HANA dynamic tiering

the best solution for warm data
management?
SAP HANA dynamic tiering utilizes disk backed, smart column store technology based on Intellectual Property
from SAP Sybase
SAP HANA dynamic tiering excels at ad hoc queries on structured data from terabyte to petabyte scale
SAP HANA dynamic tiering is a deeply integrated, high performance solution in a single system
What about Hadoop for warm data

storage and processing?
Hadoop has unlimited capacity for raw data processing

Hadoop is best suited for batch processing of raw, unstructured data
Hadoop is an external data store with technical integration into HANA with higher TCO in order to manage
the additional system
Public
12

Key aspects at a glance
Data in the database
Data moved out of the database
Different data temperatures
Different data qualities
Maximum access performance

Hot data - always in memory
Reduced access performance:
Warm data - not (always) in memory
Available for read access

BW Near-line storage
Not accessible without IT process
Traditional archive
All part of the databases data image
Data is stored and managed outside of the

application database
SAP HANA Database

Hot
Data for daily reporting,

other high-priority data
NLS
Data that is (normally) not updated, infrequently accessed
Externalize
Warm
Other data required to

operate the application
Traditional Archive
Data thats kept for legal reasons or similar
Public
13
Problems with temperatures

There are too many options across system boundaries
HANA column and
Priority and
Data Volume
Performance
and Price
In DB
row store
In memory
No restrictions, all features available
hot
HANA
Warm store of dynamic tiering /

Non-Active Data Concept
In DB
On disk
warm
BW Near-line Storage
cold
Archive
???
External to DB
Near-line Storage
Read access, no updates
Traditional Archive
External to DB
Archive storage
No read access or updates
Public
14
Problems with temperatures

There are too many options across system boundaries
HANA column and
hot
warm
hot
warm
Priority and
Data Volume
Performance
and Price
In DB
row store
In memory
Warm store of dynamic tiering /

Non-Active Data Concept
In DB
On disk
BW Near-line Storage
cold
???
BW NLS
Archive
External to DB
Near-line Storage
Read access, no updates
Traditional Archive
External to DB
Archive storage
No read access or updates
Public
15

Map data priorities to data management
Hot Store
Classic HANA tables
Primary data image in memory
DB algorithms optimized for in-memory data
Persistence on disk to guarantee durability
Warm Store
Extended Tables
Primary data image on disk
Data processing using algorithms optimized for
disk-based data
Main memory used for caching and processing.
Hot data
Warm data
All in one
database
SAP HANA Database

Dynamic Tiering
Hot Store
Primary
image in
memory
Durability
Warm Store
RAM
Cache / Processing
Primary Image
on disk
Public
16
Technical Details
Implementation choices
SAP HANA Dynamic Tiering one database / one experience for

HANA application developers and admins
Reduced TCO
Optimized for performance
Single database experience
Centralized operational control
Centralized
monitoring /
admin
Integrated
security
Common
installer and
licensing
model
SAP
HANA
Dynamic
Tiering
High speed
data ingest
Optimized
query
processing
Unified
backup and
restore
Public
18

The overall system layout
SAP HANA with Dynamic Tiering consists of two types of
hosts:
Regular worker hosts (running the classical HANA processes:
indexserver, nameserver, daemon, xsserver,)
HANA hosts can be single-node or scale-out; appliance or TDI
ES host (running nameserver, daemon, and esserver)
esserver is the database process of the warm store
One single SAP HANA database: one SID, one instance number
All client communication happens through index server / XS server
SAP HANA System with dynamic tiering service

Fast data movement and optimized push down query processing
Hot Store
Client
Application
Connect
Warm Store
Column
Table
Worker
host(*)
Row
Table
Worker
host
Extended
Table
Worker
host
ES host
Common Storage System

(*) Standby hosts not shown
Public
19
HANA Extended Tables

HANA extended table
schema is part of HANA
database catalog
HANA extended table is a first

class database object with full
ACID compliance
HANA extended table

data resides in warm
store
Database Catalog
Table Definition
Data
Hot
Store
Classical HANA
column/row table
Data
Warm
Store
Extended table
(warm table)
Table Definition
HANA Database
Public
20
High Speed Data Ingest

Import from CSV files:
IMPORT FROM CSV FILE bigfile.csv INTO t1
Bulk array insert:

INSERT INTO t1 (col1, col2, col3...) VALUES (val1, val2, val3...)
High-speed data movement between HANA tables and HANA extended tables:
INSERT INTO t_extended select c1 FROM t_hana
Concurrent inserts from multiple connections:

A HANA extended table may be a DELTA enabled table, which allows multiple concurrent writes
Data movement between hot and warm store

IMPORT FROM CSV
FILE data.csv
INTO t_extended
CSV
DATA
Warm
Extended
Table
Materialization
INSERT...SELECT
Hot HANA
column Table
HANA Database
Public
21
Optimized Query Processing

Parallel query processing
Ordering
Grouping
Data is pulled from HANA hot store into HANA warm

store query processing engine using multiple streams,
and processed in parallel
Push/Pull query optimization and transformation
Joining
T1
T2
T3
T4
Extended tables may be used in HANA CALC

views
Query operations ship to hot or warm store as

appropriate for native performance
HANA Calc engine and HANA SQL engine share

extended table query performance optimizations
Public
22
Example Query Plan

select
"account_num",
count(*) as account_count
Customer is a native
from
HANA table in HANA
VXM_FOODMART.CUSTOMER C
memory
where
"lname" >= 'Ga' and "lname" < 'Gb'
and exists
(
select *
from
Product is a HANA
VXM_IQSTORE.PRODUCT P
extended table in the
where
warm store
"product_id" = "customer_id"
)
group by
"account_num"
order by
"account_num";
Public
23
HANA Monitoring and Administration

HANA Cockpit:
New, web based monitoring and administration
console for HANA Extended Storage
HANA Studio will be used for design and

modeling of HANA extended tables
HANA Cockpit displays status,
CPU/memory/storage resource utilization,
table usage statistics
Provides access to and search of server logs

and custom traces
Shows alerts triggered by extended storage
Enables administration of extended storage:
add and drop storage, or increase size of file
Public
24
Unified Backup and Restore

Data backup
System crash
Log backup
Log area
HANA
Time
t1
Extended
Storage
t2
t3
Backup History
Log backups
(automatic, or
none)
Restore
Data backups with log
backups allow restore
to Point in Time or
most recent state: t1> t3
HANA backup manages backup of both hot and warm store
Point in Time Recovery (PITR) is supported
Data backups
(manual or
scheduled)
Data backups alone

allow restore to specific
backup only: t1 or t2
Public
25
High Availability and Disaster Recovery

High availability
Compute node failure will result in failover to standby node (manual for warm store
nodes)
Storage failure will depend on inherent storage vendor disk mirroring and fault
tolerance capabilities
Hot and warm store should use the same storage to facilitate auto-failover in the
future
Warm Store Service

Manual
Failover
Compute
node
Standby
node
Warm Store
mirror
Disaster recovery
HANA without Dynamic Tiering supports continuous replication to maintain a disaster
recovery site
HANA with Dynamic Tiering will maintain a disaster recovery site through backup and
restore capabilities only
Disaster recovery through system replication is planned for a future release
Disaster recovery through storage replication may be added independently from
software releases
Hot Store
mirror
Compute
node
Standby
node
AutoFailover
Classical HANA services
Public
26
Support in SAP HANA multiple database containers (MDC)

MDC: One SAP HANA system can have multiple tenant databases
Each tenant database can be associated with zero or one extended stores
Each extended store is dedicated to exactly one tenant database
System Database
Compute node
Tenant Database <A>
Compute node
Tenant Database <B>
Tenant Database <C>
Extended Store
Extended Store
Compute node
ES Host <B>
ES Host <C>
Classical HANA (single-node or scale-out)
SAP HANA system with MDC and dynamic tiering
Public
27
Use Cases
SAP BW and native HANA applications
SAP NetWeaver BW powered by SAP HANA

Data Classification by Object Type
Data Categories in a BW System

Archived
BW Operational Data
EDW Transformation
Memory
EDW Propagation
Corporate
Business Transformation
Archive/NLS
Analytic Mart
Staging Layer
Frequent reporting and/or HANA-native operations

Limited reporting, limited HANA-native operations
Old, out-of-use data Archive, read-only, different SLAs
Public
29
Extended Tables in HANA BW

Use Case: Staging and Corporate Memory
Object Classification in BW
Data Sources and write-optimized DSOs
can have the property Extended Table
Generated Tables are of type Extended
All BW standard operations supported
no changes
Only minor temporary RAM required in HANA
InfoCubes and Regular or Advanced DSOs
BW System
Staging Area
Corporate Memory
Data Mart
Data Source
Write-optimized DSO
InfoCube
Database Catalog
PSA Table
Table
Schema
Active Table
Table
Schema
Fact Table
Table
Schema
Generate standard column table
Data
Data
Warm store
Data
Hot Store
SAP HANA database
Public
30
SAP HANA Dynamic Tiering for Big Data

SAP HANA with Dynamic Tiering provides native Big Data solution
SAP HANA
Hot data
Cutting edge, in-memory platform
Transact/analyze in real-time
Native predictive, text, and spatial algorithms
HANA extended tables

Petascale, warm
structured data
Petascale extension to HANA with disk backed,
columnar database technology
Expand HANA capacity with warm/cool structured
data in HANA warm store
Tight integration between HANA hot store and HANA
warm store for optimal performance
Public
31
SAP HANA with Dynamic Tiering

Native Big Data solution for a multitude of use cases
SAP HANA Dynamic Tiering for Big Data Use Cases across Industries
Airline route profitability analysis: SAP HANA analyzes revenue, variable operating costs (fuel,
landing fees...), and fixed operating costs in real time to make decisions on network, pricing, and
marketing to determine where to fly, when, and how often. All data must be analyzed in real time.
Public utilities: enterprise data stored in SAP HANA and large amounts of smart meter data
stored in HANA extended tables, to identify operational problems, and establish incentive pricing
for more efficient energy use.
Financial services: Stock tick data streamed into SAP HANA for immediate price fluctuation
analysis and trading actions, with historical stock price data stored in HANA extended tables for
trend analysis and portfolio management.
Telecommunications: Network service data in HANA extended tables analyzed and correlated
with customer loyalty data in SAP HANA, to anticipate customer churn and initiate customer
retention response activities.
Public
32
Future Direction
Where are we headed?
SAP HANA Dynamic Tiering roadmap

PLANNED
SAP HANA dynamic tiering available to be used by any

HANA application (if the application supports the
feature)
Common installer
Unified administration and monitoring using HANA
Cockpit
Extended Storage (ES) engine is part of HANA topology
Single authentication model
Single licensing model
Combined error log / trace handling
Integrated File-based backup/recovery, including point-in
time recovery
FUTURE
HANA ES host scale-out and auto-failover (HA)

Disaster Recovery (SAP HANA system replication)
Further integration with respect to backup/recovery
Hybrid extended tables with rule based automatic data
movement / aging
Optimization of communication between hot and warm
store
Further unification of DDL and DML for HANA
extended tables
Further optimizer enhancements
Further extension of unique HANA capabilities to warm
store
Public
34
Hybrid extended tables
Single HANA table that spans hot and warm stores

Hot partitions in HANA memory; remaining partitions in warm store
Automatic, rules-based, asynchronous data movement between hot and warm stores
regulatory
audit
Hybrid
Extended
Table
2012
Hot data in
HANA tier
2012
aging
Warm data In
warm tier
Public
35
How to find SAP HANA documentation on this topic?
In addition to this learning material, you can find SAP HANA

platform documentation on SAP Help Portal knowledge center at
http://help.sap.com/hana_platform.
The knowledge centers are structured according to the product
lifecycle: installation, security, administration, development:
SAP HANA Platform SPS
Documentation sets for SAP HANA options can be found at

http://help.sap.com/hana_options:
SAP HANA Options
SAP HANA Advanced Data Processing
Whats New Release Notes
SAP HANA Enterprise Information Management
Installation
SAP HANA Predictive
Administration
SAP HANA Real-Time Replication
Development
SAP HANA Smart Data Streaming
References
SAP HANA Spatial
Public
36
Thank you
Contact information
Richard Bremer, Courtney Claussen, Balaji Krishna, and Robert Waywell
SAP HANA Product Management
AskSAPHANA@sap.com

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP SE or an SAP affiliate company.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP SE (or an SAP affiliate
company) in Germany and other countries. Please see http://global12.sap.com/corporate-en/legal/copyright/index.epx for additional trademark information and notices.
Some software products marketed by SAP SE and its distributors contain proprietary software components of other software vendors.
National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or warranty of any kind, and SAP SE or its
affiliated companies shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP SE or SAP affiliate company products and services
are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as constituting an
additional warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or any related presentation, or to develop or
release any functionality mentioned therein. This document, or any related presentation, and SAP SEs or its affiliated companies strategy and possible future
developments, products, and/or platform directions and functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for
any reason without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. All forwardlooking statements are subject to various risks and uncertainties that could cause actual results to differ materially from expectations. Readers are cautioned not to place
undue reliance on these forward-looking statements, which speak only as of their dates, and they should not be relied upon in making purchasing decisions.
Public
38

SAP HANA SPS 09 - Dynamic Tiering

Hochgeladen von

Dokumentinformationen

Copyright

Verfügbare Formate

Dieses Dokument teilen

Dokument teilen oder einbetten

Freigabeoptionen

Stufen Sie dieses Dokument als nützlich ein?

Sind diese Inhalte unangemessen?

Copyright:

Verfügbare Formate

SAP HANA SPS 09 - Dynamic Tiering

Hochgeladen von

Copyright:

Verfügbare Formate

SAP HANA SPS 09 - Whats New?

HANA Dynamic Tiering

2014 SAP SE or an SAP affiliate company. All rights reserved.

2014 SAP SE or an SAP affiliate company. All rights reserved.

2014 SAP SE or an SAP affiliate company. All rights reserved.

IDC predictions for 2014

Cloud spending will surge by 25%, reaching

30 billion devices, sensors in 2020 driving

2014 SAP SE or an SAP affiliate company. All rights reserved.

SAP End to End Data Management for Real Time Business

Business & Consumer Applications

ISVs & OEMs

SAP DATA MANAGEMENT

2014 SAP SE or an SAP affiliate company. All rights reserved.

SAP Data Management Portfolio

SAP HANA PLATFORM

Extended Application Services

Predictive, Spatial &

SAP HANA platform

Application Function Lib. & Data Models

Time Value of Data

Archive Access Event

Multi-Temperature Storage Options with SAP HANA

SAP Business Suite on

availability with limited scope planned Q4/2014

selected business objects

2014 SAP SE or an SAP affiliate company. All rights reserved.

SAP HANA Dynamic Tiering

SPS 9 release focus

Manage data of different temperatures

Hot data (always in memory) classical HANA

Introducing a new type of table:

Extended table disk-based columnar table

Initial functional scope

SAP HANA Database

Data for daily reporting,

Other data required to

2014 SAP SE or an SAP affiliate company. All rights reserved.

Transparent query processing

Introducing SAP HANA Dynamic Tiering

SAP HANA Database System

Fast data movement and optimized push

SAP HANA warm store

All data of extended table resides in warm store

2014 SAP SE or an SAP affiliate company. All rights reserved.

Hot/Warm Data Management

Why is warm data management

Size and cost constraints may prohibit all in-memory solution

Why is SAP HANA dynamic tiering

What about Hadoop for warm data

Hadoop has unlimited capacity for raw data processing

2014 SAP SE or an SAP affiliate company. All rights reserved.

SAP HANA Dynamic Tiering

Data moved out of the database

Different data temperatures

Different data qualities

Maximum access performance

Available for read access

All part of the databases data image

Data is stored and managed outside of the

SAP HANA Database

Data for daily reporting,

Other data required to

2014 SAP SE or an SAP affiliate company. All rights reserved.