Beruflich Dokumente
Kultur Dokumente
Las Vegas
September 24–27, 2019
Matt Zenus
Barcelona
October 8-10, 2019
Ruediger Karl
Bangalore
November 13-15, 2019
Ganeshmoorthy Duraisamy
The information in this presentation is confidential and proprietary to SAP and may not be disclosed without the permission of SAP.
Except for your obligation to protect confidential information, this presentation is not subject to your license agreement or any other service
or subscription agreement with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or any related
document, or to develop or release any functionality mentioned therein.
This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms directions and
functionality are all subject to change and may be changed by SAP at any time for any reason without notice. The information in this
presentation is not a commitment, promise or legal obligation to deliver any material, code or functionality. This presentation is provided
without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a
particular purpose, or non-infringement. This presentation is for informational purposes and may not be incorporated into a contract. SAP
assumes no responsibility for errors or omissions in this presentation, except if such damages were caused by SAP’s intentional or gross
negligence.
All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ materially from
expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, which speak only as of their dates,
and they should not be relied upon in making purchasing decisions.
What’s Next
Source: IDC Data Age 2025 Source: IDC Data Age 2025 Source: IDC, Worldwide Spending on Cloud IT Infrastructure
Reality
Strategy
Large Data with Different Formats
Complex Infrastructures
Data Compliance
TECHNOLOGIES
SAP Analytics Cloud SAP Data Warehouse Cloud SAP HANA Cloud
Analytics technology – business End-to-end data warehouse in the cloud Next-gen database Platform as-a-Service
intelligence (BI), planning, and predictive that combines data management with full capabilities to manage OLTP,
analytics – in a single solution processes with advanced analytics OLAP and HTAP workloads
Unlimited Trusted
Single source of truth for all data, Provides your business users
transactional and analytical, tools that ensure the data
structured and unstructured, they’re working with is
across on premise and cloud. actionable.
Simple Open
Manage data however you like to General purpose data
control costs and according to management platform for SAP,
your performance needs. non-SAP, third-party, and custom
applications.
Comprehensive portfolio from self managed to fully managed native cloud platform
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 17
SAP HANA: Deployment Options & Configurations in the Cloud
3rd Party Public Clouds via SAP HANA BYOL SAP HANA as a Service
Scale-up: up to 4TB(OLTP/OLAP)
Scale-out: up to 32TB for OLAP
SAP HANA Cloud
Scale-up: 4TB(OLTP) & 3TB(OLAP)
Scale-out: up to 3.2TB for OLAP
IaaS | HC IaaS | HC
Hybrid Cloud
Access replays Continue the conversation Check out the latest blogs
Keynotes Read and reply to blog posts See all SAP TechEd blog posts
Live interviews Ask questions Learn from peers and experts
Select lecture sessions Join discussions
http://sapteched.com/online sap.com/community SAP TechEd blog posts
www.sap.com/contactsap
Las Vegas
September 24–27, 2019
Tobias Koebler
Jochen Merkel
Barcelona
October 8-10, 2019
Britta Thoelking
Tobias Karpstein
Bangalore
November 13-15, 2019
Lalitendu Samantray
The information in this presentation is confidential and proprietary to SAP and may not be disclosed without the permission of SAP.
Except for your obligation to protect confidential information, this presentation is not subject to your license agreement or any other service
or subscription agreement with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or any related
document, or to develop or release any functionality mentioned therein.
This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms directions and
functionality are all subject to change and may be changed by SAP at any time for any reason without notice. The information in this
presentation is not a commitment, promise or legal obligation to deliver any material, code or functionality. This presentation is provided
without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a
particular purpose, or non-infringement. This presentation is for informational purposes and may not be incorporated into a contract. SAP
assumes no responsibility for errors or omissions in this presentation, except if such damages were caused by SAP’s intentional or gross
negligence.
All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ materially from
expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, which speak only as of their dates,
and they should not be relied upon in making purchasing decisions.
ABAP Integration
Overview
ABAP Operators & Demo
Q&A
Orchestrate
your data using
Discover modular data pipelines
your data landscape and
its interconnections
Govern Refine
and secure data assets enrich, transform,
transparently with compliance reuse, curate
SAP Data Hub
SAP Data Hub discovers, refines, governs, and orchestrates any type, variety,
and volume of data across your distributed data landscape.
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 7
SAP Data Hub DAT302
Key capabilities
SAP
Cloud Storages
BW Standard
SAP BW/4 HANA SAP BW Hadoop / HDFS
Integration Connectors
(open & native
Data Governance
protocols)
REST APIs
SAP C/4HANA
Cloud Data
Data Discovery / Data Profiling / Metadata Cataloging Databases
Integration*
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC *This is the current state of planning and may be changed by SAP at any time without notice. 8
SAP Data Hub DAT302
Key capabilities
SAP
Cloud Storages
BW Standard
SAP BW/4 HANA SAP BW Hadoop / HDFS
Integration Connectors
(open & native
Data Governance
protocols)
REST APIs
SAP C/4HANA
Cloud Data
Data Discovery / Data Profiling / Metadata Cataloging Databases
Integration
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC *This is the current state of planning and may be changed by SAP at any time without notice. 9
SAP Data Hub
Big Picture of this session
ABAP Integration
SAP S/4HANA 1909 SAP Data Hub 2.7
SLT replication
SAP LT
Replication Server (SLT)
ABAP Integration
SAP S/4HANA 1909 SAP Data Hub 2.7
SLT replication
SAP LT
ABAP Integration
SAP S/4HANA 1909 SAP Data Hub 2.7
SLT replication
SAP LT
1. ABAP Integration is used for the direct communication from SAP S/4HANA 1909 to SAP Data Hub 2.7
2. SLT replication is leveraged to connect to older releases
3. SAP LT Replication Server (SLT) is part of SAP Data Hub and no additional license required
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 12
ABAP Integration
ABAP Integration
Overview
One model to consolidate all interaction scenarios between SAP Data Hub
and an ABAP-based SAP system directional and bi-directional
Capabilities
SAP S/4HANA
Provide ABAP METADATA to the
SAP Data Hub Metadata Explorer
SAP S/4HANA Cloud
Integration requires certain system level, planned at least SAP S/4HANA 1909, SAP S/4HANA cloud 1911, SAP NetWeaver 7.00
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
with DMIS 2011/2018 Q4/2019 version. Certain functionality can only be made available for certain release levels.
14
ABAP Integration
Overview
One model to consolidate all interaction scenarios between SAP Data Hub
and an ABAP-based SAP system directional and bi-directional
Capabilities
SAP S/4HANA
DAT162
Provide ABAP METADATA to the
SAP Data Hub Metadata Explorer
SAP S/4HANA Cloud
Integration requires certain system level, planned at least SAP S/4HANA 1909, SAP S/4HANA cloud 1911, SAP NetWeaver 7.00
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
with DMIS 2011/2018 Q4/2019 version. Certain functionality can only be made available for certain release levels.
15
ABAP Integration
Technical Concept - Repository
Modeler
ABAP-based system SAP Data Hub 2.7 & SAP Data Intelligence 1909
Modeler
ABAP operators
• Pre-delivered operators
by SAP
ABAP Pipeline Engine • Custom operators
ABAP-based system SAP Data Hub 2.7 & SAP Data Intelligence 1909
Modeler
ABAP operators
• Pre-delivered operators
by SAP
ABAP Pipeline Engine • Custom operators
ABAP-based system SAP Data Hub 2.7 & SAP Data Intelligence 1909
ABAP Integration
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 18
ABAP Integration
Technical Concept - ABAP operator execution
Modeler
ABAP
Connection
via RFC
ABAP-based system SAP Data Hub 2.7 & SAP Data Intelligence 1909
Modeler
ABAP
Connection
via RFC
ABAP-based system SAP Data Hub 2.7 & SAP Data Intelligence 1909
Modeler
ABAP
Connection
via RFC
ABAP operators shell
ABAP-based system SAP Data Hub 2.7 & SAP Data Intelligence 1909
ABAP Integration
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 21
ABAP Integration
Technical Concept - Delivery and Releases
ABAP-based system
ABAP CDS Operator that supports initial load and delta ABAP CDS Views replication
READER replication of ABAP CDS views. is only available for SAP
S/4HANA 1909 and SAP
S/4HANA 1911 CE or higher
ABAP CDS is the semantically rich data model in SAP S/4 HANA and allows the
consistent representation of a business object like a Business Partner
SAP S/4HANA 1909 The ABAP CDS READER operator allows the
SAP S/4HANA CE 1911 replication of SAP ABAP CDS Views and customer
ABAP CDS views in initial load and delta mode.
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 25
DAT361
Demo
Consume ABAP CDS View and write it to a file storage
Custom ABAP Operator
Execute custom code and function modules
CUSTOM ABAP OPERATORS can be used to enhance the scope of a data-driven application. For example it is
necessary to execute a function module within a pipeline to read data into SAP Data Hub, post information into an ABAP-
based SAP system or trigger an execution in the remote system.
1 Execution of a pipeline
Execution of
2
ABAP code
ABAP Pipeline Engine SAP Data Hub 2.7 & SAP Data Intelligence 1909
Capabilities
SAP S/4HANA 1909
SAP Business Suite (NW 7.0+ and DMIS*) • Build customer operators to execute any kind of code
• ABAP code execution in remote system
• Exchange of data and results if required
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC * DMIS 2011 SP18 or DMIS 2018 SP2 27
DAT361
Demo
Execute an ABAP custom operator within a pipeline
Operators on the roadmap for Q4 2019 and 2020
ANY SUBGRAPH
TABLE BASED
REPLICATION
− Pool, cluster, INDX, HR tables Transformation Third-party DBs
− Unicode and non-Unicode Replication Server
− Replication of Views
− Support of NW 4.6c and higher SAP HANA
− Transformation and filter capabilities
SAP S/4HANA − Integrated data type mapping SAP Data Hub
− Scalable SAP NetWeaver instance
− Replication staging for HA/DR
SAP HANA − Option to load out of archives
− Support of LAN, WAN and cloud SAP Business Warehouse
APPLICATION BASED
Third-party DBs *** deployments
REPLICATION
SAP BW/4HANA
− SAP ASE, SAP MaxDB
− Oracle, MS SQL, SAP Data Services
− IBM DB2, DB4, DB6
SAP S/4HANA Finance
for central finance foundation
*For dedicated integration scenarios only (e.g. central finance subsidiary integration, tax declaration framework integration)
**Through cloud connector / via HaaS
*** For restrictions, check SAP note 1768805
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 32
SAP LT Replication Server & SAP Data Hub
Value Proposition
SAP Data Hub provides a broad spectrum of connectivity with a strong focus on heterogenous landscapes,
including Hadoop, Cloud Storages, Messaging Technologies, third-party databases, enterprise applications
and so on.
Third-party DBs
…
− SAP ASE, SAP MaxDB
− Oracle, MS SQL,
− IBM DB2, DB4, DB6
SAP LT Replication Server replicates data via SAP Data Hub into additional target systems, that aren’t
natively supported by SAP LT Replication Server.
The SLT CONNECTOR operator establishes a communication to the remote ABAP System and
consumes data (initial load and delta) via SAP LT Replication Server technology. This allows the
consumption of business data directly within a Data Hub pipeline to leverage a tight integration between
business data and big data.
Application Logging
tables tables Table
Replication
DB triggers
SAP S/4HANA 1909 SAP LT - Use SAP LT Replication Server as part of your
SAP Data Hub
Replication Server productive SAP S/4HANA system. The SLT
functionality is already included in the S/4HANA stack.
Demo
Replicate a table with the SLT connector operator
Q&A
Continue your SAP TechEd 2019 Learning Experience
Join the digital SAP TechEd Learning Room 2019 in SAP Learning Hub
Access replays Continue the conversation Check out the latest blogs
Keynotes Read and reply to blog posts See all SAP TechEd blog posts
Live interviews Ask questions Learn from peers and experts
Select lecture sessions Join discussions
http://sapteched.com/online sap.com/community SAP TechEd blog posts
Britta Thoelking
Product Manager
britta.thoelking@sap.com
Follow us
www.sap.com/contactsap
Las Vegas
September 24–27, 2019
Marc Hartz
Barcelona
October 8-10, 2019
Jens Rannacher
Bangalore
November 13-15, 2019
Lalitendu Samantray
The information in this presentation is confidential and proprietary to SAP and may not be disclosed without the permission o f SAP.
Except for your obligation to protect confidential information, this presentation is not subject to your license agreement or any other service
or subscription agreement with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or a ny related
document, or to develop or release any functionality mentioned therein.
This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms dir ections and
functionality are all subject to change and may be changed by SAP at any time for any reason without notice. The information in this
presentation is not a commitment, promise or legal obligation to deliver any material, code or functionality. This presentat ion is provided
without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a
particular purpose, or non-infringement. This presentation is for informational purposes and may not be incorporated into a contract. SAP
assumes no responsibility for errors or omissions in this presentation, except if such damages were caused by SAP’s intentional or gross
negligence.
All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ material ly from
expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, which speak only as of their dates,
and they should not be relied upon in making purchasing decisions.
Data Integration
▪ With SAP Applications
▪ With non-SAP Applications
▪ Leveraging SAP Cloud Platform
End-2-end Demo
Q&A
Unified data management to capture Best-in-class digital platform for new app
real-time value from different types of data development, extensions, and integration
Digital
Platform
Meta Data and lifecycle management
SAP Data Services
Smart data Integration Marketplace Collaboration Services
SAP CP Big Data Services Portal
SAP Data Hub SAP Cloud Platform
Data Cloud
Integration services Object Store (S3, Swift…) Mobile Services
Management Platform
UX Services
Next-generation data SAP HANA powers SAP Data Hub Platform for extending Delivering deep Marketplace for
management expands SAP applications as provides data the business processes data and process ecosystem to build
SAP HANA in-memory the foundation of orchestration and of the Intelligent Suite integrations new innovations
database to address high-performance metadata and enabling new through APIs and leveraging APIs and
structured and data warehousing management across innovations microservices business services
unstructured data and analytics heterogeneous data
use cases and sources
external data
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 8
SAP Data Hub – Unified Data Integration for the Intelligent Enterprise
BW Standard
SAP BW/4 HANA SAP BW Hadoop / HDFS
Integration Connectors
(open & native
protocols)
Data Governance REST APIs
SAP C/4HANA
Data Discovery / Data Profiling / Metadata Cataloging Databases
Cloud Data
Integration*
Public Clouds
… Data Orchestration & Monitoring
Connection Management / Workflows / Scheduling 3rd Party
3rd Party Applications
Connectors
Workflows
BW Process Data Services HANA
Chains Jobs Flowgraphs
SAP API
Data Pipelining & Processing Business Hub
SAP Analytics Cloud SAC Push API
Data ingestion / Data Processing / Data Enrichment SAP Cloud SCI for process
Platform integration
Connectors
SAP HANA
SAP Open
(on-premise, cloud, multi cloud) Integration
Connectors
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC *This is the current state of planning and may be changed by SAP at any time without notice. 9
SAP Data Hub
Capabilities Overview
SAP Data Hub Capabilities: Data Governance
BW Standard
SAP BW/4 HANA SAP BW Hadoop / HDFS
Integration Connectors
(open & native
protocols)
Data Governance REST APIs
SAP C/4HANA
Data Discovery / Data Profiling / Metadata Cataloging Databases
Cloud Data
Integration*
Public Clouds
… Data Orchestration & Monitoring
Connection Management / Workflows / Scheduling 3rd Party
3rd Party Applications
Connectors
Workflows
BW Process Data Services HANA
Chains Jobs Flowgraphs
SAP API
Data Pipelining & Processing Business Hub
SAP Analytics Cloud SAC Push API
Data ingestion / Data Processing / Data Enrichment SAP Cloud SCI for process
Platform integration
Connectors
SAP HANA
SAP Open
(on-premise, cloud, multi cloud) Integration
Connectors
Capabilities
▪ Prepare the data based on a sample dataset
▪ Transform, shape, harmonize, curate, enrich the
data via simple click actions
▪ View, present and report the outcome immediately
▪ Apply the transformations to the full dataset at any
time
Main Use Cases
▪ End-to-end self-service data preparation
▪ Improve data quality to achieve data excellence
▪ Create new data sets based for scenario and
new or adjusted
delete combine
data set project requirements
BW Standard
SAP BW/4 HANA SAP BW Hadoop / HDFS
Integration Connectors
(open & native
protocols)
Data Governance REST APIs
SAP C/4HANA
Data Discovery / Data Profiling / Metadata Cataloging Databases
Cloud Data
Integration*
Public Clouds
… Data Orchestration & Monitoring
Connection Management / Workflows / Scheduling 3rd Party
3rd Party Applications
Connectors
Workflows
BW Process Data Services HANA
Chains Jobs Flowgraphs
SAP API
Data Pipelining & Processing Business Hub
SAP Analytics Cloud SAC Push API
Data ingestion / Data Processing / Data Enrichment SAP Cloud SCI for process
Platform integration
Connectors
SAP HANA
SAP Open
(on-premise, cloud, multi cloud) Integration
Connectors
BW Standard
SAP BW/4 HANA SAP BW Hadoop / HDFS
Integration Connectors
(open & native
protocols)
Data Governance REST APIs
SAP C/4HANA
Data Discovery / Data Profiling / Metadata Cataloging Databases
Cloud Data
Integration*
Public Clouds
… Data Orchestration & Monitoring
Connection Management / Workflows / Scheduling 3rd Party
3rd Party Applications
Connectors
Workflows
BW Process Data Services HANA
Chains Jobs Flowgraphs
SAP API
Data Pipelining & Processing Business Hub
SAP Analytics Cloud SAC Push API
Data ingestion / Data Processing / Data Enrichment SAP Cloud SCI for process
Platform integration
Connectors
SAP HANA
SAP Open
(on-premise, cloud, multi cloud) Integration
Connectors
BW Standard
SAP BW/4 HANA SAP BW Hadoop / HDFS
Integration Connectors
(open & native
protocols)
Data Governance REST APIs
SAP C/4HANA
Data Discovery / Data Profiling / Metadata Cataloging Databases
Cloud Data
Integration*
Public Clouds
… Data Orchestration & Monitoring
Connection Management / Workflows / Scheduling 3rd Party
3rd Party Applications
Connectors
Workflows
BW Process Data Services HANA
Chains Jobs Flowgraphs
SAP API
Data Pipelining & Processing Business Hub
SAP Analytics Cloud SAC Push API
Data ingestion / Data Processing / Data Enrichment SAP Cloud SCI for process
Platform integration
Connectors
SAP HANA
SAP Open
(on-premise, cloud, multi cloud) Integration
Connectors
One model to consolidate all interaction scenarios between SAP Data Hub
and an ABAP-based SAP systems directional and bi-directional
Capabilities
SAP S/4HANA
Provide ABAP METADATA to the
SAP Data Hub Metadata Explorer
SAP S/4HANA Cloud
ABAP CDS Operator that supports initial load and delta ABAP CDS Views are only
READER replication of ABAP CDS views. available in SAP S/4HANA
ABAP CDS is the semantically rich data model in SAP S/4 HANA and allows the
consistent representation of a business object like a Business Partner
SAP S/4HANA 1909 The ABAP CDS READER operator allows the
SAP S/4HANA CE 1911 replication of SAP ABAP CDS Views and customer
ABAP CDS views in initial load and delta mode.
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 25
Integration with SAP Cloud solutions
One SAP Cloud Data Integration (CDI) for integration into all SAP Cloud solutions
SAP C/4HANA:
- SAP Marketing Cloud … SAP Cloud Data Integration (CDI) is a
- SAP Service Cloud core concept for integrating all SAP solutions in the
cloud using ONE API based on open standards
Available Today Planned for Q3/Q4 2019 Planned >= 2020
Example Cloud Data Integration scenario with SAP Fieldglass & SAP Data Hub
Typical Scenarios:
▪ Load Data from Data Lake into BW
▪ Data Tiering from BW into Data Lake
Smart Data
Access
VORA
Ingestor
Files
VORA
Client
BW Standard
SAP BW/4 HANA SAP BW Hadoop / HDFS
Integration Connectors
(open & native
protocols)
Data Governance REST APIs
SAP C/4HANA
Data Discovery / Data Profiling / Metadata Cataloging Databases
Cloud Data
Integration*
Public Clouds
… Data Orchestration & Monitoring
Connection Management / Workflows / Scheduling 3rd Party
3rd Party Applications
Connectors
Workflows
BW Process Data Services HANA
Chains Jobs Flowgraphs
SAP API
Data Pipelining & Processing Business Hub
SAP Analytics Cloud SAC Push API
Data ingestion / Data Processing / Data Enrichment SAP Cloud SCI for process
Platform integration
Connectors
SAP HANA
SAP Open
(on-premise, cloud, multi cloud) Integration
Connectors
SAP Vora:
Data Quality:
Scripting Operators:
▪ Write and run custom scripts for data manipulation within a pipeline
Subengines:
▪ Build re-usable operators in different programming languages
▪ Develop and compile new operators locally using SDK
▪ Register and run custom operators in available pipeline subengine
*
*This is the current state of planning and may be changed by SAP at any time without notice.
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 33
SAP Data Hub: Extensibility for 3rd Party Connectivity
BW Standard
SAP BW/4 HANA SAP BW Hadoop / HDFS
Integration Connectors
(open & native
protocols)
Data Governance REST APIs
SAP C/4HANA
Data Discovery / Data Profiling / Metadata Cataloging Databases
Cloud Data
Integration*
Public Clouds
… Data Orchestration & Monitoring
Connection Management / Workflows / Scheduling 3rd Party
3rd Party Applications
Connectors
Workflows
BW Process Data Services HANA
Chains Jobs Flowgraphs
SAP API
Data Pipelining & Processing Business Hub
SAP Analytics Cloud SAC Push API
Data ingestion / Data Processing / Data Enrichment SAP Cloud SCI for process
Platform integration
Connectors
SAP HANA
SAP Open
(on-premise, cloud, multi cloud) Integration
Connectors
Connected
Systems
SAP
Applications
Tenant Applications managed by System Management SAP Vora
Engines
3rd party Pipeline Modeler Metadata Explorer Embedded System Application SAP Cloud
Docker Relational Applications
Images (API-driven)
Custom Built-in Metadata Profiling /
Operators Connectors
Database Tools
Catalog Discovery
Export Import
vSolution
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
Archive
35
Connecting data sources with SAP Data Hub
Three ways of connecting systems, engines and repositories
Available in the SAP Data Hub launchpad, Additional systems can be accessed within Custom operators can be created based on
these are the richest and most integrated the pipeline modeler via specific operators, SAP provided base operators like JavaScript,
connectors, providing metadata and e.g. Kafka. Python, Spark, RestAPI, etc. Those are very
governance services, profiling, source powerful, and allow integration with a wide
crawlers, etc.
• All currently supported standard range of systems, applications, and data
• Includes connectors to ETL tools like operators can be found here. stores. They require an engineering skillset.
SAP Data Services and SAP HANA
SDI, where SAP Data Hub leverages • How to build custom operators is
brokered connections through an described in this blog series.
intermediary, allowing connection with
many additional systems.
▪ SAP internal Lead-to-Cash Scenario: Understand internal process inefficiencies all the way from demand
management to maintaining a deal through process mining in Celonis leveraging SAP Data Hub
▪ Involved Steps
1. Collect purchase related activities in ERP system (SAP S/4HANA)
2. Anonymize personal data, transform activities into required event log structure to do process mining and
upload event log to Celonis Intelligent Business Cloud (SAP Data Hub + 3rd Party Adapter from Celonis)
3. Run Process Mining (Celonis Intelligent Business Cloud)
1 2 3
Data Pipeline
ERP Data Celonis
Data Upload
Ingestion Intelligent
CRM
Business
BW Cloud
Data Hub‘s Extensibility Options Data Hub Content Delivery SAP Data Hub Content Marketplace:
Partners and customers can add own ▪ Custom Data Hub Content can be ▪ Planned Marketplace and Delivery
content based on different layers: packed into a SAP Data Hub channel for SAP Data Hub Partner
▪ Pipelines Templates: Solution Archive Content via SAP API Business Hub
– Parameterizable scenario templates ▪ SAP Data Hub Solutions can be in combination with SAP App Center
– (Sub)graphs called in other graphs defined, exported and imported via for monetization
▪ Operators: – SAP Data Hub System Management UI
A win-win partnership:
– Extend pre-defined base operators using – vCTL Command Line Tool*
powerful runtimes, e.g. Python, Go, ▪ Partners can reach more customers
▪ SAP Data Hub Solution Structure:
Javascript, and R with their services, while SAP Datahub
– Develop new operators with own Hub expands its reach with relevant
runtimes, e.g. Process Executor content
▪ Dockerfiles: ▪ Our partners understand the customer
– Provide execution environments for use cases and can better support with
operators domain-specific content by
– Incorporate 3rd party libraries and generalizing the specific issue with a
executables broad solution
SAP API Business Hub: Search, discover and consume content packages with pre-packaged
integrations and sample applications from SAP and partners
BW Standard
SAP BW/4 HANA SAP BW Hadoop / HDFS
Integration Connectors
(open & native
protocols)
Data Governance REST APIs
SAP C/4HANA
Data Discovery / Data Profiling / Metadata Cataloging Databases
Cloud Data
Integration*
Public Clouds
… Data Orchestration & Monitoring
Connection Management / Workflows / Scheduling 3rd Party
3rd Party Applications
Connectors
Workflows
BW Process Data Services HANA
Chains Jobs Flowgraphs
SAP API
Data Pipelining & Processing Business Hub
SAP Analytics Cloud SAC Push API
Data ingestion / Data Processing / Data Enrichment SAP Cloud SCI for process
Platform integration
Connectors
SAP HANA
SAP Open
(on-premise, cloud, multi cloud) Integration
Connectors
Capabilities
process an image file
Pre-defined operator for triggering iFlows (boarding pass)
Access replays Continue the conversation Check out the latest blogs
▪ Keynotes ▪ Read and reply to blog posts ▪ See all SAP TechEd blog posts
▪ Live interviews ▪ Ask questions ▪ Learn from peers and experts
▪ Select lecture sessions ▪ Join discussions
http://sapteched.com/online sap.com/community SAP TechEd blog posts
www.sap.com/contactsap
DAT206
PUBLIC
Speakers
Las Vegas
September 24–27, 2019
Jason Hinsperger
Barcelona
October 8-10, 2019
Dominique Noth
Bangalore
November 13-15, 2019
Immanuel Vasanth
The information in this presentation is confidential and proprietary to SAP and may not be disclosed without the permission of SAP.
Except for your obligation to protect confidential information, this presentation is not subject to your license agreement or any other service
or subscription agreement with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or any related
document, or to develop or release any functionality mentioned therein.
This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms directions and
functionality are all subject to change and may be changed by SAP at any time for any reason without notice. The information in this
presentation is not a commitment, promise or legal obligation to deliver any material, code or functionality. This presentation is provided
without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a
particular purpose, or non-infringement. This presentation is for informational purposes and may not be incorporated into a contract. SAP
assumes no responsibility for errors or omissions in this presentation, except if such damages were caused by SAP’s intentional or gross
negligence.
All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ materially from
expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, which speak only as of their dates,
and they should not be relied upon in making purchasing decisions.
Reality
Strategy
Large Data with Different Formats
Complex Infrastructures
Data Compliance
On-Premises
Enterprise Data Center Web Application How to setup ?
Public Cloud Provider A How to connect ?
Performance ?
Secure access ?
Database
TECHNOLOGIES
SAP Analytics Cloud SAP Data Warehouse Cloud SAP HANA Cloud
Analytics technology – business End-to-end data warehouse in the cloud Next-gen database Platform as-a-Service
intelligence (BI), planning, and predictive that combines data management with full capabilities to manage OLTP,
analytics – in a single solution processes with advanced analytics OLAP and HTAP workloads
Leverage benefits of the cloud — high - Open to all applications, SAP, custom and
availability, elasticity, and low total cost of 3rd parties and data types including
ownership — by deploying as a stand- spatial, graph, or document with standard
alone solution or hybrid, as an extension SQL access.
to an existing on-premise environment.
Unlimited Trusted
Single source of truth for all data, Provides your business users
transactional and analytical, tools that ensure the data
structured and unstructured, they’re working with is
across on premise and cloud. actionable.
Simple Open
Manage data however you like to General purpose data
control costs and according to management platform for SAP,
your performance needs. non-SAP, third-party, and custom
applications.
Application Application
• Manage users
• Manage catalog/content Data Layer Data Layer
• Select OS
• Configure OS OS Managed
• Update OS service
XSA S/4HANA
SCP Cockpit IoT SAP Leonardo ML
App Integration
HC Service
Broker Cloud Foundry
HDI
SCP backing service SCP backing service
SAP HANA Cloud K8s
Infrastructure * *
* planned
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 14
Hana Cloud Multi-Cloud and Hybrid Deployment
AWS / Azure / GCP / Alibaba Customer on-premise
• S/4 Hana
• ECC on DB2
Cloud Storage • Oracle
• Hadoop
Migration • Custom applications
Reporting
Data Lake HANA Cloud HSR Azure
Table Replication
• Hana Cloud
• SQL Azure DB
• ADLS …
Google Cloud
• Big Query
• GCS …
• Easy Setup
• Single View
• Real-time Data
• No Data Move, No Replication
• Secure Access
• Low TCO
Query Optimization
Cost-based optimization, e.g. filter / function pushdown, semi-join reduction, join relocation, histogram statistics
Caching (remote cache, local cache)
Seamless toggle between Federation and Replication
Virtual Table
Like HANA local column-store table, but references to remote table or view (no local persistence)
Integrated in HANA Modeling (Graphical Modeler, SQL)
Rapid Development/Deployment
Native integration with other HANA instances (HANA Cloud or HANA on-prem)
Optimized connectivity and data transfer (exchange of binary data containers)
Optimized and faster query processing (distributed query processing over federated query processing)
Optimized push-down of functions and filters
Efficient access to all SAP and non-SAP data from a common entry point
Access replays Continue the conversation Check out the latest blogs
Keynotes Read and reply to blog posts See all SAP TechEd blog posts
Live interviews Ask questions Learn from peers and experts
Select lecture sessions Join discussions
http://sapteched.com/online sap.com/community SAP TechEd blog posts
www.sap.com/contactsap
DAT209
PUBLIC
Speakers
Las Vegas
September 24–27, 2019
Matt Zenus
Barcelona
October 8-10, 2019
Ruediger Karl
Bangalore
November 13-15, 2019
The information in this presentation is confidential and proprietary to SAP and may not be disclosed without the permission of SAP.
Except for your obligation to protect confidential information, this presentation is not subject to your license agreement or any other service
or subscription agreement with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or any related
document, or to develop or release any functionality mentioned therein.
This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms directions and
functionality are all subject to change and may be changed by SAP at any time for any reason without notice. The information in this
presentation is not a commitment, promise or legal obligation to deliver any material, code or functionality. This presentation is provided
without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a
particular purpose, or non-infringement. This presentation is for informational purposes and may not be incorporated into a contract. SAP
assumes no responsibility for errors or omissions in this presentation, except if such damages were caused by SAP’s intentional or gross
negligence.
All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ materially from
expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, which speak only as of their dates,
and they should not be relied upon in making purchasing decisions.
What’s Next
Source: IDC Data Age 2025 Source: IDC Data Age 2025 Source: IDC, Worldwide Spending on Cloud IT Infrastructure
Reality
Strategy
Large Data with Different Formats
Complex Infrastructures
Data Compliance
TECHNOLOGIES
SAP Analytics Cloud SAP Data Warehouse Cloud SAP HANA Cloud
Analytics technology – business End-to-end data warehouse in the cloud Next-gen database Platform as-a-Service
intelligence (BI), planning, and predictive that combines data management with full capabilities to manage OLTP,
analytics – in a single solution processes with advanced analytics OLAP and HTAP workloads
Unlimited Trusted
Single source of truth for all data, Provides your business users
transactional and analytical, tools that ensure the data
structured and unstructured, they’re working with is
across on premise and cloud. actionable.
Simple Open
Manage data however you like to General purpose data
control costs and according to management platform for SAP,
your performance needs. non-SAP, third-party, and custom
applications.
• Built-In Data Lake, Easy to Manage • Fast Data Access and Query Processing
• Scalable and Centralized Data Store • Secure
• Improve insights with enhanced 3rd-party data • Low TCO
Virtualization
Replication Virtual Tables
Access replays Continue the conversation Check out the latest blogs
Keynotes Read and reply to blog posts See all SAP TechEd blog posts
Live interviews Ask questions Learn from peers and experts
Select lecture sessions Join discussions
http://sapteched.com/online sap.com/community SAP TechEd blog posts
www.sap.com/contactsap
Las Vegas
September 24–27, 2019
Marc Hartz
Barcelona
October 8-10, 2019
Marc Hartz
Bangalore
November 13-15, 2019
Lalitendu Samantray
The information in this presentation is confidential and proprietary to SAP and may not be disclosed without the permission o f SAP.
Except for your obligation to protect confidential information, this presentation is not subject to your license agreement or any other service
or subscription agreement with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or a ny related
document, or to develop or release any functionality mentioned therein.
This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms dir ections and
functionality are all subject to change and may be changed by SAP at any time for any reason without notice. The information in this
presentation is not a commitment, promise or legal obligation to deliver any material, code or functionality. This presentat ion is provided
without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a
particular purpose, or non-infringement. This presentation is for informational purposes and may not be incorporated into a contract. SAP
assumes no responsibility for errors or omissions in this presentation, except if such damages were caused by SAP’s intentional or gross
negligence.
All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ material ly from
expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, which speak only as of their dates,
and they should not be relied upon in making purchasing decisions.
ML Scenario Management
Enterprise Applications
Operationalize and maintain
intelligent enterprise applications to
assist in solving enterprise
challenges in a sustainable way
Intelligent Technologies
Enterprise Apps BI and Artificial Metadata
Harness intelligent technologies Business Cloud Apps
ERP, CRM, HR Visualization Intelligence Management
to create and enrich enterprise
applications IT
Data Management
Take care of
• different data types
• data governance
• data integration
• orchestration of data
processing
Create data pipelines to leverage Harness the advanced machine learning Manage metadata across a
your data projects and orchestrate content to accelerate and scale and diverse data landscape and
the data integration processes automate your Data Science projects create a metadata repository
Access & Govern & Prepare & Build scalable Deploy & integrate Monitor &
connect data discover data manage data & flexible data intelligent orchestrate
processes scenarios the lifecycle
SAP HANA
Metadata
Data
Access
SAP S/4HANA
Pipeline Data
Preparation API Access
Management Governance Modeling Workflows
& Labeling
SAP BW/4HANA
Pipelines
3rd Party
SAP ABAP Messaging / Cloud Data ML Custom
Connectors
Databases
Integration Streaming Integration Operators Code
Please always check the Product Availability Matrix for the latest information about
supported OS, Kubernetes versions, certified partners, and any other restrictions.
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 11
SAP Data Intelligence
Data Integration & Processing
SAP Data Intelligence
End to End Data Integration and Processing
BW Standard
SAP BW/4 HANA SAP BW Hadoop / HDFS
Integration Exploration Model Design ML Deployment Connectors
(open & native
Identify / Data Creation / Training / Automate / Scale / protocols)
preprocessing Validation Serve REST APIs
3rd Party
3rd Party Applications
Connectors
BW Process Data Services HANA
Workflows
Data Orchestration & Monitoring
Chains Jobs Flowgraphs
SAP API
Connection Management / Workflows / Scheduling Business Hub
SAP Analytics Cloud SAC Push API
SAP Cloud SCI for process
Platform integration
SAP HANA
Data Pipelining & Processing Connectors
SAP Open
(on-premise, cloud, multi cloud) Integration Data ingestion / Data Processing / Data Enrichment Connectors
Scalable
▪ Distributed
▪ Containerized
Production-Ready
▪ Manage
▪ Schedule (stream, time, interval)
Parse the file
▪ Observe and perform
sentiment
Re-Usability analysis
SAP Vora:
…
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 15
Integration with ABAP-based SAP Systems
One model to consolidate all interaction scenarios between SAP Data Hub
and an ABAP-based SAP systems directional and bi-directional
Capabilities
Integration requires certain system level, planned at least SAP S/4HANA 1909, SAP S/4HANA cloud 1908, SAP NetWeaver 7.00
with DMIS 2011/2018 Q4/2019 version. Certain functionality can only be made available for certain release levels.
Typical Scenarios:
▪ Load Data from Data Lake into BW
▪ Data Tiering from BW into Data Lake
▪ SAP internal Lead-to-Cash Scenario: Understand internal process inefficiencies all the way from demand
management to maintaining a deal through process mining in Celonis leveraging SAP Data Hub
▪ Involved Steps
1. Collect purchase related activities in ERP system (SAP S/4HANA)
2. Anonymize personal data, transform activities into required event log structure to do process mining and
upload event log to Celonis Cloud (SAP Data Hub + 3rd Party Adapter from Celonis)
3. Run Process Mining (Celonis Cloud)
1 2 3
Data Pipeline
Data Celonis
Data Upload
Ingestion Intelligent
Business
Cloud
Benefits:
▪ Use a unified metadata catalog to gain visibility about Open
Metadata catalog APIs
landscape wide data assets
▪ Easily govern and manage metadata assets across
enterprise system disparate the source
▪ Discover, understand, and consume information about data Collaborative
with the ability to synchronize, share, and perform version Metadata crawlers Manual definition definition/
lineage and impact analysis workflows
Providing metadata of ABAP-based SAP systems in SAP Data Hub Metadata Explorer
Capabilities
Receive metadata information of tables, Views, CDS Views
and custom CDS views (depending on source system)
Covering of standard metadata functions like to browse,
preview, publish and catalogue relevant metadata information
Communication can be established via RFC or HTTP, but with
different functional coverage ➔ check note SAP Note
2731192
Understanding metadata of
ABAP-based SAP systems
Integration requires certain system level, planned at least SAP S/4HANA 1909, SAP S/4HANA cloud 1908, SAP NetWeaver 7.00
with DMIS 2011/2018 Q4/2019 version. Certain functionality can only be made available for certain release levels.
Capabilities
• Access a dataset to prepare the data based on a sample dataset
• Transform, shape, harmonize, curate, enrich the data by a simple click
Profile, assess, transform, shape, and enrich the data
View, present and report the outcome immediately
new or adjusted
delete combine
data set
Capabilities
SAP BW: Info Providers, BW transformations and BW
Queries
SAP HANA: SQL views, Column views, Hierarchies,
Synonyms
SAP VORA: Views and Datasource tables
Data Pipeline operators:
o Storage operators
o HANA & VORA operators
o Flowagent operators
o SQL statements in HANA/VORA operators (2.7)
o New File operators (2.7)
Capabilities
Tied with the connectivity and discovery from Metadata explorer
Rules Dashboards for metrics and monitoring
AND/OR condition builder for complex conditions
Roadmap to tie in with data preparations
Pipeline operators extend to streaming and IoT data as well.
Get better insights on privacy related data by using high level anonymization operator
Capabilities
Basic and high level anonymization in one operator
Create a k-anonymization group and run i-diversity to ensure
additional anonymity
Details to k-anonymization and i-diversity
Capabilities
Connect profiling to publish rating of the dataset
in Metadata explorer
A simple way to add comments to enable
business context
Search & Connection Data Data Model Integration into Automation &
Model Model Model
Browse /Storage Preparation Processing Validation Application Maintenance
Training Deployment
Data Management Creation
Recent innovations 2019 – Planned innovations1 2020 – Product direction1 2021 – Product vision1
ML & Data Science Tooling ML & Data Science Tooling ML & Data Science Tooling Enable the intelligent enterprise
• End-2-end data delivery to ML model creation, • Auto ML on structured data & texts • Automated labeling & annotations of data assets • Enable data-driven and completely automated
training, consumption including holistic lifecycle • Enhanced multi-tenancy capabilities including intelligent enterprise applications
• Embedding SAP Machine Learning
• Jupyter Notebook integration out of the box Foundation Services (e.g. OCR, translation..) metering • Support new application paradigms
Data Pipelining • Versioning & management of data sets • Operations Dashboard to monitor productive • Enabling a simple, holistic data management view
• Data transfer SAP BW/4 & SAP HANA • Integration of Jupyter Notebook with execution
Connection Management etc. Metadata Governance Evolution of enterprise information management
• Predefined anonymization, data masking &
data quality operations Metadata Governance • Information policy management compliance • Unify existing capabilities
• SQL processing of streaming data • Hierarchical tagging mechanism dashboard • Simplify data integration portfolio
• Local file Uploads into Data Catalog • Terms & Glossary with an integration to • Comprehensive landscape management
Metadata Governance
SAP Information Steward
• Embedded data preparation capabilities • Enhancement of Rules (data types, operations)
• Self-learning metadata management End-to-end business application and processes
• Business rules including Data Quality KPIs Data Pipelining •
• Semantical data extraction for SAP systems Delivery of applications for business scenarios and
• Visual data lineage for catalog objects • Templates to speed up pipeline modeling (e.g. SAP S/4HANA, SAP ECC) industry use cases
Application Integration and Content • Content marketplace scenarios for SAP Data Pipelining
S/4HANA, SAP C/4HANA as well as IoT •
• Replication of SAP S/4HANA data Suggest complementary dataset to the ones
• Delta data transfer for SAP BW (via ODP) currently considered by users
• Unified API for integration with SAP cloud
solutions (e.g. Fieldglass, Concur), • Replication for SAP S4/HANA and ECC • Proactive tuning and self-correcting
• Integration with SAP CP-CPI Deployment & Connectivity Application Integration and Content
Deployment • On-premise deployment incl. core ML services • Expand native connectivity driven by market
• Offered as service in SAP Cloud Platform • Availability on Azure and Alicloud • Provide templates & pre-defined/extendable
with consumption-based pricing • Connectivity to on-premise Data Center content for on-premise and cloud Industry
• Including all SAP Data Hub functionalities models and applications
• Security enhancements & fine grained policies
• Predefined partner content delivery
• Management of API endpoints
1. This is the current state of planning and may be changed by SAP at any time without notice.
© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 32
Continue your SAP TechEd 2019 Learning Experience
Join the digital SAP TechEd Learning Room 2019 in SAP Learning Hub
Access replays Continue the conversation Check out the latest blogs
▪ Keynotes ▪ Read and reply to blog posts ▪ See all SAP TechEd blog posts
▪ Live interviews ▪ Ask questions ▪ Learn from peers and experts
▪ Select lecture sessions ▪ Join discussions
http://sapteched.com/online sap.com/community SAP TechEd blog posts
Related SAP TechEd Learning Journeys: Next-Gen Data Management and Artificial Intelligence
▪ DAT1: Scale Artificial Intelligence
▪ DAT3: Tame data challenges
www.sap.com/contactsap