Roadmap SaP BI

SAP NetWeaver 7.
0 Business Intelligence
Warehouse Management
Rainer Uhle NW PM, SAP AG T.A.Cook Conferences, Birmingham 2007
Disclaimer
This presentation on EDW status & roadmap is a preliminary version and not subject to your license agreement or any other agreement with SAP. This document contains intended strategies, developments, and functionalities of the SAP product and is not intended to be binding upon SAP to any particular course of business, product strategy, and/or development. Please note that this document is subject to change and may be changed by SAP at any time without notice. SAP assumes no responsibility for errors or omissions in this document.
SAP AG 2007, NetWeaver 7.0 BI EDW, R. Uhle 2
Bill Inmons: Enterprise Data Warehousing Concept

Departmental Data Marts
Acctg Finance Marketing Sales
DSS Applications
ERP ERP ERP CRM
ETL Changed Data Staging Area
eComm.
EDW
Global ODS local ODS
Oper. Mart
Bus. Int.
ERP Corporate Applications
Exploration warehouse/ data mining
Granularity Manager
Cross media Storage Management

Nearline Storage Archives
Session Analysis Dialogue Manager Cookie Cognition Preformatted dialogues Web Logs
Internet
Source:Bill Inmon
SAP NW 7.0 BI Architecture: Platform & Data Warehouse

Business Explorer Suite (BEx) BIA Engine (based on TREX) Analytic Engine
Aggregation
Meta Data Repository / Documents
Caching Calculation Planning Services
Data Warehouse
Master Data Operational Data Store (volatile) Architected Data Marts Data Warehouse Layer (historical)
Open Hub Service NLS Service
NLS Engine
DataSource PSA
Data Acquisition
Monitoring / Administration
Analysis Process Design
Planning Functions and Sequences
Data Flow Control / Process Chains
13,000 Customer Installations
Across 25+ industries, from small to very large
Enterprise Business Intelligence
Business Intelligence Accelerator
Business Planning
Main Investments with SAP NetWeaver 7.0 (2004s) BI WHM

Complete ETL approach
Classic ETL
Lean data flow concept Improved Load Performance
30% more throughput Zero latency every minute
Real-time Data Warehousing

Direct Access Real-time Data Accquisition
My last years presentation
Visionary Concepts for high performance and large data volumes

BI Accelerator (BIA)
A new transparent approach based on TREX to boost BI query performance
Nearline Storage (NLS) Interface
20 to 100 times faster
Storage Management Optimization using NLS technologies based on column based indexing, grid computing and in memory processing High compression rates
90 % compression
Engaged Administration and Monitoring strategy

BI Administrator Cockpit
Central Point of Truth for administration needs
360 overview
SAP NW 7.0 BI - Status and Outlook

Complete ETL approach, Persistency Layer Optimization
(New data flow concept, RDA, Direct Access, Write optimized DSO) Status
Migration Aspects
Outlook
Hierarchy Framework (Transformation Integration and Segmented DataSources) Semantic Partitioning
Visionary Concepts for high performance and large data volumes (BI Accelerator (BIA), Nearline Storage (NLS) Interface) Status
Partners, Customers, Success Stories BIA/NLS Positioning NLS Limitations
Outlook
Hybrid Providers Growing transparency for NLS features
Information Quality Management

(BI/MDM Integration) Status
Enhance existing BI Master Data
Where are we today and where do we want to be with the next release
Outlook
More Integration Scenarios

Migration Aspects
Outlook
Outlook

Outlook
Status: ETL Aspects Data Flow Concept SAP Netweaver BI

Process Chain
DTP TR
InfoSource
TR TR DataStore Object 3
Process Chain
DTP
DTP
TR DataStore Object 1
TR DataStore Object 2
DTP
DTP
TR DataSource (PSA) DataSource (PSA)
TR DataSource (PSA) DataSource (PSA)
DTP
IP
IP
Source System 1
Source System 2
Status: Lean data flow concept - Cornerstones

Query
BI
InfoProvider VirtualProvider Remote Characteristic
Data Transfer Process TRANSFORMATION
Graphical Transformation Formular editor Start/End/Expert Routines
Processing Mode: Extraction Direct access Real-Time Data Package Process Options: Error handling, Simulation Delta handling Scheduling: Process Chain/RDA Daemon manually
DataSource DataSource
Adapter Type: File Database Table (ODBC, JDBC) Service API / RDA WebService (Push)
any source
Status: Direct Access - Transactional Data

Query
BI
VirtualProvider
DataTransfer Process for Direct Access
TRANSFORMATION
DataSource DataSource for direct access for direct access
SourceSystem
Status: Direct Access including remote Master Data

Query Remote Characteristic as InfoProvider
BI
VirtualProvider
TR
DTP for Direct Access
InfoSource
TR TR DataSource DataSource (direct access) (direct access) TR
DTP for Direct Access
DataSource DataSource (direct access) (direct access)
Source System
Transactional Data
Master Data
Status: Real-time Data Acquisition (RDA) Daemon Concept
SAP NetWeaver Business Intelligence Architected Data Marts Operational Data Store DataStore Objects Daemon Pull ~ 1/min
Scheduled Data Transfer Process
Data Warehouse Layer

Scheduled Data Transfer Process
DataTransfer Process for Real-time Data Acquisition
PSA DataSource
InfoPackage for RDA
InfoPackage for RDA
Web Service Push External System
Delta Queue Service API
Real-time Update
Application
SAP Source System

Status: Data Flow Migration - DataSources
Migration Tools 3.x 7.0 DataSource 3.x 7.0 InfoSource Transfer Rule Transformation
Status: Data Flow Migration - Transfer Rules
Status: Data Flow Migration - Documentation
SAP NW TOM: http://help.sap.com/saphelp_nw04s/helpdata/en/43/f9d041d6392ae3e10000000a422035/frameset.htm

Outlook: Hierarchy Framework Segmented DataSources
Outlook: Hierarchy Framework Complex Transformations
Flexibility during Transformation Expert routines available in Transformations Subtree Handling Remote Handling for Hierarchies
Enhancing BI Data Quality with SAP NetWeaver MDM
Status: Layer Architecture - Write Optimized DataStore Object
Data Modeling for Enterprise Data Warehousing (EDW)

Enhanced DataStore objects (formerly: ODS objects)
Improved performance and flexibility
Performance optimization of activation process New DataStore type: Writeoptimized DataStore (without change log, no activation, partitioned using request ID)
Example for write-optimized DataStore object:

Staging of large volumes of document data with unique key into fast inbound layer
Data can be directly written into the DataStore without activation The request information enables further processing/update of the data Missing change log does not allow delta determination of multiple records with the same key
Outlook: Semantic Partitioning Metadata Concept
Business Case: Semantic Partitioning per timezone Mass data readiness
InfoSource
Generated by Generated by LPO

Semantic Partitioning Object
Partition1
Partition2
Partition3
Overflow Partition
Master object
Simple (and identical ) 1:1 Transformations
InfoSource
Master Transformation
APA EMEA
InfoSource
AMERICAS
Manual Creation
InfoSource Source 1 InfoSource Source 2
Source
Source

Migration Aspects
Outlook
Outlook

Outlook
New Paradigms in Data Wareouse DBMSs
New Providers with offerings in direction: vertical / column vectored DBMS strong compression ratio in memory processing grid computing
Magic Quadrant for Data Warehouse Database Management Systems, 2006

Source: Gartner (September 2006)
Status - Near-line Storage vs. BI Accelerator

BI
InfoCube
NLS
alternative storage types with direct access capabilities for reporting and loading extraction of non-frequently used, read-only InfoProvider data partitions extracted partitions are deleted in RDBMS NLS storage and Online Storage together consistently reflect the BI data persistency of an InfoProvider NLS data is read-only NLS partitioned portions of an InfoProvider Offline Archive are write-protected
BIA BIA
Indexing Staging
Archiving
NLS
Replication of the BI Star Schema including master data RDBMS DB volume not affected Roll-Up and Change Run possible after data loads optimized for fast BI Query access
Access - very frequently

frequently
not frequently
rarely
The Near-Line Storage Solution for SAP NetWeaver BI

Separation of frequently used data and rarely used data using Data Archiving Processes (DAP) Data Archiving Processes guarantee data consistency over DBMS and file system boundaries using
automatic deletes write protection for removed areas in InfoCubes and DataStore Objects Reload option
NLS support for InfoCubes and DataStore Objects

NLS Partions of an InfoCube are not accessible in an MultiProvider scenario (available with the next 7.x release) NLS not supported for write optimized DataStore Objects (available with 7.0 SP)
Transparent access to NLS data for

Queries Data Transfer Processes, DAP Restore
Open interface for partner solutions
Present development partners

(in the sequence of certification)
Certified for SAP NW 7.0
SAND Technology Dynamic Nearline Access PBS Software CBW FileTek StorHouse
yes yes yes
Near-line Storage: Reporting Aspects

Business Explorer Suite (BEx) Transparent Access
No Access
BI
Adjoint InfoProvider InfoProvider
BIA Engine
NearlineProvider
NLS Engine Offline Archive
RDBMS
Near-line Storage: Dataflow Aspects
BI BIA Engine
Data Mart
separate DTP for NLS data necessary
Indexing NLS Engine

EDW
DTP
DAP DTP
PSA
flexible for structural changes Archive and delete in a consistent way write protection for removed areas in InfoProviders simplified reload option for entire request
SAP BI is the proprietary owner of the NLS data (Data Distribution only via Open Hub) Sources
Outlook: NLS Interface Open Issues NW 7.0 Write optimized DSO (7.0 SP 16) Partition Locking for InfoCubes and Write opt. DSO (7.0 SP 16) Transparent DTP handling for NLS partitions (7.0 SPnn / 7.x) Complete MultiProvider support (7.x completed; downport tbd) Roadmap NW 7.x & beyond NLS for master data InfoObjects (7.x) Semantic Partitioning with NLS (7.x) Hybrid Provider with NLS (7.x)
Resounding Success with BI Accelerator

With Early Adopters and Market Analysts
10 million records Query up to x102* faster Index update in 1min /day
650 million records Query up to x300* faster Index update in 1min /day
we are absolutely happy Measurable TCO reduction 527% (avg.) performance increase
Live since September 06 800+ users Across SAP- & non-SAP data
.. end users will benefit from SAP raising the bar with its new BI accelerator solution.
1.3 billion records Query mean 0.9 sec ( 0.8) Index built at 200 million rows per hour
New: SAP features Proof of Concept Lab for BI Accelerator.

* = as compared to traditional query without aggregates
Status: BI-BIA enhancements since SPS9

Performance:
improved parallelization algorithm for indexing large fact tables improvements for hierarchy handling in queries display of all BIA indexes in RSDDV and the BIA monitor
BIA monitor:
System/hardware health check BIA alertserver messages in CCMS + email notification service BIA consistency check center - Demo
Quick check after each index process
Automation/TCO:
process chain variant for creating and filling BIA indexes automatic BIA index adjustment after metadata changes save re-start of the BIA server during indexing processes RSRT debug-option use BIA index even if inactive Automatic re-build of BIA index after selective deletion Enable/disable BIA query usage for certain users
Outlook: SAP NetWeaver BI Accelerator - Enhancements Next generation SAP NetWeaver BI Accelerator
Leveraging in-memory processing technology for complex analytic operations (e.g. top n analyses, count distinct, currency&unit conversion) Using BIA index for master data
(Google-like) value help
High Availability
Hard- and Software capabilities to ensure 24x7 BIA operation
Further Discussion Topics

BIA as buffer for VirtualProvider data Optimising hierarchy handling Support of very large query result sets via packaged read
Outlook: Bringing together tactical and strategic analysis Introducing a new type of InfoProvider: the HybridProvider
Ensures real-time information Combines latest OLTP delta with strategic data kept in a BIA store Optionally bypassing InfoCube database persistency
Avg. response time
OLTP-based Analytics
OLTPbased Analytics
BI-based Analytics
SAP NetWeaver Business Intelligence Real-Time Query HybridProvider

1% Real-Time Data 99%
BI-based Analytics
Traditional behavior
Transactional Delta
Real-Time Update
InfoCube w/ BI Accelerator
<1 min latency

data latency
Typical Synchronization Frequency: 24 Hours
OLTP

Migration Aspects
Outlook
Outlook

Outlook
Definition of Enterprise Information Management

Definition by Gartner Enterprise Information Management is an organized program to design, catalog and safeguard all information assets ( including content found in databases, transaction systems data warehouses, documents and rich media) to maximize their value, usefulness, accessibility and security.
by Gartner (David Newman)
Maximise accessibility and value of information
Information Workspaces
Composite Application
Model-based Composition Provide Information Services Manage Information Assets Integrate Information
SAP NetWeaver Information Management Approach

Topics for Information Management: Process-centric Information Delivery
Embedded Analytics Enterprise Search Business Activity Monitoring Analyze Refine Share
Information workspace Composite Applications

Access Search Collaboration Tasks Information context
Composition
Visual Composer as a common design environment BI Consumer Services to provide service-oriented access to BI and relational data
Event Network
Enterprise Services
Manage Information Assets

BI / KM Integration Information Broadcasting to distribute information Master Data Management as single point of truth Information Lifecycle Management (ILM) BI Master Data Consolidation Composition
SAP NetWeaver
Information Management Infrastructure

BI DQM MDM Modeling KM ILM
Information Integration
KM Repository Framework Universal Data Integration within BI Dynamic Taxonomies/Guided Search Distributed Query Technology to access structured data
Today NW2004s Additional Investments in next major NW Release
EII ETL, EAI
Existing Systems
Status: SAP NW BI IQM Functionality SAP NW BI Information Quality Management Master data
Consistency, Referential Integrity BI Master data consolidation using MDM deduplication features
new new
Process Data
Consistency check (RSRV) (e.g. plausible date/time fields) Check Routines in transformations Data Reconciliation for SAP ERP systems Requests: Errorhandling for erroneous or duplicate records DTP Request: Simulation Debugging, Error Stack, Restart Option
new new
Meta Data
Service API check for structural changes before data loads from SAP ERP systems Certified 3rd party ETL solutions based on staging BAPI have to check structural changes as well
Example: Harmonizing Master Data

Make campaign successful consolidate master data
Customers Marketing Manager Release goods shipment
SAP NetWeaver BI ?=
Oracle Legacy + SAP +
MDM
Description of a master data object: Globally relevant data Client-specific data
Outlook: The Case for Information Quality Management

Poor quality of information assets affects overall business operation across the enterprise
IQM: Framework ensuring utmost quality of a company's information assets. Using this collaborative environment organizations can detect data inconsistencies in a given business context (such as poor quality or redundancies) to assure high quality of business operation.
Quality Planning
Check which data is in inspection scope Define inspection Define quality KPIs in business processes
Planning
Quality Inspection
Run inspections Get inspection results
Control
Quality Control
Run corrective actions Run preventive actions Refine quality rules
Inspection
Evaluation
Quality Evaluation
Analyze results Trigger quality control (corrective/preventive actions)
IQM: Key topics to take home SAP will enhance the so far existing data quality capabilities in SAP NW BI following a sound IQM strategy
Existing set of features and functions for quality assurance
Consistence, Plausibility, Integrity Simulation, Debugging, Errorhandling Checks for metadata changes
New: Set of APIs for BI/MDM Integration

Point to point connection between SAP BI und MDM Automatic metadata transfer from BI to MDM during OpenHub activation Using BI standard interfaces (Open Hub, DataSource) Generic BI extractor functionalitiy in MDM Available on a pilot project basis for SAP NW 7.0 SPS12 / MDM 5.5 SP05 Patch 1
How to get started
Pilot / Proof of Concept Program

For additional details and/or to be considered for the pilot / proof of concept program, contact Karen Comer (Karen.Comer@sap.com) to receive a pilot nomination form. Once the form is completed and returned, your request will be reviewed for participation in this program.
Summary: SAP NW 7.0 BI - Status and Outlook

Migration Aspects
Outlook
Outlook

Outlook
Copyright 2007 SAP AG. Alle Rechte vorbehalten

Weitergabe und Vervielfltigung dieser Publikation oder von Teilen daraus sind, zu welchem Zweck und in welcher Form auch immer, ohne die ausdrckliche schriftliche Genehmigung durch SAP AG nicht gestattet. In dieser Publikation enthaltene Informationen knnen ohne vorherige Ankndigung gendert werden. Die von SAP AG oder deren Vertriebsfirmen angebotenen Softwareprodukte knnen Softwarekomponenten auch anderer Softwarehersteller enthalten. Microsoft, WINDOWS, NT, EXCEL, Word, PowerPoint und SQL Server sind eingetragene Marken der Microsoft Corporation. IBM, DB2, DB2 Universal Database, OS/2, Parallel Sysplex, MVS/ESA, AIX, S/390, AS/400, OS/390, OS/400, iSeries, pSeries, xSeries, zSeries, z/OS, AFP, Intelligent Miner, WebSphere, Netfinity, Tivoli, Informix und Informix Dynamic ServerTM sind Marken der IBM Corporation. ORACLE ist eine eingetragene Marke der ORACLE Corporation. UNIX, X/Open, OSF/1 und Motif sind eingetragene Marken der Open Group. Citrix, das Citrix-Logo, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, MultiWin und andere hier erwhnte Namen von Citrix-Produkten sind Marken von Citrix Systems, Inc. HTML, DHTML, XML, XHTML sind Marken oder eingetragene Marken des W3C, World Wide Web Consortium, Massachusetts Institute of Technology. JAVA ist eine eingetragene Marke der Sun Microsystems, Inc. JAVASCRIPT ist eine eingetragene Marke der Sun Microsystems, Inc., verwendet unter der Lizenz der von Netscape entwickelten und implementierten Technologie. MaxDB ist eine Marke von MySQL AB, Schweden. SAP, R/3, mySAP, mySAP.com, xApps, xApp, SAP NetWeaver, und weitere im Text erwhnte SAP-Produkte und -Dienstleistungen sowie die entsprechenden Logos sind Marken oder eingetragene Marken der SAP AG in Deutschland und anderen Lndern weltweit. Alle anderen Namen von Produkten und Dienstleistungen sind Marken der jeweiligen Firmen. Die Angaben im Text sind unverbindlich und dienen lediglich zu Informationszwecken. Produkte knnen lnderspezifische Unterschiede aufweisen.
Die in dieser Publikation enthaltene Information ist Eigentum der SAP. Weitergabe und Vervielfltigung dieser Publikation oder von Teilen daraus sind, zu welchem Zweck und in welcher Form auch immer, nur mit ausdrcklicher schriftlicher Genehmigung durch SAP AG gestattet. Bei dieser Publikation handelt es sich um eine vorlufige Version, die nicht Ihrem gltigen Lizenzvertrag oder anderen Vereinbarungen mit SAP unterliegt. Diese Publikation enthlt nur vorgesehene Strategien, Entwicklungen und Funktionen des SAP-Produkts. SAP entsteht aus dieser Publikation keine Verpflichtung zu einer bestimmten Geschfts- oder Produktstrategie und/oder bestimmten Entwicklungen. Diese Publikation kann von SAP jederzeit ohne vorherige Ankndigung gendert werden. SAP bernimmt keine Haftung fr Fehler oder Auslassungen in dieser Publikation. Des Weiteren bernimmt SAP keine Garantie fr die Exaktheit oder Vollstndigkeit der Informationen, Texte, Grafiken, Links und sonstigen in dieser Publikation enthaltenen Elementen. Diese Publikation wird ohne jegliche Gewhr, weder ausdrcklich noch stillschweigend, bereitgestellt. Dies gilt u. a., aber nicht ausschlielich, hinsichtlich der Gewhrleistung der Marktgngigkeit und der Eignung fr einen bestimmten Zweck sowie fr die Gewhrleistung der Nichtverletzung geltenden Rechts. SAP haftet nicht fr entstandene Schden. Dies gilt u. a. und uneingeschrnkt fr konkrete, besondere und mittelbare Schden oder Folgeschden, die aus der Nutzung dieser Materialien entstehen knnen. Diese Einschrnkung gilt nicht bei Vorsatz oder grober Fahrlssigkeit. Die gesetzliche Haftung bei Personenschden oder Produkthaftung bleibt unberhrt. Die Informationen, auf die Sie mglicherweise ber die in diesem Material enthaltenen Hotlinks zugreifen, unterliegen nicht dem Einfluss von SAP, und SAP untersttzt nicht die Nutzung von Internetseiten Dritter durch Sie und gibt keinerlei Gewhrleistungen oder Zusagen ber Internetseiten Dritter ab.

Roadmap SaP BI

Hochgeladen von

Dokumentinformationen

Originalbeschreibung:

Copyright

Verfügbare Formate

Dieses Dokument teilen

Dokument teilen oder einbetten

Freigabeoptionen

Stufen Sie dieses Dokument als nützlich ein?

Sind diese Inhalte unangemessen?

Copyright:

Verfügbare Formate

Roadmap SaP BI

Hochgeladen von

Copyright:

Verfügbare Formate

SAP NetWeaver 7.

SAP AG 2007, NetWeaver 7.0 BI EDW, R. Uhle 2

Bill Inmons: Enterprise Data Warehousing Concept

ETL Changed Data Staging Area

ERP Corporate Applications

Exploration warehouse/ data mining

Cross media Storage Management

SAP AG 2007, NetWeaver 7.0 BI EDW, R. Uhle 3

SAP NW 7.0 BI Architecture: Platform & Data Warehouse

Meta Data Repository / Documents

Caching Calculation Planning Services

Open Hub Service NLS Service

Analysis Process Design

Planning Functions and Sequences

Data Flow Control / Process Chains

13,000 Customer Installations

Across 25+ industries, from small to very large

Enterprise Business Intelligence

Business Intelligence Accelerator

SAP AG 2007, NetWeaver 7.0 BI EDW, R. Uhle 5

Main Investments with SAP NetWeaver 7.0 (2004s) BI WHM

30% more throughput Zero latency every minute

Real-time Data Warehousing

My last years presentation

Visionary Concepts for high performance and large data volumes

Nearline Storage (NLS) Interface

20 to 100 times faster

Engaged Administration and Monitoring strategy

SAP AG 2007, NetWeaver 7.0 BI EDW, R. Uhle 6

SAP NW 7.0 BI - Status and Outlook

Information Quality Management

SAP NW 7.0 BI - Status and Outlook

Information Quality Management

Status: ETL Aspects Data Flow Concept SAP Netweaver BI

TR DataSource (PSA) DataSource (PSA)

TR DataSource (PSA) DataSource (PSA)

Status: Lean data flow concept - Cornerstones

InfoProvider VirtualProvider Remote Characteristic

Data Transfer Process TRANSFORMATION

Graphical Transformation Formular editor Start/End/Expert Routines

Status: Direct Access - Transactional Data

DataTransfer Process for Direct Access

DataSource DataSource for direct access for direct access

SAP AG 2007, NetWeaver 7.0 BI EDW, R. Uhle 11

Status: Direct Access including remote Master Data

DTP for Direct Access

DTP for Direct Access

DataSource DataSource (direct access) (direct access)

SAP AG 2007, NetWeaver 7.0 BI EDW, R. Uhle 12

Status: Real-time Data Acquisition (RDA) Daemon Concept

Data Warehouse Layer

DataTransfer Process for Real-time Data Acquisition

InfoPackage for RDA

Web Service Push External System

Delta Queue Service API

SAP Source System

Status: Data Flow Migration - DataSources

SAP AG 2007, NetWeaver 7.0 BI EDW, R. Uhle 14

Status: Data Flow Migration - Transfer Rules

SAP AG 2007, NetWeaver 7.0 BI EDW, R. Uhle 15

Status: Data Flow Migration - Documentation

SAP NW TOM: http://help.sap.com/saphelp_nw04s/helpdata/en/43/f9d041d6392ae3e10000000a422035/frameset.htm

Outlook: Hierarchy Framework Segmented DataSources