<Insert Picture Here>

S292621
Overview: Approaches to Oracle Data Warehousing
Robert Stackowiak
Vice President, Business Intelligence, Oracle Technology Business Unit
The following is intended to outline our general
product direction. It is intended for information
purposes only, and may not be incorporated into any
contract. It is not a commitment to deliver any
material, code, or functionality, and should not be
relied upon in making purchasing decisions.
The development, release, and timing of any
features or functionality described for Oracle’s
products remains at the sole discretion of Oracle.
Best Practices from….

And you!!!
 Starting Out: On the Same Page?
Different Agendas Typical in IT & Lines of Business

Information Technology Lines of Business

It is about… It is about…
managing and immediate access
delivering quality to information
data consistently needed for
and at low cost business
decisions
 Finding Benefits
IT Benefits are only Somewhat Motivating

• ROI = Present Value of Benefits - Costs

• Increasing ROI for information producers by

• Reducing current costs of analysis for LOBs

• Empower LOBs with tools, applications, and automated
analysis rather than manually creating custom reports

• Reducing ongoing costs of analysis for IT

• Faster and simpler development of analytic applications
• Centralized management
 Finding Benefits
Lines of Business produce the Big Wins

• ROI = Present Value of Benefits - Costs

• Increasing ROI for information consumers (LOBs) by

• Enabling top-line growth

• New customers/markets, most profitable customers, …
• React faster than the competition

• Enabling bottom-line savings

• Optimize operations, financial management, …
 Typical Business Drivers
• Financial
• Cross-sell, targeted marketing, more efficient processes

• Manufacturing
• Supply chain analysis / just in time inventory

• Retail
• Supply chain analysis / inventory control

• Media & Telecommunications

• Revenue across multiple channels
 Typical Business Drivers
• Transportation
• Optimized logistics management

• Healthcare
• Cost containment / quality of care

• Civilian Government
• Budget spend and reporting to constituents

• Military & Intelligence

• Logistics management, threat analysis
Business Strategy Map
 Deploy within Scope Quickly
• Pick a strategic business area
• Should have potentially highly visible ROI

• Build business / IT partnership

• Limit scope, deliver projects incrementally

• Assemble team with the right skills

• Engage systems integrators as if employees

Organization Assessment Discovery Solution Approval &

Strategy & Scope Development Budget
& Presentation
 Your Infrastructure?
MULTIPLE DIFFERENT AD-HOC DISPARATE BI TOOLS AND FRAGMENTED
ROLES METRICS PROCESS REPORTING SYSTEMS DATA SOURCES

FINANCE
GOAL
FINANCE EBITDA
Multiple
ERP
?
HUMAN
PLAN
HIRING
RESOURCES QUALITY Multiple
OPERATIONS SUPPLY
CHAIN
?
BRAND
MODEL Multiple
MARKETING
DATA Multiple
WAREHOUSES LEGACY
APPLICATIONS
?
CUSTOMER SERVICE ANALYZE
LEVELS
PLANNING

SERVICE
Multiple
POINT
? APPLICATIONS
COMPANY REPORT
EXECUTIVE HEALTH
 A Re-architecture Approach
Data Marts
Orchestration Applications Data
Master
Warehouse
Data & BI Tools
Reporting
Data Warehouse & Dashboards
Database
Sales
EAI
Marketing

Self Service

Business Intelligence
Master
Call Center
Data Hub
DW

Financials DW ETL

Providers DW

Eligibility Data
Warehouse
Claims

EAI ETL
Analytical
Data
 Plan for Data Growth
1,487% Increase in Size from 1998 to 2005
245% Increase just from 2003 to 2005
100

80

Size of the largest data

60 warehouse in TopTen
Database
Programs
Size
(TB)
40

20

0
1998 1999 2000 2001 2002 2003 2004 2005

Source: 2005 TopTen Program, November 2005 © Winter Corporation, Waltham, MA, USA
 Time to Consider Grid Deployment?

Fusion Middleware

Real Application Clusters

Grid Control

Automatic Storage Management

 Configuring the Platform
Rule of Thumb: Maximal Number of
200MB/s per CPU Switches = Number
→ Number of HBA per of HBAs
node = number CPUs
CPU,Node per node
Number of HBAs +
No. of Controllers
Host Bus Adapter
Switch
Number of nodes Controller
<=8 → GigE,
otherwise infiniband
Disk

Interconnect
Minimum number of
disks = number of
* 2Gbit based controller x 4
 Typical Platform Sizing Questions

• Highest level basic questions

• How much data needs to be stored in the system?
• What is the mix of query types (e.g. simple, intermediate,
complex)?
• How many concurrent users are there?

• Technical questions
• What is the expected read / query rate from the system in GB
/ second?
• What is the expected read / query rate from the system in GB
/ second?
• Do queries run concurrently with the data load?
 Goal: Consistent Sustained Performance

Component Hardware spec Sustained

CPU core - 100 - 200 MB/s

1/2 Gbit HBA 1/2 Gbit/s 100/200 MB/s

16 port switch 8 * 2 Gbit/s 1,200 MB/s

Fiber channel 2 Gbit/s 200 MB/s

Disk controller 2 Gbit/s 200 MB/s

GigE NIC (interconnect) 2 Gbit/s 80 MB/s*

Disk (spindle) 30 - 50 MB/s

* Limited by the protocol

 Simplify: Use Optimized Warehouses

• Oracle Optimized Warehouse

Reference Configurations
• Documented best-practice balanced
configurations for data warehousing
• Available Today!
• Dell / EMC, HP, IBM, Sun

• Oracle Optimized Warehouses

• Scalable systems pre-installed and pre-
configured: ready to run out-of-the-box
• Recent announcements
 Leverage Oracle Database Flexibility
Materialized Views, Hybrid Schema…

SQL Query Materialized Views

Sales Sales
Region Date by Region by Date

Query
Rewrite
Sales Sales
by Product by Channel

Product Channel
Relational
Star Schema
 … and New Database Capabilities
Cube Organized Materialized Views

SQL Query Materialized Views

Region Date

Query
Rewrite

Product Channel
Automatic OLAP Option Cube
Refresh
 Analyze Large Data Sets in Database
Better Performance for Sophisticated Users
• Analytic Functions in the Database

• OLAP Option in the Database

• Data Mining Option Algorithms in the Database

• Naïve Bayes, Associations, Adaptive Bayes
Network, Clustering algorithms, Support Vector
Machines, Nonnegative Matrix Factorization,
Decision Trees, Generalized Linear Models
• You can leverage existing mining tools
• SPSS Clementine
• InforSense
 Optimizing Oracle BI Suite EE Plus
Leverage the BI Server as a Cache

Interactive Ad hoc Proactive Microsoft Reporting & Publishing

Dashboards Analysis Detection Office BI Publisher
and Alerts
Financial Reporting
Interactive Reporting
SQR Production Reporting
Web Analysis

Common Enterprise Information Model

Oracle BI Server

Set
Goals
Align Plan
Insight
Performance
Action
Report Monitor

Analyze

Data SAP, Oracle Files Financial

OLTP & ODS Warehouse PeopleSoft, Siebel, Excel Business Performance Hyperion
Systems Data Mart Custom Apps XML Process Management Essbase
Applications
Match Solutions to Needs

Hyperion Oracle Database

Essbase OLAP Option

Performance Enhanced
Management Data Warehousing

Hyperion Essbase Oracle Database OLAP

Data Mgt. Strategy Heterogeneous Oracle-centric

System Ownership LoB IT

Metadata Mgt. User Owned IT Managed

Hot-pluggable Data Sources BI Tools

 Still Managing Oracle like it is 1999?

• Consider leaving init.ora parameters set as

defaults
• Adaptive degree of parallelism, etc.

• Leverage Enterprise Manager

• Database Resource Manager
• CPU allocation by groups of users,
proactive query governing, automatic
queuing, dynamic re-prioritization
• Automatic Database Diagnostics Monitor
alerting & advisors
• Partitioning, SQL Access, SQL Tuning,
Segment, Mean Time to Recovery, and
other advisors
 Storage Management through ASM

Database 1 • Portable, high performance,

cluster file system & volume
manager
File #1 File #2
• Files spread across disks to
balance load

• Integrated mirroring
• SAME vs. RAID 5

• Accessible through Enterprise

File #1 Manager
Database 2
 Change Management Considerations
Leverage Change Assurance Capabilities

Detect and Tune

Performance Changes
Capture and
Replay Workload Provision - Upgrade or
Clone

Set Up Test Configure and Maintain

Environments Production System

Package Incidents
for Support

Online ‘Hot’ Patching

 Partitioning Strategies
ORDERS ORDERS ORDERS

Europe

USA
Jan Feb Jan Feb

Large Table Partition Composite Partition

Difficult to Manage Divide and Conquer Higher Performance
Easier to Manage More flexibility to match
business needs
Improve Performance

• New: Interval partitioning, more composites (list-list, list-range, list-hash,

range-range), partitioning on virtual columns
 Data must be Available
Information Lifecycle Management to contain Cost
• Management parameters:
• Data classification
• Age / date, product, privacy, etc.
• Storage Tiers
• High performance, low cost,
historical
• Advanced Compression in tiers
• Access Management & Migration
• By class
• ILM Assistant simplifies:
• Policy management, data
management, compliance &
security
 The Data Warehouse and Availability
• Disaster Recovery
• Identical RAC Clusters in distance separated sites
• Other Strategies: Active Data Guard, Total Recall
1. Extract 2. Integrate, 3. Query and 4. Data access
from source transform, and analyze and publishing
systems denormalize
Users
Extract STG1
Servers (ETL/Staging) Data Warehouse 1
BI Tool
ETL
Manager
STG2
(ETL/Staging) Data Warehouse 2
 Share Data and Protect it?

Audit Database Label Advanced Secure Configuration

Vault Vault Security Security Backup Mgmt Pack

Monitor, Alert, Multi-factor Data Encrypted Encrypted Secure

Consolidate DBA Controls Classification Data Data on Tape Deployments
 Example: Virtual Private Database
Transparent Security inside the Database

• Server dynamically rewrites SQL

• Query modification based on PL/SQL package assigned to an
object
• “Where” clause appended to SQL statement

SELECT * FROM orders

Where territory_id = 12
Western
Sales Rep
SELECT * FROM orders
Where product_id - 22
Product orders
Manager
Deploying Pervasive BI
Execute Action

Provide values for the following action parameters:

Begin Marketing Campaign

Region West
Campaign ID 42684

Help Cancel OK

OBI Suite EE Plus

&
BPEL
 Consider Analytic Applications
Build from Scratch
with Traditional BI Tools Oracle Analytic Applications

Training / Roll-out
Oracle Analytic Applications
solutions approach:
Define Metrics
& Dashboards • Faster time to value
• Lower TCO
• Assured business value
DW Design

Training / Rollout Easy to use, easy to adapt

Define Metrics Role-based dashboards and
Back-end & Dashboards thousands of pre-defined metrics
ETL and DW Design Prebuilt DW design, adapts to your
Mapping EDW
Back-end
ETL and Prebuilt Business Adapters for
Mapping Oracle, PeopleSoft, Siebel, SAP,
others
Months or Years Weeks or Months

Source: Patricia Seybold Research, Gartner, Merrill Lynch, Oracle Analysis

 Oracle BI Applications
Check alignment to Business Requirements
Comms Complex Consumer Financial High Insurance Life Public Travel
Auto Energy
& Media Mfg Sector Services Tech & Health Sciences Sector & Trans

Service & Order

Supply Human
Sales Contact Marketing Management Financials
& Fulfillment
Chain Resources
Center
Pipeline Churn Campaign Order Supplier A/R & A/P Employee
Analysis Propensity Scorecard Linearity Performance Analysis Productivity
Orders
Triangulated Customer Response vs. Available Spend GL / Balance Compensation
Forecasting Satisfaction Rates Inventory Analysis Sheet Analysis Analysis
Customer
Sales Team Resolution Product Cycle Time Procurement & Product HR Compliance
Effectiveness Rates Propensity Analysis Cycle Times Profitability Reporting

Up-sell / Service Rep Loyalty and Backlog Inventory P&L Analysis Workforce
Cross-sell Effectiveness Attrition Analysis Availability Profile

Cycle Time Service Cost Market Basket Fulfillment Employee Expense Turnover
Analysis Analysis Analysis Status Expenses Management Trends

Lead Service Campaign ROI Customer BOM Analysis Cash Flow Return on
Conversion Trends Receivables Analysis Human Capital

Other Operational
Prebuilt adapters: & Analytic Sources

BI Tools, Database, Complementary Vertical Models / Applications

 A BI Applications Suite Spot
Hyperion Financial Performance Management
Strategic Planning Planning and Budgeting
Set Strategic Cascade Targets
Objectives

Treasury Long-Term Detailed

Strategies Planning Forecasting
Budgeting

Corporate Allocate
Development Resources

Master Data
Business Rules
Metrics/KPIs
Targets, Plans & Actuals

Cost and Profitability Management

Financial Close Process
Define Costing
Methods

Internal External Report & Define Cost

Data
Consolidate Reporting & Reporting & Analyze Drivers
Cleansing
Analysis Compliance
Perform
Allocations
 Good News: Improving Technology

• Faster Time to Deployment

• Analytic applications, SOA components, Optimized Warehouses

• Pervasive Business Insight

• Automated business processes, guided decisions

• Right Time Predictive Insight

• Advanced predictive analytics

• Highly Available and Secure Solutions

• On-line data accessible all of the time

• Decreasing TCO
• Lower-cost, self-managed, less tuning needed
 Challenges

• Understanding business needs & priorities

• Navigating sponsorship & politics

• Getting info to design and size properly

• Planning for future using corporate vision

• Finding architects skilled in business, technology

• Unforeseen developments
 Presentation Review

• Business and IT must be on the same page

• Deploy quickly in well-scoped increments
• Evaluate re-architecture as needed
• Choose the right tools for the right users
• Data volume, access determines where to analyze it
• Use newer database features in design, management
• Design to meet security, availability needs
• Insist on Optimized Warehouse configurations
• Plan ahead: data growth & changing business
• Evaluate applications as aligned to business
For More Information

search.oracle.com
business intelligence

or
oracle.com/bi