Beruflich Dokumente
Kultur Dokumente
Session Objectives
Overview of Data Warehouse and warehousing
Operational Systems
Helps to run the day-to-day enterprise operations. Backbone systems of any enterprise, for order entry, inventory etc. The classic examples are airline reservations, credit-card authorizations, and ATM withdrawals etc.,
Data
Information
Knowledge
Tactical Information
Transported Quantity Inventory Control System
Order quantity
OLTP Server
Production quantity
Supports day to day control operations Transaction Processing High Performance Operational Systems Fast Response Time Initiates immediate action
10
Strategic Information
Production & Inventory Marketing
Finance
Payroll
Operational Data
Periodic Refresh
Tactical Information
Strategic Information
Operational data helps the organization meet operational and tactical requirements for data. While the Data Warehouse data helps the organization meet strategic requirements for information
12
Analytical
s
s s s s s
Constantly updated Minimal redundancy Highly detailed data Referential integrity Supports day-to-day business functions
s s s s s
Less frequently updated Managed redundancy Summarized data Historical integrity Supports long-term informational requirements
Normalized design
De-normalized design
13
Data Warehousing
15
Data Warehouse
Customer
Billing
Accounting
Usage
Revenue
Operational data is organized by specific processes or tasks and is maintained by separate systems
Warehoused data is organized by subject area and is populated from many operational systems
16
Application Specific
s
Integrated
Applications and their databases were designed and built separately Different formats, representations
17
18
Data warehouse
Update Insert
Update Delete Insert
Load/ Update
Initial Load
Constant Change
s
Updated constantly
s Does NOT mean the Data warehouse is never updated or never changes!!
19
20
Data Marts
Data Mart
23
24
volume
26
ODS Definition
The ODS is defined to be a structure that is:
Integrated Subject oriented Volatile, where update can be done Current valued, containing data that is a day or perhaps a month old Contains detailed data only.
28
ODS data resolves data integration issues processing demands of reporting and analysis
ODS
Access to current data facilitated.
Tactical Analysis
29
30
ODS- Benefits
Integrates the data Synchronizes the structural differences in data High transaction performance Serves the operational and DSS environment Transaction level reporting on current data
Flat files 60,5.2,JOHN 72,6.2,DAVID Operational Data Store Relational Database
Excel files 31
ODS Data
Update schedule - Daily or less time frequency Detail of Data is mostly between 30 and 90 days Addresses operational needs
Weekly or greater time frequency Potentially infinite history Address strategic needs
32
33
OLAP
What is OLAP
OLAP tools are used for analyzing data It helps users to get an insight into the organizations data It helps users to carry out multi dimensional analysis on the available data Using OLAP techniques users will be able to view the data from different perspectives Helps in decision making and business planning Converting OLTP data into information Solution for maintaining your company's competitive edge
35
OLAP Terminology
Drill Down and Drill Up Slice and Dice Multi dimensional analysis What IF analysis
36
Information Access
Data warehouse
Reporting tools
ODS
Mining
OLAP
Data Marts
Information Servers
Web Browsers
Administration
38
Staging
Enterprise Datawarehouse
41
In a top down scenario, the entire EDW is architected, and then a small slice of a subject area is chosen for construction
42
1. Coordinated environment
2. Single point of control & development
Staging
Enterprise Datawarehouse
44
Once the EDMA is complete, an initial subject area is selected for the first incremental Architected Data Mart (ADM).
The EDMA is expanded in this area to include the full range of detail required for the design and development of the incremental ADM.
45
47
49
ETL
Info Access
Reporting tools Map Req. to OLTP Enterprise Data Warehouse Reverse Engg. OLAP External Data Storage Web Browsers
Mining
OLTP System
50