Beruflich Dokumente
Kultur Dokumente
Architecture
Objectives
► At the end of this lesson, you will know :
Data Warehouse Architectures
Components of Data Warehousing Architecture
An overview of each of the components
Considerations for Data Warehouse Design
Common mistakes in Warehouse designs
An overview of Warehouse on the web
Warehouse Architecture - 1
EIS /DSS
Metadata
Web Browsers
Operational
Systems/Data Middleware/
API Data Mining
Data
Preparation
Metadata
EIS /DSS
Data Mart
Metadata
Select Query Tools
Extract
Transform Data Mart
Integrate OLAP/ROLAP
Maintain Metadata
Web Browsers
Operational Data Mart
Systems/Data Middleware/
Data API Data Mining
Preparation
EIS /DSS
Metadata
Web Browsers
Operational
Systems/Data Middleware/
Operational
API Data Mining
Data Data Store
Preparation
LAN
Data Warehouse
Server
Processes
•Extract
•Scrubbing
•Transformation
DW is sum
•Load Jobs total of all
•Aggregation Jobs Data Marts
•Replication
•Monitoring
•Management
•Meta Data Repository DW Bus using
•Meta Data Population Conformed Dimensions
•Meta Data Maintenance
LAN
Data Warehouse Server
Processes
•Extract
•Scrubbing
•Transformation
•Load Jobs
•Aggregation Jobs
•Replication
•Monitoring Detail Data
•Management in ER format
•Meta Data Repository
•Meta Data Population
•Meta Data Maintenance
Summarized Data
in Star formats
Warehouse Architected
Admin Data marts
Tool
Warehouse Databases
Hardware Considerations
•Parallelism
•SMP or MPP
•Disk Storage
Hardware Considerations
► Parallelism
Most deployments of VLDB Data Warehouses
are on SMP or MPP
► Fault Tolerance
Redundant Array of Independent Disks (RAID)
Arrangement of disks to achieve higher fault
tolerance
Hardware Considerations
► Three options for Hardware
Symmetric Multiprocessing (SMP)
►Shared Memory Architecture
Massively Parallel Processing (MPP)
►Shared Nothing Architecture
►Each node has its own memory and I/O
Benefits
► Extends the reach to more users
► Data can be shared with external
users
► Security is a major issue
► Client software and management
costs go down
HTML HTML
Request Reports
Data
Browser Web
Reports Warehouse
Server
Applet
ActiveX SQL
HTTP Request
Download
Applet/ActiveX
Query
Browser Results Data
Warehouse
Web Query
Server Engine