Beruflich Dokumente
Kultur Dokumente
Based
on the IBM/Rational approach for e2e software delivery the broader BI strategy their tools/processes employ
Understand Look
PROBLEM STATEMENT
Understand the effectiveness and efciency of existing models/processes Standardised reports for Operations and Finance (reduce costs of managing the business) Drive up standards by providing visibility of activities Monitor and improve reuse within requirement, design and implementation phases Line of sight from user demands through development and test E2E traceability from cradle to grave
DASHBOARD SOURCES
Code Stats Requirements Data Build Stats Testing Status Data
System Data
Platform Data
Dashboard
Incident Management CIT Stats
Project Data
PHASE 1
Requirements
are a key component in obtaining this picture (for the time being) systems Planning/Proposal and Portfolio management Data
Investment
Systems/Development
BI STRATEGY
Business Operations Financial Analyst Lines of Business Customer Experience Technical Delivery Systems/Platforms Release Planning
BI STRATEGY
Business
Business
BI STRATEGY
Platforms/Systems operational cycle
volume Time
on target
BI STRATEGY
Mid term views
software tie
in design collateral in with stories, test/QA, vendors, etc up (and measure) re-use of strategic capabilities pinch points in OM delivery cycles
drive
identify pull
ARCHITECTURE
ETL Process
D1
Landing (raw) Tables
ETL Process
D1
Landing/Staging Tables
Staging Area
Staging Area
Transform, cleanse Transform, conform
SQL Modules
D2
SQL Modules
Pre-Warehouse Tables
D2 Staging Tables
Iteration-2 (real-time) reporting requires that we take a different approach... to processing the data...
refactor to process incoming records on-demand
ETL Process
D1
Landing (raw) Tables
ETL Process
D1
Landing/Staging Tables
Staging Area
Staging Area
Transform, cleanse Transform, conform
SQL Modules
D2
SQL Modules
Pre-Warehouse Tables
D2 Staging Tables
Introduce CEP/ESP tools such as Esper along side shorter load processes (see next 2 slides for the latter)
ETL Process
D1
Pre-Warehouse Tables
Staging Area
BULK_LOADER
Data Warehouse
ETL Process
Tablespace/Logical Database
ETL/Loading Process
D1
Hot table partition
D1
Pre-Warehouse Tables
OVERFLOW
Bulk Loader
D2
Main Warehouse Tables
Physical Database
SQL Modules Producer/Consumer
FACT_LOADER
Data Warehouse
Transform, conform
SQL Modules
D2
Pre-Warehouse Tables
Tablespace/Logical Database
Bulk Loader
D2
Main Warehouse Tables
Fail-over Handler
Physical Database
BACKUP SLIDES
Some
of the challenges:
Near
real time BI requires a more complex architecture than nightly batch processing structure of complex process oriented data, particularly decomposition in hierarchies to adopt new paradigms such as CEP/ESP
The
Need