Data Stage Course content

Data warehousing concepts

_ Data warehouse & Data
warehousing
_ Data warehousing Architectures
_ ETL project phases
_ ETL Process
_ ETL Architecture
_ Over view of project Architecture
_ ER, Dimensional Model & I E
Notation
_ Data warehousing Teams & Roles
_ Understand Mapping Documents
Introduction to Data Stage
_ History & Features
_ Difference between 7.5X2 & 8.x
_ IBS DS & QS 8.0.1
_ DS info Sphere 8.5 Enhancements
_ View on Web console
_ IBM Data Stage 7.5x2 & 8.x
Architecture
_ Traditional Batch Processing
_ Partition & Pipeline parallelism
_ Partitioning & re- Partitioning
techniques
_ Combinality, Combining & collecting
Techniques
_ Configuration File & Node
Components
About IBM web sphere DS & QS
_ 7.5X2 & 8X Enhancements-New
Features
_ Parallel Processing environments
(SMP, MPP etc.)
_ DS Client Components Overview
_ DS architecture Components
Overview
Data Stage Jobs & Stages
_ Difference between server & parallel
jobs
_ Overview of Parallel jobs, server
jobs, mainframe jobs, migration jobs
and job sequencing jobs
_ Repository, DS Designer Toolbar &
Palette
_ Active & Passive stages
_ Palette Customization
_ About Link Markers
_ Frame work Operators
Design, Compile & Run DS jobs
_ DS Job Design Process

_ Designer Canvas customization

_ Compile, Force Compile & multiple
job compile
_ DTD & OSH code
Working with file stages
_ Sequential file & stage rules
_ Data set & types
_ File set
_ Differences-Data et, file set & seq
file stages
_ Lookup file set stage
Development/Debug & STUB Stages
_ Row generator & column generator
_ Head, tail & sample stages
_ Peek stage
_ Copy stage
Working with relational databases
_ Enterprise and plug-in stages
overview
_ Oracle, DB/2, SQL server stages
_ TERADATA
_ ODBC (oracle, SQL server, Excel &
Access)
_ Dynamic RDBMS stage
_ Orchestrate schema import

Processing stages

Horizontal combining
_ Join stage
_ Lookup stage (normal, sparse, range,
case less)s
_ Merge state
_ Funnel stage & funneling
Sorting & vertical combining
_ In-stage sorts (traditional sort)
_ Sort stage (complex & simple sorts)
_ Aggregate stage
_ Remove duplicate stage
Data transformation with transformer
_ Basic transformer vs. parallel
transformer
_ External functions & macros
_ Stage variables & system variables
_ Transformer constraints
_ Transformer execution order
Filtering methods
_ Constraints & source level
_ Filter stage
_ Switch stage
_ External filter stage
Other stages

_ Modify stage
_ Compress & Expand stage
_ Decode & Encode stage
_ Pivot stage
Slowly changing dimensions
_ Type -0, 1, 2 Dimensions
_ Implementing SCD -I & II in 8.0.1 &
7.5x2
_ SCD stage
_ Change capture & change apply
stage
_ Surrogate key stage (state file &
sequence object)
Performance tuning tips
_ Performance tuning with best
practices
_ Performance tuning with
partitioning techniques
_ Performance Analysis & Estimate
resource
Advance topics
_ Parameter set & Parameter file
creation
_ Data connection
Job control
_ Job sequencing (run stages, error
handling stages, flow control stages
& etc)
_ Batch jobs
Data stage designer additional features
_ Import & export of repository
components
_ Node configuration
_ Generate exports
Data stage director
_ Schedule/run/validate a compiled
job
_ Message handling (job & project
level)
_ Monitor jobs, filter/purge logs
_ Unlocking job & customize
Web console & DS administrator
_ security services, session
management
_ Domain management, reporting,
scheduling..
_ ADD, Delete and Organize projects
Information analyzer
_ Column, primary key, foreign key,
cross domain & base line analysis