Manage Your ODI Development Cycle: Jerome Francoisse ODTUG Webinar January 2016

Manage Your ODI Development Cycle
Jerome Francoisse | ODTUG Webinar | January 2016

info@rittmanmead.com www.rittmanmead.com @rittmanmead 1
Jrme Franoisse
Consultant for Rittman Mead
ODI Trainer

Providing ODI support on OTN Forums
ODI 12c Beta Program Member
Blogger at http://www.rittmanmead.com/blog/
Email : jerome.francoisse@rittmanmead.com
Twitter : @JeromeFr

About Rittman Mead
Optimizing your investment in Oracle Data Integration
Worlds leading specialist partner for technical Providing our customers targeted expertise; we are a
excellence, solutions delivery and innovation in company that doesnt try to do everything only
Oracle Data Integration, Business Intelligence, what we excel at
Analytics and Big Data
Founded on the values of collaboration, learning,
70+ consultants worldwide including 1 Oracle ACE integrity and getting things done
Director and 2 Oracle ACEs
Comprehensive service portfolio designed to
support the full lifecycle of any analytics solution

5
20% discount on rittmanmead.com/save-on-training/
5
Successful ODI project

Having good developers is great


but its not enough!


but its not enough!
We also need :


but its not enough!
We also need :
- Assurance that the code deployed in production is correct


but its not enough!
We also need :
- Possibility to restore any previous state


but its not enough!
We also need :
- Possibility to restore any previous state
- A way to manage concurrent development

Agenda
Lifecycle Management
- Architecture
- Promotion
- Versioning

ODI 12c Key Components
ODI Studio (the main development IDE)
- Designer Navigator Security
- Operator Navigator Topology
Versioning
- Topology Navigator
Master Repository
- Security Navigator
ODI Agents (executing mappings and packages)
Models
ODI Console (web-based interface)

Projects Execution
Execution
ODI Repositories (contain definitions of models,
mappings and other objects) Work Repository Execution Repository
(Development) (Production)

Physical and Logical Topology
Physical Contexts Logical
DEV_SCOTT
DEV_OP SH
HR
SCOTT
TEST_OP
HR
SCOTT
PROD_OP SH
HUM_RES

DEV_SCOTT
DEV_OP SH
HR
SCOTT
SCOTT
SH
TEST_OP
HR
HR
SCOTT
PROD_OP SH
HUM_RES

DEV_SCOTT
DEV_OP SH
DEV
HR
SCOTT
SCOTT
TEST_OP TEST SH
HR
HR
SCOTT PROD
PROD_OP SH
HUM_RES

DEV_SCOTT
DEV_OP SH
DEV
HR
SCOTT
SCOTT
TEST_OP TEST SH
HR
HR
SCOTT PROD
PROD_OP SH
HUM_RES

DEV_SCOTT
DEV_OP SH
DEV
HR
SCOTT
SCOTT
TEST_OP TEST SH
HR
HR
SCOTT PROD
PROD_OP SH
HUM_RES

DEV_SCOTT
DEV_OP SH
DEV
HR
SCOTT
SCOTT
TEST_OP TEST SH
HR
HR
SCOTT PROD
PROD_OP SH
HUM_RES

Architecture
Security
Topology
Versioning
Master Repository
Models
Projects Execution
Execution
Work Repository Execution Repository

(Development) (Production)

How many repositories do I need?
Security
Topology
Versioning
Master Repository
Models
Projects Execution Execution
Execution
Work Repository Execution Repository Execution Repository

(Development) (Test) (Production)

Security Security
Topology Topology
Versioning Versioning
Master Repository Master Repository
Models
Projects Execution Execution
Execution
Work Repository Execution Repository Execution Repository

(Development) (Test) (Production)

Security Security Security

Topology Topology Topology
Versioning Versioning Versioning
Master Repository Master Repository Master Repository
Models
Projects Execution Execution Execution

Execution
Work Repository Execution Repository Execution Repository Execution Repository

(Development) (Test) (Pre-Production) (Production)


Models Models
Projects Execution Execution Projects Execution

Execution Execution
Work Repository Execution Repository Execution Repository Work Repository Execution Repository
(Development) (Test) (Pre-Production) (Hotfix) (Production)


Models Models
Projects Execution Execution Execution Projects Execution
Execution Execution
Work Repository Execution Repository Execution Repository Execution Repository Work Repository Execution Repository
(Development) (Test) (Smoke Test) (Pre-Production) (Hotfix) (Production)

Security Security Security Security Security
Topology Topology Topology Topology Topology

Versioning Versioning Versioning Versioning Versioning
Master Repository Master Repository Master Repository Master Repository Master Repository
Models Models
Projects Execution Execution Projects Execution
Execution Execution
Work Repository Execution Repository Execution Repository Work Repository Execution Repository
(Development) (Test) (Smoke Test) (Hotfix) (Production)

Problems

Problems
As a developer, how do I create a consistent set of objects for a release?

Problems
Execution
Execution Repository

Problems
Models
Execution Projects
Execution
Execution Repository Work Repository

Problems
Models
Execution Projects
Execution
As a release manager, how do I easily

Problems
Models
Execution Projects
Execution

- promote code from one environment to another?

Problems
Models
Execution Projects
Execution

- keep track of these sets of objects?

Problems
Models
Execution Projects
Execution

- keep track of these sets of objects?
- roll back to a previous release?

The Solution Deployment Archive (DA)

Archive file containing a set of consistent ODI objects


Applied to Deployed Repositories (test/production)


3 types :


3 types :
- Initial


3 types :
- Initial
- Patch


3 types :
- Initial
- Patch
- Rollback


3 types :
- Initial
- Patch
- Rollback
Development or Execution

Example
Developer
Development
environment
Release Manager
QA environment
(Deployed repository)

Example
Creates Initial
Release 1.0.0.0
Developer
Development
environment
Release Manager
QA environment

Example
Creates Initial
Release 1.0.0.0
Developer
Development
environment
Initialize
repository with
Release 1.0.0.0
Release Manager
QA environment

Example
Creates Patch
Creates Initial Release 1.1.0.0
Release 1.0.0.0 to add a
features
Developer
Development
environment
Initialize
repository with
Release 1.0.0.0
Release Manager
QA environment

Example
Creates Patch
features
Developer
Development
environment
Apply Patch
Initialize Release 1.1.0.0
repository with and create
Release 1.0.0.0 rollback DA
Release Manager
QA environment

Example
Creates Patch
features
Developer
Development
environment
Bug
Apply Patch
Initialize Release 1.1.0.0
repository with and create
Release Manager
QA environment

Example
Creates Patch
features
Developer
Development
environment
Bug
Apply Patch
Initialize Apply Rollback
Release 1.1.0.0
repository with Release 1.1.0.0
and create
Release Manager
QA environment

Example
Creates Patch Creates Patch

Creates Initial Release 1.1.0.0 Release 1.1.0.1
Release 1.0.0.0 to add a to fix the
features previous bug
Developer
Development
environment
Bug
Apply Patch
Release 1.1.0.0
and create
Release Manager
QA environment

Example
Creates Patch Creates Patch

Creates Initial Release 1.1.0.0 Release 1.1.0.1
Release 1.0.0.0 to add a to fix the
features previous bug
Developer
Development
environment
Bug
Apply Patch Apply Patch

Release 1.1.0.0 Release 1.1.0.1
and create and create
Release 1.0.0.0 rollback DA rollback DA
Release Manager
QA environment

Developer / Administrator
Create a deployment archive

Create a deployment archive

from VCS label
Best Practice :
Link documentation and DDL
statements to be applied

Create a deployment
archive from selected
objects
Best Practice :
Mention the bug number in
the description

No need to think about development or

execution-only environment

Release Manager
Apply Deployment Archives

Release Manager
Initial DA
Can choose from

development or
execution-only archive

Release Manager
Patch DA
Can choose from

development or
execution-only archive
Best Practice :
Always create a
Rollback DA!

Release Manager
See applied DAs

Inventory

Release Manager
See applied DAs

Inventory
See available DAs

View Details

Release Manager
Rollback DA

Automation
Available through ODI SDK
Scenarios :
- Import and be sure you always generate a rollback DA

Automation
Scenarios :
- Import daily into a smoke test environment

Automation
Scenarios :
- Import daily into a smoke test environment
- Import the same release in Hotfix and Production at the same
time

Other Problems

Other Problems
How to rollback on the Development environment?

Other Problems

How to restore delete objects in the Development
environment?


Other Problems

How to restore delete objects in the Development
environment?

How to develop concurrently?

The Solution - VCS

The Solution - VCS
Integration with Subversion (SVN)

The Solution - VCS

- Everything is done through ODI Studio

The Solution - VCS

- Git support in the next release

The Solution - VCS

- Tagging

The Solution - VCS

- Tagging
- Branching / Merging

VCS - Features
Add an object to VCS

VCS - Features

VCS - Features

VCS - Features
Create a new version of an object

VCS - Features
Create a new version of an object

VCS - Features
View and compare versions

VCS - Features

VCS - Features

VCS - Features

VCS - Features
Restore a version

VCS - Features
Restore a version

VCS - Features
Tags

VCS - Features
Tags
- Snapshot of consistent set of versioned objects

VCS - Features
Tags
- Ready for promotion Deployment Archive

VCS - Features
Tags
- or for branching

VCS - Features
Tags
- or for branching
- Created from

VCS - Features
Tags
- or for branching
- Created from
Whole repository (Full Tag)

VCS - Features
Tags
- or for branching
- Created from
Whole repository (Full Tag)
Selected Objects and
dependencies (Partial Tag)

VCS - Features
Branches

VCS - Features
Branches
- Created from a Tag

VCS - Features
Branches
- Populate a new environment Master and Work repository

VCS - Features
Branches
- For a new feature or a new team

VCS - Features
Branches
- For a new feature or a new team
- Can be merged back in the trunk

VCS - Features

VCS - Features

VCS - Features

VCS - Features

VCS - Features

VCS - Features

VCS - Working on multiple releases
Trunk

New features for Release 1
Trunk

Trunk 1

Trunk 1 2

Trunk 1 2 3

New features for Release 1 Bug Fixes for Release 1
Trunk 1 2 3

Trunk 1 2 3
Branch 1

Trunk 1 2 3
Branching
Branch 1 4

Trunk 1 2 3
Branching
Branch 1 4

Trunk 1 2 3 5
Branching
Branch 1 4

Trunk 1 2 3 5
Branching
Branch 1 4 6

Trunk 1 2 3 5
Branching
Branch 1 4 6 7

Trunk 1 2 3 5 8
Release 1
Branching
Branch 1 4 6 7

Trunk 1 2 3 5 8
Release 1
Branching
Branch 1 4 6 7 9

Trunk 1 2 3 5 8 10
Release 1
Branching Merging
Branch 1 4 6 7 9

New features for Release 1 Bug Fixes for Release 1 New features for Release 2
Trunk 1 2 3 5 8 10
Release 1
Branching Merging
Branch 1 4 6 7 9

New features for Release 1 Bug Fixes for Release 1 New features for Release 2
Trunk 1 2 3 5 8 10 11
Release 1
Branching Merging
Branch 1 4 6 7 9

VCS - Working with different cycles
Trunk

Trunk 42

Trunk 42
Branch 1

Trunk 42
Branching
Branch 1 43

Trunk 42
Branching
Branch 1 43 44

Branch 2
Trunk 42
Branching
Branch 1 43 44

Branch 2 45
Branching
Trunk 42
Branching
Branch 1 43 44

Branch 2 45
Branching
Trunk 42
Branching
Branch 1 43 44 46

Branch 2 45
Branching
Trunk 42 47
Branching Merging
Branch 1 43 44 46

Branch 2 45 48
Branching Merging
Trunk 42 47
Branching Merging
Branch 1 43 44 46

Branch 2 45 48 49
Branching Merging
Trunk 42 47
Branching Merging
Branch 1 43 44 46

Branch 2 45 48 49
Branching Merging
Trunk 42 47
Branching Merging
Branch 1 43 44 46 50

Branch 2 45 48 49 51
Branching Merging
Trunk 42 47
Branching Merging
Branch 1 43 44 46 50

Branch 2 45 48 49 51
Branching Merging Merging
Trunk 42 47 52
Branching Merging
Branch 1 43 44 46 50

Branch 2 45 48 49 51
Trunk 42 47 52
Branch 1 43 44 46 50 53

Branch 2 45 48 49 51 54
Trunk 42 47 52
Branch 1 43 44 46 50 53

Branch 2 45 48 49 51 54
Trunk 42 47 52
Branch 1 43 44 46 50 53 55

Branch 2 45 48 49 51 54
Branching Merging
Trunk 42 47 52
Branching Merging
Branch 1 43 44 46 50 53 55

Branch 2 45 48 49 51
Branching Merging
Trunk 42 47 52
Branching Merging
Branch 1 43 44 46
Branch 3 50

Branch 2 45 48 49 51
Branching Merging
Trunk 42 47 52
Branching Merging
Branch 1 43 44 46 Branching
Branch 3 50

Summary
ODI - Deployment Archives
- Promote, Rollback and keep track of your code

- For development or execution-only environment
- Easy for Developers and Release Managers
- Can be automated
ODI - VCS
- Be able to get back to any version to object

- Branching for Team development
- Cannot be automated

Further Reading / Testing
ODI Lifecycle
- Managing versions in SVN

https://blogs.oracle.com/dataintegration/entry/oracle_data_integrator_12_21
- Parallel Development using SVN Branches

https://blogs.oracle.com/dataintegration/entry/oracle_data_integrator_12_22
- ODI Getting Started VM 12.2.1

http://www.oracle.com/technetwork/middleware/data-integrator/odi-
demo-2032565.html

Questions?

Manage Your ODI Development Cycle: Jerome Francoisse ODTUG Webinar January 2016

Hochgeladen von

Dokumentinformationen

Originalbeschreibung:

Originaltitel

Copyright

Verfügbare Formate

Dieses Dokument teilen

Dokument teilen oder einbetten

Freigabeoptionen

Stufen Sie dieses Dokument als nützlich ein?

Sind diese Inhalte unangemessen?

Copyright:

Verfügbare Formate

Manage Your ODI Development Cycle: Jerome Francoisse ODTUG Webinar January 2016

Hochgeladen von

Copyright:

Verfügbare Formate

Manage Your ODI Development Cycle

Jerome Francoisse | ODTUG Webinar | January 2016

Consultant for Rittman Mead

Providing ODI support on OTN Forums

ODI 12c Beta Program Member

info@rittmanmead.com www.rittmanmead.com @rittmanmead 3

Optimizing your investment in Oracle Data Integration

info@rittmanmead.com www.rittmanmead.com @rittmanmead 4

info@rittmanmead.com www.rittmanmead.com @rittmanmead 6

Having good developers is great

info@rittmanmead.com www.rittmanmead.com @rittmanmead 6

Having good developers is great

info@rittmanmead.com www.rittmanmead.com @rittmanmead 6

Having good developers is great

info@rittmanmead.com www.rittmanmead.com @rittmanmead 6

Having good developers is great

info@rittmanmead.com www.rittmanmead.com @rittmanmead 6

Having good developers is great

info@rittmanmead.com www.rittmanmead.com @rittmanmead 6

Having good developers is great

info@rittmanmead.com www.rittmanmead.com @rittmanmead 6

info@rittmanmead.com www.rittmanmead.com @rittmanmead 7

- Designer Navigator Security

- Operator Navigator Topology

ODI Console (web-based interface)

info@rittmanmead.com www.rittmanmead.com @rittmanmead 8

info@rittmanmead.com www.rittmanmead.com @rittmanmead 9

info@rittmanmead.com www.rittmanmead.com @rittmanmead 9

info@rittmanmead.com www.rittmanmead.com @rittmanmead 9

info@rittmanmead.com www.rittmanmead.com @rittmanmead 9

info@rittmanmead.com www.rittmanmead.com @rittmanmead 9

info@rittmanmead.com www.rittmanmead.com @rittmanmead 9

Work Repository Execution Repository

info@rittmanmead.com www.rittmanmead.com @rittmanmead 10

Projects Execution Execution

Work Repository Execution Repository Execution Repository

info@rittmanmead.com www.rittmanmead.com @rittmanmead 11

Master Repository Master Repository

Projects Execution Execution

Work Repository Execution Repository Execution Repository

info@rittmanmead.com www.rittmanmead.com @rittmanmead 12

Security Security Security

Master Repository Master Repository Master Repository

Projects Execution Execution Execution

Work Repository Execution Repository Execution Repository Execution Repository

info@rittmanmead.com www.rittmanmead.com @rittmanmead 13

Security Security Security

Master Repository Master Repository Master Repository

Projects Execution Execution Projects Execution

info@rittmanmead.com www.rittmanmead.com @rittmanmead 14

Security Security Security

Master Repository Master Repository Master Repository

Projects Execution Execution Execution Projects Execution

info@rittmanmead.com www.rittmanmead.com @rittmanmead 15

Security Security Security Security Security

Topology Topology Topology Topology Topology

Projects Execution Execution Projects Execution

info@rittmanmead.com www.rittmanmead.com @rittmanmead 16

info@rittmanmead.com www.rittmanmead.com @rittmanmead 17

info@rittmanmead.com www.rittmanmead.com @rittmanmead 17

info@rittmanmead.com www.rittmanmead.com @rittmanmead 17

Execution Repository Work Repository