Oracle GoldenGate

Oracle's strategic solution for real time data integration

SPREKER E-MAIL DATUM

Jos van den Oord : Jos.van.den.Oord@transfer-solutions.com : 29 november 2011

: WWW.TRANSFER-SOLUTIONS.COM

Who am I
Jos van den Oord
Working with Oracle products since 1998 Working at Transfer-Solutions since 2010

Interests
Databases
Right Availability Security, Performance

Blog : joordsblog.vandenoord.eu Email : jos.van.den.oord@transfer-solutions.com

COPYRIGHT TRANSFER SOLUTIONS B.V.

Agenda
Introduction Oracle GoldenGate (OGG)
GoldenGate Topologies GoldenGate Intergration solutions GoldenGate Products

Technology Overview GoldenGate

Simple, Flexible Instantiation GoldenGate Modular Building Blocks GoldenGate Capture/Delivery GoldenGate Checkpointing

Architecture Process Components Demo GoldenGate

COPYRIGHT TRANSFER SOLUTIONS B.V. 3

Introduction Oracle GoldenGate (OGG)

Oracle GoldenGate provides low-impact capture, routing, transformation, and delivery of transactional data across heterogeneous environments in real time Oracles real-time data movement solution
Data replication for heterogeneous databases
Real-time information feeds to Oracle BI/EPM Zero-downtime migrations and upgrades to Oracle Database and Applications

COPYRIGHT TRANSFER SOLUTIONS B.V.

Introduction Oracle GoldenGate (OGG)

GoldenGate Topologies
Unidirectional Bi-directional Peer to Peer

Broadcast

Intergration / Consolidation Cascading

COPYRIGHT TRANSFER SOLUTIONS B.V.

Introduction Oracle GoldenGate (OGG)

Databases
Capture: Oracle DB2 Microsoft SQL Server Sybase ASE Ingres Teradata Enscribe SQL/MP SQL/MX Delivery: All listed above MySQL, HP Neoview, Netezza, and any ODBC compatible databases ETL products JMS message queues

O/S and Platforms

Windows 2000, 2003, XP Linux Sun Solaris HP NonStop HP-UX HP TRU64 HP OpenVMS IBM AIX IBM z/OS

COPYRIGHT TRANSFER SOLUTIONS B.V.

Introduction Oracle GoldenGate (OGG)

Product / License Description

Heterogeneity Oracle GoldenGate

Supports Afb Overview Includes GoldenGate Capture,

Deliver, Active Data Guard and XStream Oracle GoldenGate for Mainframe Includes GoldenGate Capture and Deliver for HP NonStop and IBM DB2 on z/OS Add-on capability to validate data in Oracle GoldenGate Veridata replicated systems

Management Pack for GoldenGate Add-on management pack, includes

Oracle GoldenGate Director

Oracle GoldenGate Adapters

Pre-packaged application content, such as for Flat File and Java adapters

COPYRIGHT TRANSFER SOLUTIONS B.V.

Technology Overview GoldenGate

OGG Modular Building Blocks
Capture: Committed changes are captures ( and can be filtered) As they occur by reading the transaction logs Trail files: Universal data format enables heterogeneity Route: No Distance constraints via TCP/IP. Compression & encryption. Delivery: Applies transactional data with guaranteed integrity

Logs Logs Logs

Capture

Trail Files

LAN/WAN TCP/IP

Trail Files

Deliver

Logs Logs Logs

Database Deliver Trail Files Trail Files Capture

Database

Bi-directional
COPYRIGHT TRANSFER SOLUTIONS B.V.

Technology Overview GoldenGate

Simple, Flexible Instantiation
Start Change Data Capture (CDC) Initial Snapshot Synchronization

Redolog

Capture
Trail Files Database

Data Pump

LAN/WAN TCP/IP
Ongoing Data Synchronization Initial Load

Collector Trail Files

Delivery

Database

COPYRIGHT TRANSFER SOLUTIONS B.V.

Technology Overview GoldenGate

Oracle GoldenGate Capture

COPYRIGHT TRANSFER SOLUTIONS B.V.

10

Technology Overview GoldenGate

Oracle GoldenGate Delivery

COPYRIGHT TRANSFER SOLUTIONS B.V.

11

Technology Overview GoldenGate

GoldenGate Checkpointing
Start of Oldest Open (Uncommitted) Transaction Capture
---------------

Current Write Position

Position

Current Read Position

Database Capture Trail Files Data Pump Trail Files Delivery

COPYRIGHT TRANSFER SOLUTIONS B.V.

---------------

---------------

Begin TX1 Insert TX1 Begin TX2 Update TX1 Insert TX2 Commit TX2 Begin TX3 Insert TX3 Begin TX4 Commit TX3 Delete TX4

Checkpoint

PUMP Checkpoint

Delivery Checkpoint

Begin TX2 Insert TX2 Commit TX2 Begin TX3 Insert TX3 Current Commit TX3 Read

Begin TX2 Insert TX2 Commit TX2

Current Write Position Current Read Position

Database Database

12

Architecture Process Components

CAPTURE
Log-based VAM-based Local/Remote Queuing Filtering Parallel Coordination Local/Remote

DELIVERY
Native database API ODBC Batch Operations Filtering Transaction/Operations Grouping Parrallel Coodination Local/Remote

PUMP
Filtering Local/Remote TCP/IP Compression Encryption

MANAGER
Queue (Trail) Management Process Management (Dynamic) Monitoring and Administration (Lag report) Reporting (Events, Error, Tresholds) Receive/Route request from UI

On disk Components
Trail Files Checkpoint files (Capture, Pump, Delivery) Configuration Files Discard files Report/Log files Binaries
COPYRIGHT TRANSFER SOLUTIONS B.V. 13

Demo GoldenGate
Manager process Extract process DataPump Process Replicat Process Bi-Directional Replication DDL Bi-Directional Replication Extract /Replicat Filtering Logdump SQL statements van replicat

COPYRIGHT TRANSFER SOLUTIONS B.V.

14

Point of Interest for Oracle GoldenGate

Oracle's strategic solution for real time data integration

SPREKER E-MAIL DATUM

Jos van den Oord : Jos.van.den.Oord@transfer-solutions.com : 29 november 2011

: WWW.TRANSFER-SOLUTIONS.COM

Point of Interest for Oracle GoldenGate

Requirements and Planning

Understanding of the business objectives Approved by your stakeholders? Understanding of the requirements? Appropriate replication topology

COPYRIGHT TRANSFER SOLUTIONS B.V.

16

Point of Interest for Oracle GoldenGate

Installation and Setup

Creating Dedicated Users Encrypting Passwords Creating a Dedicated Installation Directory Using a Checkpoint Table Verifying the Character Sets Developing Naming Standards Using a Data Pump

COPYRIGHT TRANSFER SOLUTIONS B.V.

17

Point of Interest for Oracle GoldenGate

Management and Monitoring

Using GGSCI Command Shortcuts Using OBEY Files Generating Interim Statistics Using a Discard File Reporting Regularly on Process Health Purging Old Trail Files Regularly Automatically Starting Processes

COPYRIGHT TRANSFER SOLUTIONS B.V.

18

Point of Interest for Oracle GoldenGate

Performance

Running Performance Tests Limiting the Number of Extracts Using Passthru Mode for Data Pumps Using Parallel Replicats Using the Fastest Available Storage Tuning the Database

COPYRIGHT TRANSFER SOLUTIONS B.V.

19

Questions Answers

CONSULTING | MANAGED SERVICES | EDUCATION

WWW.TRANSFER-SOLUTIONS.COM
COPYRIGHT TRANSFER SOLUTIONS B.V. 20