Enterprise Manager Snap Clone

Snapshot your data without snapping your storage

Subhadeep Sengupta
Principal Product Manager

Bala Kuchibhotla
Senior Director of Development

September 2014

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for
information purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied upon
in making purchasing decisions. The development, release, and timing of any features or
functionality described for Oracle’s products remains at the sole discretion of Oracle.

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 2

Session Abstract
CON8122
Are database refresh challenges causing you to miss projects deadlines? Is your storage
cost for dev/test environments spiraling out of control? In this session, you will learn
how the Snap Clone feature of Oracle Cloud Management Pack for Oracle Database
• Can refresh production databases after masking and subsetting
• Can enable instant cloning of large databases (TBs) while saving more than 90 percent
on storage costs
• Fits perfectly with your existing investments in storage, servers, and engineered systems
• Is being used by other customers for large-scale environments

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 3

Program Agenda

1 Current Challenges
2 EM 12c Solution
3 Summary

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

A Large Financial Institution – Storage Challenges
Average Storage Team: “We haveEstimated
50 PB SAN. Annual OP
Number Average Number of Estimated
Annual growth has ranged from
1 - 20-35%”
3 Years
Ave
SPARC
Oracle DB x86 of DB Size Non-prod Storage (GB) Non Production Per En
Applications Team: “1300 Apps
Size Applications (GB) Environments Requirements Environments Per A
are utilizing private Cloud”
Very Small (less < 1 TB) 1,400 300 5 2,100,000 $13,860,000
Small (1TB to 5TB) 500 3,000 5 7,500,000 $49,500,000 $
Medium (5TB to 10TB) 75 7,500 7 Database
3,937,500 Team: “delivering
3 – 5$25,987,500
Years $
Large (10TB to 15TB) 25 12,500 7 test data for UAT is a focus
2,187,500 for private Cloud
$14,437,500 $
Very Large (>15TB) 20 20,000 7 this year ”
2,800,000 $18,480,000 $
Total: 2,020 18,525,000 $122,265,000 $

Storage Cost / GB = $6.6/year

5 to 7 non-prod clones per production database
Estimated Annual Storage OPX
18 of 30 PB for non-prod Oracle environments Cost “$198M/year” for Oracle
$122M of $198M for non-prod clones Environments

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Process Challenges

60000 RMAN “Database Refresh

refresh/year full clones is a
necessary evil!”
2000+ 10 - 20
Dev/Test DB issues/day - Christian Bilien,
Global Head of
Database Team
3 – 5 TB EMC & NetApp
Typical DB size storage

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Evolution of Solutions

Point Features Point Tools EM Solution

 Storage level:  VM cloning  Technology
snapshot, agnostic
volumn/lun thin  DB cloning using
clone, dedupe, smart file systems  End-to-End
compression, etc automation from
× Limited focus on prod to test/dev
× Lacked DB or just cloning
application context  Designed for DBAs
× Lacked lifecycle
× Does not solve management of  Complete mgmt of
process problem clones clones - masking,
performance,
patch/upgrade, etc

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

EM Solution – Data Lifecycle Management (DLM)

Supports full and thin database clones

Technology Agnostic
End-to-End Automation – Prod to Test/Dev
Designed for DBAs
Integrated Masking, Subsetting, Patch, etc
Available via Admin Flows and Self Service portal
EMCLI and REST API for integrations

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Strong Investment in EM’s Data Cloning Solution

EM 12c R2 EM 12c R3 EM 12c R4 EM 12c R4+

• Snap Clone for • Snap Clone using

NAS storage – CloneDB
NetApp & Sun • Data Guard Standby
ZFSSA as a Test Master
• RMAN backup • NetApp Ontap 8.x
based clones • Snap Clone using cluster mode • Data Lifecycle Management
• Snap Clone Solaris File System • Certification for Engg • Snap Clone using EMC SAN
Analyzer to show (ZFS) systems, I/O over IB and ASM
storage savings • Snap Clone for PDBs • Support for NFSv4 • Admin flows for test master
(Admin Flows) creation
• Integration with masking,
patching, upgrades, etc
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal 9
Technology Agnostic
Data Lifecycle Management

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Supported Cloning Options

Full Clones Snap (Thin) Clones

Database Native [Storage Agnostic] Software Solution [Vendor Agnostic]

RMAN RMAN
Data Pump
Restore Duplicate

Hardware Solution [Vendor Specific]

• Leverage your existing investments
• Cater to both functional and stress testing needs NAS SAN
• Maximize for best performance

Use Snap Clone whenever you need >1 clones!

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Snap Clone using Solaris File System (ZFS)
• Uses a single stock Solaris 11.1+ image – physical or virtual [and NOT the
Sun ZS3 Appliance ]
• Supports any storage type – NAS or SAN
• For SAN, mount LUNs as raw disk and format with ZFS filesystem
• Does NOT require the snapshot/clone licenses from the storage vendor,
these features are available for free
• Additional features include compression, de-duplication, IO caching, etc
• HA has to be handled externally either via Solaris Clusters, or by using HA
features of the underlying hypervisor

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Solaris File System with SAN Storage Network Diagram

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 13
CloneDB using DNFS
• Ability to create thin databases from • Advantages
RMAN image copies – Easy to setup
• Uses NFS v3 client embedded in
database
• Supported configurations
– Single instance databases
– Note: Only file system support for this
setup (No ASM)
• Supported Versions: 11.2.0.3+, 12.1
– No special storage software needed
– Works on all platforms
– Time efficient: Instantaneous cloning
– Space efficient: Create multiple clones
based on one backup
– Uses dNFS to improve performance,
high availability, and scalability of NFS
storage

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Snap Clone on ASM + EMC Storage
• Ability to create ‘live’ thin clones of
databases on ASM
• Live Clone: NOT snapshot based, but
a live clone of DB
• Clone can be within the same or on
a different cluster
• EMC VMAX (with Time Finder
VPSnap) and VNX storage appliances
• Supported configurations: SI and
RAC
• Supported Versions: DB = 10.2.0.5 or
higher; GI = 11.2 and higher

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

End to End Automation
Data Lifecycle Management

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 16
Data Movement
Production Test Master
Database Masking & Database
Sub setting
NAME SSN SALARY
NAME SSN SALARY
AGUILAR 203-33-3234 40,000
MILLER 112-23-4567 40,000
BENSON 323-22-2943 60,000
SMITH 111-22-3333 60,000
010110011
101001010
000111010

Data Guard Standby

Prod DB Backups Mask / Subset Test Master Clones

Refresh
Refresh

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Data Movement
Activity Breakdown

• Prod DB – Identify production database for cloning

• Backups – Take regular backups [RMAN, datapump exports, etc]

• Mask / Subset – Mask sensitive data. Optionally, subset to reduce storage footprint

• Test Master – Sanitized copy of production data for use in dev / test environments OR
a Data Guard Standby database

• Clones – Full clones for performance / stress testing; snap clones for functional testing

• Refresh - Keep in sync with data changes in production

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 18
 Deployment Scenarios
Snap Clones using Standby

Private backups
(snapshots) for SSA
user
Production Continuous or Discrete Replication Standby / Test
Database Master Database

Replication Types:
Continuous Discrete
Technology Data Guard, Golden Gate RMAN, Snap Mirror, import/export …

Data Refresh Automatic and instantaneous Manual and at scheduled intervals

Masking and Not possible At source (in production), or in place at test master
Subsetting

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

DB Clone and Refresh – Admin Flow
Production Test Master
Database Masking & Database
Sub setting
NAME SSN SALARY
NAME SSN SALARY
AGUILAR 203-33-3234 40,000
MILLER 112-23-4567 40,000
BENSON 323-22-2943 60,000
SMITH 111-22-3333 60,000

• Enable direct clones from production databases • Works with patched or upgraded binary

• Provide automation to refresh the clone with data • If using clone as test master, allow self service users to
changes in production refresh existing clones with new data

• Works for storage snapshots, RMAN backups, data • Reduce administrative overhead
pump exports, etc

• Include masking & subsetting

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 20
DB Clone and Refresh – Admin Flow
Mask

Production Database Subset Clone / Test Master

Update [Patch or Upgrade]
Change Configuration [SI / RAC]
Snap Clone
Use as Test Master

Version: 11.2.0.3 Version: 11.2.0.4

Config: 3 Node RAC Config: Single Instance
Data: RMAN Backup1 Data: RMAN Backup1
t0 t1 t2 …. tN
RMAN Backup / Data Pump / Storage Snapshot

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle Confidential – 2
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle Confidential – 2
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle Confidential – 2
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
 Full or Snap Clone: How it Works?

Scheduled or Manual Storage Snapshots or RMAN Backups of the test master database, called Profiles

Standby / t0 t1 t2 …. tN
Test Master

Test master is
regularly
refreshed with
current data Clones
from production • Clones can be created from any
profile
Private backups
• Each user gets a personal read-
write database clone

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Self Service Provisioning and Service Catalog

• Out-of-box self service portal

• Catalog of different database configuration with
varied datasets
• Resource quota based on role
• Integrated monitoring, snapshot/rollback, etc

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Complete APIs for Automation or Integration

 Request DBs
 List Zones
 List Service Templates List Deploy  Request PDBs
 Request Schemas
 List Service Instances
 Track request progress
DBaaS
Portal & API
 Service Control (start/stop)

 Delete Service  Backup

 Extend reservation Delete Manage  Restore

 Snapshot
 Get Chargeback info

DBaaS Providers:
• CRUD on Zones / Pools / Service templates / Profiles / Quota / etc

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Complete REST API for Automation or Custom Portals
POST :
https://example.oracle.com/em/cloud/dbaas/zone/82CF1C28FA20A18
3C99D138FF8065F19
Authorization: basic ZGVtb3VzZXI6ZGVtb3VzZXI=
Content-Type:
application/oracle.com.cloud.common.DbPlatformInstance+json
Accept:
application/oracle.com.cloud.common.DbPlatformInstance+json
Body:
{
"based_on":
OR "/em/cloud/dbaas/dbplatformtemplate/CC3BBB665A6BC6FFE040F00AEF
252456",
"name": "<Request name>",
"description": "<Request Description>",
"params":
{ "username": "Master Account username for the DB",
"password": "Password for the Master Account on the DB"
Out of box Self Service Portal }
}

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Snap Clone Vs Competition
 Scale, Scale, Scale
 Supports 1 to 1000s of clones
 Protects your existing investments
 Choice between hardware and software solution
 Use of trusted technologies like data guard for test master refresh
 Part of Enterprise Manager 12c
 Oracle’s flagship management product for all your database needs
 In sync with DB releases (support for PDBs on day 1)
 Secure and role based access control; used by Fortune 1000 customers
 Protection from unnecessary point tools; reduce TCO

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

 Snap Clone with Oracle Engineered Systems
External Storage
Exadata
• Compute nodes are used to run snap
clone databases
Test Master
• The storage is external to Exadata Database
and served over NFS
• In case of ZS3 storage, all traffic over /source [nfs]
infiniband
010110011
SuperCluster 101001010
000111010
• Solaris Zones or LDOMS used to run /clone1 [nfs]
snap clone databases
• Embedded ZS3-ES storage served
over infiniband
/clone2 [nfs]
Oracle Virtual Compute Appliance
• Oracle VMs used to run snap clone
databases
.. more
• Embedded ZS3-ES storage served
over infiniband Enterprise Manager
12c

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Cloud Management Pack for Oracle Database Summary
Self-Service Provisioning Supports Databases, Schema, and PDBs

Database Cloning Full clones and Snap Clones (thin clones)

Role based, Single catalog, to enforce

Enterprise-wide Service Catalog
standardization across the DB estate

Quota and Policy based Management Enforces governance and control

Metering, Chargeback Supports Database, Schema, and PDBs

Comprehensive REST and EMCLI APIs For all self service and admin functions

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

References

• Enterprise Manager Page on O.com

• Cloud Management Page on OTN

• Cloud Administration Guide (Documentation)

• MOS Note: EM12c Recommended Plug-Ins and Patches for DBaaS

(1549855.1)

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |