Sie sind auf Seite 1von 132

Oracle 11gR2 Clusterware Upgrade on HPUX

A Success Story

Presented by : Syed Jaffer Hussain

Slide # 1

Disclaimer

This views/content in this slides are those of the author and do not necessarily reflect that of Oracle Corporation and/or its affiliates/subsidiaries. The material in this document is for informational purposes only and is published with no guarantee or warranty, express or implied.. This material should not be reproduced or used without the authors' written permission.

Presented by : Syed Jaffer Hussain

Slide # 2

Foreword

The goal of this presentation is to explain you the best practices that we had adopted/followed/practiced to upgrade successfully our FOUR Oracle 10.2.0.4 clusterware environments to Oracle 11g R2 on HPUX Servers.

Presented by : Syed Jaffer Hussain

Slide # 3

What will be covered


o o o o o o o o o o o Why upgrade? Upgrade compatibility matrix. Upgrade pattern [best practices]. Introduction to our setup. Prepare for upgrade. Clusterware and ASM upgrade. 11gR2 RDBMS software installation. Database upgrade. Post upgrade steps. Upgrade aftermath stories. References.

Presented by : Syed Jaffer Hussain

Slide # 4

Know your presenter


Syed Jaffer Hussain Database Support Manager 20 years IT experience 11+ years as an Oracle DBA Oracle ACE Director Oracle 10g Certified Master(OCM) Oracle 10g RAC Certified Expert OCP v8i,9i,10g & 11g ITIL v3 Foundation Certified Authored Oracle 11g R1/R2 Real Application Clusters Essentials Twitter: @sjaffarhussain http://jaffardba.blogspot.com

Presented by : Syed Jaffer Hussain

Slide # 5

What will be covered


o o o o o o o o o o o WHY upgrade? Upgrade compatibility matrix. Upgrade pattern [best practices]. Overview of our setup. Prepare for upgrade. Clusterware and ASM upgrade. 11gR2 RDBMS software installation. Database upgrade. Post upgrade steps. Upgrade aftermath stories. References.

Presented by : Syed Jaffer Hussain

Slide # 6

Why upgrade? A burning question

Is it mandatory to upgrade an existing environment with every Oracle new release?

Presented by : Syed Jaffer Hussain

Slide # 7

Why upgrade?

Presented by : Syed Jaffer Hussain

Slide # 8

Why upgrade?
Situations that perhaps drives you to oppose an upgrade:
 Legacy application.  Doesn t want to take the risk.  Lack of skills and support.

Presented by : Syed Jaffer Hussain

Slide # 9

Why upgrade?
Situations that are likely to drives you to embrace for an upgrade:
    Organization standards. Oracle release support policy. Tantalizing new features. Bug fixes.

Presented by : Syed Jaffer Hussain

Slide # 10

What will be covered


o o o o o o o o o o o Why upgrade? Upgrade compatibility MATRIX. Upgrade pattern [best practices]. Overview of our setup. Prepare for upgrade. Clusterware and ASM upgrade. 11gR2 RDBMS software installation. Database upgrade. Post upgrade steps. Upgrade aftermath stories. References.

Presented by : Syed Jaffer Hussain

Slide # 11

Upgrade compatibility matrix

Courtesy from Oracle Corporation Thanks to Roy Swonger & Mike Dietrich

Presented by : Syed Jaffer Hussain

Slide # 12

Upgrade compatibility matrix

Courtesy from Oracle Corporation Thanks to Roy Swonger & Mike Dietrich

Presented by : Syed Jaffer Hussain

Slide # 13

Upgrade compatibility matrix


Minimum Version of the database that can be directly upgraded to Oracle 11g Release 2 Source Database 9.2.0.8 or higher 10.1.0.5 or higher 10.2.0.2 or higher 11.1.0.6 or higher Target Database 11.2.x 11.2.x 11.2.x 11.2.x

The following database version will require an indirect upgrade path. Source Database ---> Upgrade Path for Target Database--->Target Database
7.3.3 (or lower)-----> 7.3.4 ---> 9.2.0.8 ---->11.2.x 8.0.5 (or lower)----> 8.0.6 ---> 9.2.0.8 ---->11.2.x 8.1.7 (or lower)----> 8.1.7.4---> 10.2.0.4---->11.2.x 9.0.1.3 (or lower)----> 9.0.1.4-- ->10.2.0.4---->11.2.x 9.2.0.7(or lower)---->9.2.0.8---->11.2.x

Presented by : Syed Jaffer Hussain

Slide # 14

What will be covered


o o o o o o o o o o o Why upgrade? Upgrade compatibility matrix. Upgrade pattern [BEST PRACTICE]. Overview of our setup. Prepare for upgrade. Clusterware and ASM upgrade. 11gR2 RDBMS software installation. Database upgrade. Post upgrade steps. Upgrade aftermath stories. References.

Presented by : Syed Jaffer Hussain

Slide # 15

Upgrade pattern [BEST PRACTICE]

UPGRADE Clusterware + ASM

Presented by : Syed Jaffer Hussain

Slide # 16

Upgrade pattern [best practice]

UPGRADE Clusterware + ASM

INSTALL RDBMS Software

Presented by : Syed Jaffer Hussain

Slide # 17

Upgrade pattern [best practice]

UPGRADE Clusterware + ASM

INSTALL RDBMS Software

UPGRADE databases

Presented by : Syed Jaffer Hussain

Slide # 18

Upgrade pattern [best practice]

UPGRADE Clusterware + ASM

INSTALL RDBMS Software

UPGRADE databases

Post upgrade

Presented by : Syed Jaffer Hussain

Slide # 19

What will be covered


o o o o o o o o o o o Why upgrade? Upgrade compatibility matrix. Upgrade pattern [best practices]. Overview of our SETUP. Prepare for upgrade. Clusterware and ASM upgrade. 11gR2 RDBMS software installation. Database upgrade. Post upgrade steps. Upgrade aftermath stories. References.

Presented by : Syed Jaffer Hussain

Slide # 20

Overview of our setup


CISCO Switch

HP Superdome 1 Intel(R) Itanium 2 9000 series

EMC Symmetrix DMX-4

NetBackup 6.5.6

Presented by : Syed Jaffer Hussain

Slide # 21

Overview of our setup


Production 1 Production 2

8 nodes

6 nodes

Non-Production 1

Non-Production 2

7 nodes

3 nodes

Presented by : Syed Jaffer Hussain

Slide # 22

Overview of our setup


Production 1 Production 2

8 nodes
31 databases 51 instances 4 logical processors 22GB Memory Non-Production 1 11 databases 20 instances

6 nodes
3 logical processors 12GB Memory

Non-Production 2

7 nodes
60 databases 80 instances 3 logical processors 16GB Memory 12 databases 20 instances

3 nodes
3 logical processors 12GB Memory

Presented by : Syed Jaffer Hussain

Slide # 23

Overview of our setup


The framework that we have followed for the upgrade

V11.31 V11.23
/var/opt /var/opt

HP UX upgrade from V11.23 TO v11.31

Presented by : Syed Jaffer Hussain

Slide # 24

Overview of our setup


The framework that we have followed for the upgrade

V11.31 V11.23
/var/opt /var/opt

HP UX upgrade from V11.23 TO v11.31

EMC Storage Configuration update

Presented by : Syed Jaffer Hussain

Slide # 25

Overview of our setup


The framework that we have followed for the upgrade

10.2.0.4

11.2.0.2

V11.31 V11.23
/var/opt /var/opt

HP UX upgrade from V11.23 TO v11.31

EMC Storage Configuration upgrade

Clusterware Databases upgrade

Presented by : Syed Jaffer Hussain

Slide # 26

What will be covered


o o o o o o o o o o o Why upgrade? Upgrade compatibility matrix. Upgrade pattern [best practices]. Overview of our setup. Prepare for upgrade. Clusterware and ASM upgrade. 11gR2 RDBMS software installation. Database upgrade. Post upgrade steps. Upgrade aftermath stories. References.

Presented by : Syed Jaffer Hussain

Slide # 27

What will be covered

Preparation is the headstone to every successful installation or upgrade projects.

Presented by : Syed Jaffer Hussain

Slide # 28

Prepare for upgrade prerequisites checks


 Verify: o OS certification for Oracle 11gR2.
o o o o OS kernel, packages. Additional OS groups. Oracle base location. GIH location.

 Set GI home different from OB.  Configure Single Client Access Name(SCAN) o Maximum of 3 IP s (same across nodes).
o DNS round robin resolution. o Must be on the subnet as Public and VIP IP s. o Not recommended to configure in HOSTS file.

 root user access  UNSET the following


o o o o o ORACLE_BASE ORACLE_HOME ORACLE_CRS_HOME TNS_ADMIN ORA_NLS10

Presented by : Syed Jaffer Hussain

Slide # 29

Prepare for upgrade prerequisites checks


 Space: o Additional space for [/u00] mount point. o Enough /tmp space  Back up: o Back up Oracle homes (CRS, ASM)
o Back up Voting disk. o Back up OCR.

 CRS version: o Remember, the crs active and software version


must be the same.
crsctl query crs activeversion crsctl query crs softwareversion

 Nodes readiness:
runcluvfy.sh stage pre crsinst n nodes_list fixup fixupdir <dirname> -verbose

Presented by : Syed Jaffer Hussain

Slide # 30

What will be covered


o o o o o o o o o o o Why upgrade? Upgrade compatibility matrix. Upgrade pattern [best practices]. Overview of our setup. Prepare for upgrade. Clusterware and ASM upgrade. 11gR2 RDBMS software installation. Database upgrade. Post upgrade steps. Upgrade aftermath stories. References.

Presented by : Syed Jaffer Hussain

Slide # 31

Clusterware, ASM upgrade Whats new?


Grid Infrastructure Clusterware Automatic Storage Management (ASM)

Out-of-Place and In-place upgrades

Presented by : Syed Jaffer Hussain

Slide # 32

Clusterware, ASM upgrade

Is it necessary to upgrade Clusterware AND ASM together?

Presented by : Syed Jaffer Hussain

Slide # 33

Clusterware, ASM upgrade


Clusteware + ASM =

no rolling upgrade

Presented by : Syed Jaffer Hussain

Slide # 34

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 35

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 36

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 37

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 38

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 39

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 40

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 41

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 42

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 43

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 44

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 45

Clusterware and ASM upgrade

ORACLE BASE must be different from the SW location

Presented by : Syed Jaffer Hussain

Slide # 46

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 47

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 48

Clusterware and ASM upgrade


Cause :
False warning generated by unpublished CVU bug 10024549

Solution:
The warning can be ignored

Presented by : Syed Jaffer Hussain

Slide # 49

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 50

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 51

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 52

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 53

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 54

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 55

Clusterware and ASM upgrade

Can I run the rootupgrade.sh script in PARALLEL across nodes?

Presented by : Syed Jaffer Hussain

Slide # 56

Clusterware and ASM upgrade

Always run the script on the LOCAL node first.

Presented by : Syed Jaffer Hussain

Slide # 57

Clusterware and ASM upgrade

Always run the script on the LOCAL node first.

Run the script in parallel on all nodes, except the LAST node.

Presented by : Syed Jaffer Hussain

Slide # 58

Clusterware and ASM upgrade

Always run the script on the LOCAL node first.

Run the script in parallel on all nodes, except the LAST node.

Run the script on the LAST node.

Presented by : Syed Jaffer Hussain

Slide # 59

Clusterware and ASM upgrade


rootupgrade.sh
Shuts down the existing clusterware stack.

Brings up the new version clusterware stack.

Up on successfully running the script on the LAST node, the CRS active/release version will set to the new version.

Presented by : Syed Jaffer Hussain

Slide # 60

Clusterware and ASM upgrade

Average rootupgrade.sh execution time on each node was just about 15 min. Took more time on couple nodes, mostly while stopping the existing cluster stack. Look closely for the logs under /u00/app/11.2.0/grid/cfgtoollogs.

Presented by : Syed Jaffer Hussain

Slide # 61

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 62

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 63

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 64

Clusterware and ASM upgrade

Cried for HELP!

Presented by : Syed Jaffer Hussain

Slide # 65

Clusterware and ASM upgrade


Internet

Cried for HELP!

Presented by : Syed Jaffer Hussain

Slide # 66

Clusterware and ASM upgrade


Internet MOS

Cried for HELP!

Presented by : Syed Jaffer Hussain

Slide # 67

Clusterware and ASM upgrade


Internet MOS

Cried for HELP!

ASM alert.log, trace files & log files

Doesn t help much!


Presented by : Syed Jaffer Hussain Slide # 68

Clusterware and ASM upgrade


Life Savior MOS [ID 398374.1]

Presented by : Syed Jaffer Hussain

Slide # 69

Clusterware and ASM upgrade


cd $ORA_ASM_HOME/log/hostname/racg/ora.<hostname>.ASM.asm.log
SQL> ORACLE instance shut down. SQL> Disconnected [PRSR][1]prsr_get_enabled_key: OCR api procr_open_key failed for key DATABASE.ASM.node01.+asm1.ENABLED with 4 [ PRSR][1]OCR error code : 4 [ PRSR][1]OCR error msg : PROC-4: The cluster registry key to be operated on does not exist. 2009-06-23 16:12:26.332: [ RACG][1] [28830][1][ora.node01.ASM1.asm]: prsr_fetch_asm_config() error, rc = 8 2009-06-23 16:12:27.443: [ RACG][1] [28830][1][ora.node01.ASM1.asm]: SQL*Plus: Release 10.2.0.4.0 - Production on Tue Jun 23 16:12:26 2009 Copyright (c) 1982, 2007, Oracle. All Rights Reserved. Enter user-name: Connected to an idle instance. SQL> ORA-01506: missing or illegal database name SQL> Disconnected

Presented by : Syed Jaffer Hussain

Slide # 70

Clusterware and ASM upgrade


What might have gone wrong???
 ASM instance name registered as ASMn instead of +ASMn in the OCR.  Could be due to a manual entry.  GI is very particular about + in contrast to previous cluster version.  Bug 5644904: WRONG ASM KEY PROC-4: THE CLUSTER REGISTRY KEY TO BE OPERATED ON DOES NOT EXIST

Presented by : Syed Jaffer Hussain

Slide # 71

Clusterware and ASM upgrade


Remedy
 Stop ASM and dependent instances.  Remove dependency on ASM instance.  Remove ASM from OCR.  Add ASM back in with + correct name  Add dependency to ASM.  Startup ASM.  Resume the failed step.

Presented by : Syed Jaffer Hussain

Slide # 72

Clusterware and ASM upgrade


In action
      srvctl stop asm n <hostname> srvctl modify instance d DBNAME i <instance_name> -f [do it for all active instances on the node] srvctl remove asm n <hostname> -i <ASM_INSTANCE1> srvctl add asm n <hostname> -i <+ASM_INSTANCE1> -o <ORA_ASM_HOME> srvctl modify instance d <DBNAME> -i <instance_name> -s +ASM_INSTANCE1 [do it for all active instances on the node] srvctl start asm n <hostname>

Presented by : Syed Jaffer Hussain

Slide # 73

Clusterware and ASM upgrade


In action
      srvctl stop asm n <hostname> srvctl modify instance d DBNAME i <instance_name> -f [do it for all active instances on the node] srvctl remove asm n <hostname> -i <ASM_INSTANCE1> srvctl add asm n <hostname> -i <+ASM_INSTANCE1> -o <ORA_ASM_HOME> srvctl modify instance d <DBNAME> -i <instance_name> -s +ASM_INSTANCE1 [do it for all active instances on the node] srvctl start asm n <hostname>

Repeat on all nodes!!!

Presented by : Syed Jaffer Hussain

Slide # 74

Clusterware and ASM upgrade

Presented by : Syed Jaffer Hussain

Slide # 75

Clusterware and ASM upgrade


Post upgrade checks active/software version
#crsctl query crs activeversion Oracle Clusterware active version on the cluster is [11.2.0.2.0] # crsctl query crs releaseversion Oracle High Availability Services release version on the local node is [11.2.0.2.0]

Presented by : Syed Jaffer Hussain

Slide # 76

Clusterware and ASM upgrade


Post upgrade checks cluster stats across nodes
# crsctl check cluster -all ************************************************************** node01: CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online ************************************************************** node02: CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online ************************************************************** node03: CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online **************************************************************

Presented by : Syed Jaffer Hussain

Slide # 77

Clusterware and ASM upgrade


Post upgrade checks query voting disk
# ocrcheck
Status of Oracle Cluster Registry Version Total space (kbytes) Used space (kbytes) Available space (kbytes) ID Device/File Name Device/File Name is as follows : : 3 : 1051708 : 27048 : 1024660 : 1837247566 : /dev/rdsk/oracle/ocr/ln1/ora_ocr_001 Device/File integrity check succeeded : /dev/rdsk/oracle/ocr/ln1/ora_ocr_002 Device/File integrity check succeeded Device/File not configured Device/File not configured Device/File not configured Cluster registry integrity check succeeded Logical corruption check bypassed due to non-privileged user

Up to FIVE OCR files

Presented by : Syed Jaffer Hussain

Slide # 78

Clusterware and ASM upgrade


Post upgrade checks query voting disk
# crsctl query css votedisk
## -1. 2. 3. STATE ----ONLINE ONLINE ONLINE File Universal Id ----------------3ee7c55614f24fdcfff130e1abf94384 a2c4e40a31f97f4bff6d65d558d03be8 1c9ed71914a54f9bbf55dd1c86048628 File Name Disk group --------- --------(/dev/rdsk/oracle/vote/ln1/ora_vote_001) [] (/dev/rdsk/oracle/vote/ln1/ora_vote_002) [] (/dev/rdsk/oracle/vote/ln1/ora_vote_003) []

Presented by : Syed Jaffer Hussain

Slide # 79

Clusterware and ASM upgrade


Post upgrade checks b/g and daemon processes
#ps -ef |grep d.bin
oracle 14458 oracle 14462 root 14539 oracle 14549 root 14541 root 14732 oracle 14469 oracle 14739 oracle 14535 oracle 14545 root 20675 root 14595 root 13999 root 14533 oracle 20671 oracle 20685 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 15:14:12 ? 15:14:13 ? 15:14:28 ? 15:14:29 ? 15:14:28 ? 15:15:48 ? 15:14:15 ? 15:15:49 ? 15:14:25 ? 15:14:29 ? 15:36:03 ? 15:14:50 ? 15:13:20 ? 15:14:24 ? 15:36:03 ? 0 15:36:03 ? 0:41 /u00/app/11.2.0/grid/bin/oraagent.bin 0:00 /u00/app/11.2.0/grid/bin/mdnsd.bin 0:24 /u00/app/11.2.0/grid/bin/cssdagent 0:01 /u00/app/11.2.0/grid/bin/diskmon.bin -d -f 4:17 /u00/app/11.2.0/grid/bin/orarootagent.bin 7:35 /u00/app/11.2.0/grid/bin/crsd.bin reboot 0:11 /u00/app/11.2.0/grid/bin/gpnpd.bin 3:21 /u00/app/11.2.0/grid/bin/evmd.bin 2:51 /u00/app/11.2.0/grid/bin/gipcd.bin 4:42 /u00/app/11.2.0/grid/bin/ocssd.bin 4:28 /u00/app/11.2.0/grid/bin/orarootagent.bin 3:06 /u00/app/11.2.0/grid/bin/octssd.bin 2:47 /u00/app/11.2.0/grid/bin/ohasd.bin reboot 0:26 /u00/app/11.2.0/grid/bin/cssdmonitor 0:08 /u00/app/11.2.0/grid/bin/appagent.bin 0:26 /u00/app/11.2.0/grid/bin/oraagent.bin

#ps -ef |grep init.d


root 66 0 oracle 8645 15234 root 13977 1 0 Feb 9 ? 0 19:31:02 pts/0 0 15:13:19 ? 0:00 pagetable_init_daemon 0:00 grep init.d 0:00 /bin/sh /sbin/init.d/init.ohasd run

Presented by : Syed Jaffer Hussain

Slide # 80

Clusterware and ASM upgrade


Remember
 You can easily resume/downgrade from a failed or successful upgrade.  Can fall back to the pre 11gR2 version.  You hardly need a 3-step procedure to do that.

Presented by : Syed Jaffer Hussain

Slide # 81

Remove OLD homes


Removing OLD cluster home
Although it s a best practice to keep the OLD_HOME for a while after a successful upgrade, you can use the following to remove the OLD_HOMES.
export ORACLE_HOME=$OLD_HOME ## detach OLD_HOME $OLD_HOME/oui/bin/runInstaller -detachHome -silent -local ORACLE_HOME=$OLD_HOME #confirm $OLD_HOME is removed from central inventory: $OLD_HOME/OPatch/opatch lsinventory -all ## remove files in OLD_HOME manually: /bin/rm -rf $OLD_HOME unset ORACLE_HOME

Presented by : Syed Jaffer Hussain

Slide # 82

What will be covered


o o o o o o o o o o o Why upgrade? Upgrade compatibility matrix. Upgrade pattern [best practices]. Overview of our setup. Prepare for upgrade. Clusterware and ASM upgrade. 11gR2 RDBMS software installation. Database upgrade. Post upgrade steps. Upgrade aftermath stories. References.

Presented by : Syed Jaffer Hussain

Slide # 83

11gR2 RDBMS software installation


Verify the READINESS of the nodes for DB software installation

cluvfy stage -pre dbinst -n node01,node02,node03 -d $ORACLE_HOME verbose

Presented by : Syed Jaffer Hussain

Slide # 84

11gR2 RDBMS software installation

Presented by : Syed Jaffer Hussain

Slide # 85

11gR2 RDBMS software installation

Presented by : Syed Jaffer Hussain

Slide # 86

11gR2 RDBMS software installation

Presented by : Syed Jaffer Hussain

Slide # 87

11gR2 RDBMS software installation

Presented by : Syed Jaffer Hussain

Slide # 88

11gR2 RDBMS software installation

Presented by : Syed Jaffer Hussain

Slide # 89

11gR2 RDBMS software installation

Presented by : Syed Jaffer Hussain

Slide # 90

11gR2 RDBMS software installation

Presented by : Syed Jaffer Hussain

Slide # 91

11gR2 RDBMS software installation

Presented by : Syed Jaffer Hussain

Slide # 92

11gR2 RDBMS software installation

Presented by : Syed Jaffer Hussain

Slide # 93

11gR2 RDBMS software installation

Presented by : Syed Jaffer Hussain

Slide # 94

11gR2 RDBMS software installation

Presented by : Syed Jaffer Hussain

Slide # 95

11gR2 RDBMS software installation

Presented by : Syed Jaffer Hussain

Slide # 96

11gR2 RDBMS software installation

Presented by : Syed Jaffer Hussain

Slide # 97

11gR2 RDBMS software installation

Presented by : Syed Jaffer Hussain

Slide # 98

11gR2 RDBMS software installation

Presented by : Syed Jaffer Hussain

Slide # 99

11gR2 RDBMS software installation

Presented by : Syed Jaffer Hussain

Slide # 100

11gR2 RDBMS software installation

How to manage the pre 11gR2 databases under 11gR2 GIH?

Presented by : Syed Jaffer Hussain

Slide # 101

11gR2 RDBMS software installation


PINNING NODES You need to PIN the nodes in order to run your pre 11gR2 databases UNDER The Grid Infrastructure umbrella.

root@node01: /u00/app/11.2.0/grid/bin # ./crsctl pin css -n node01 node02 node03


CRS-4664: Node usiogd01 successfully pinned. CRS-4664: Node usiogd02 successfully pinned. CRS-4664: Node usiogd03 successfully pinned.

Presented by : Syed Jaffer Hussain

Slide # 102

What will be covered


o o o o o o o o o o o Why upgrade? Upgrade compatibility matrix. Upgrade pattern [best practices]. Overview of our setup. Prepare for upgrade. Clusterware and ASM upgrade. 11gR2 RDBMS software installation. Database upgrade. Post DB upgrade steps. Upgrade aftermath stories. References.

Presented by : Syed Jaffer Hussain

Slide # 103

Database upgrade Caution

Ensure the database backed up thoroughly BEFORE you kick off the db upgrade procedure.

Presented by : Syed Jaffer Hussain

Slide # 104

Database upgrade upgrade paths


UPGRADE

SQL> @catupgrade.sql

RAC aware and most recommended for RAC dbs. Also can be run in silent mode.

Presented by : Syed Jaffer Hussain

Slide # 105

Database upgrade
For a smooth rise, follow the best practice, run @OH_11G/rdbms/admin/utlu112i.sql
********************************************************************** Tablespaces: [make adjustments in the current environment] ********************************************************************** --> SYSTEM tablespace is adequate for the upgrade. .... minimum required size: 788 MB --> UNDOTBS1 tablespace is adequate for the upgrade. .... minimum required size: 43 MB --> SYSAUX tablespace is adequate for the upgrade. .... minimum required size: 566 MB --> TEMP tablespace is adequate for the upgrade. .... minimum required size: 61 MB PURGE DBA_RECYCLEBIN .... must be executed immediately prior to executing your upgrade. . ********************************************************************** Recommendations ********************************************************************** Oracle recommends gathering dictionary statistics prior to upgrading the database. To gather dictionary statistics execute the following command while connected as SYSDBA: EXECUTE dbms_stats.gather_dictionary_stats;

Presented by : Syed Jaffer Hussain

Slide # 106

Database upgrade
As a best practice, run @OH_11G/rdbms/admin/utlu112i.sql
********************************************************************** Components: [The following database components will be upgraded or installed] ********************************************************************** --> Oracle Catalog Views [upgrade] VALID --> Oracle Packages and Types [upgrade] VALID --> JServer JAVA Virtual Machine [upgrade] VALID --> Oracle XDK for Java [upgrade] VALID --> Real Application Clusters [upgrade] VALID --> Oracle Workspace Manager [upgrade] VALID --> OLAP Analytic Workspace [upgrade] VALID --> OLAP Catalog [upgrade] VALID --> EM Repository [upgrade] VALID --> Oracle Text [upgrade] VALID --> Oracle XML Database [upgrade] VALID --> Oracle Java Packages [upgrade] VALID --> Oracle interMedia [upgrade] VALID --> Spatial [upgrade] VALID --> Data Mining [upgrade] VALID --> Expression Filter [upgrade] VALID --> Rule Manager [upgrade] VALID --> Oracle OLAP API [upgrade] VALID

Presented by : Syed Jaffer Hussain

Slide # 107

Database upgrade

Presented by : Syed Jaffer Hussain

Slide # 108

Database upgrade

Presented by : Syed Jaffer Hussain

Slide # 109

Database upgrade

Presented by : Syed Jaffer Hussain

Slide # 110

Database upgrade

Presented by : Syed Jaffer Hussain

Slide # 111

Database upgrade

Listener will be created on all nodes

Presented by : Syed Jaffer Hussain

Slide # 112

Database upgrade

Presented by : Syed Jaffer Hussain

Slide # 113

Database upgrade

Presented by : Syed Jaffer Hussain

Slide # 114

Database upgrade
Note 453903.1 - Enabling and Disabling Oracle Database Vault in UNIX Note 453902.1 - Enabling and Disabling Oracle Database Vault in WINDOWS
$ $ $ $ cd $ORACLE_HOME/rdbms/lib make -f ins_rdbms.mk dv_off cd $ORACLE_HOME/bin relink all

(For RAC installations, run these commands on all nodes.) #cd /u00/app/oracle/product/11.2.0/db_1/rdbms/lib # make -f ins_rdbms.mk dv_off /usr/ccs/bin/ar d /u00/app/oracle/product/11.2.0/db_1/rdbms/lib/libknlopt.a kzvidv.o /usr/ccs/bin/ar cr /u00/app/oracle/product/11.2.0/db_1/rdbms/lib/libknlopt.a /u00/app/oracle/product/11.2.0/db_1/rdbms/lib/kzvndv.o

Presented by : Syed Jaffer Hussain

Slide # 115

Database upgrade

Presented by : Syed Jaffer Hussain

Slide # 116

Database upgrade

Presented by : Syed Jaffer Hussain

Slide # 117

Database upgrade

Presented by : Syed Jaffer Hussain

Slide # 118

Database upgrade

Presented by : Syed Jaffer Hussain

Slide # 119

Database upgrade

Presented by : Syed Jaffer Hussain

Slide # 120

Database upgrade

Presented by : Syed Jaffer Hussain

Slide # 121

Database upgrade

Presented by : Syed Jaffer Hussain

Slide # 122

What will be covered


o o o o o o o o o o o Why upgrade? Upgrade compatibility matrix. Upgrade pattern [best practices]. Overview of our setup. Prepare for upgrade. Clusterware and ASM upgrade. 11gR2 RDBMS software installation. Database upgrade. Post DB upgrade steps. Upgrade aftermath stories. References.

Presented by : Syed Jaffer Hussain

Slide # 123

Database post upgrade list


 Run @utlrp.sql to compile ANY invalid objects.  Run @utlu112s.sql to check post upgrade components status.  Adjust time zone data in the database.  Gather statistics for system and fixed objects.  Amend scripts [if any] to affect the new OH settings.  Verify the database upgrade
srvctl config database d <DBNAME>

 Back up the database.  Modify the COMPATIBLE init. Parameter to 11gR2.

Presented by : Syed Jaffer Hussain

Slide # 124

Database upgrade measuring upgrade

Presented by : Syed Jaffer Hussain

Slide # 125

Database upgrade trivia


 Upgraded over 100 databases successfully using MANUAL and DBUA methods.  Avg. database upgrade time was just about 2 hrs.  Upgrade using DBUA for RAC DB proved a wise decision.  Nearly identical duration between CLI and DBUA upgrade methods.  Duration is typically proportional to the number of installed database components.

Presented by : Syed Jaffer Hussain

Slide # 126

Database upgrade CLI upgrade steps

Courtesy from Oracle Corporation Thanks to Roy Swonger & Mike Dietrich
Presented by : Syed Jaffer Hussain Slide # 127

What will be covered


o o o o o o o o o o o Why upgrade? Upgrade compatibility matrix. Upgrade pattern [best practices]. Overview of our setup. Prepare for upgrade. Clusterware and ASM upgrade. 11gR2 RDBMS software installation. Database upgrade. Post DB upgrade steps. Upgrade aftermath stories. References.

Presented by : Syed Jaffer Hussain

Slide # 128

Upgrade aftermath stories


Snapshot Controlfile must be placed on a shared storage for a RAC database. ORA-24247: network access denied by access control list (ACL)
Solution: UTL_TCP, UTL_HTTP, UTL_SMTP, UTL_MAIL is used grant the privileges explicitly DBMS_NETWORK_ACL_ADMIN.CREATE_ACL ADD_PRIVILEGE ASSIGN_ACL

ASM instance resource status MIGHT turn into INTERMEDIATE with CHECK TIMED OUT state_details [BUG 11807012] Solution: crsctl modify resource ora.asm attr CHECK_TIMEOUT=132 MOS [ID 1323679.1] IMPDP fails with ORA-29913, 31011, 19202, LPX-00217 [BUG 11877267] Solution: no solution workaround exists ORA-07445: exception core dump [evaopn3()] Solution: _simple_view_merge, _complex_view_merging=false

Presented by : Syed Jaffer Hussain

Slide # 129

What will be covered


o o o o o o o o o o o o Why upgrade? Upgrade compatibility matrix. Upgrade pattern [best practices]. Overview of our setup. Prepare for upgrade. Clusterware and ASM upgrade. 11gR2 RDBMS software installation. Database upgrade. Post DB upgrade steps. How to proceed from failed upgrade. Upgrade aftermath stories. References.

Presented by : Syed Jaffer Hussain

Slide # 130

References
 Oracle Database Upgrade Path Reference List [ID 730365.1]  Complete Checklist for Manual Upgrades to 11gR2 [ID 837570.1]  Complete checklist to upgrade the database to 11g R2 using DBUA [ID 870814.1]  Master Note for Real Application Clusters (RAC) Oracle Clusterware and Oracle Grid Infrastructure [ID 1096952.1]  How to Proceed from Failed Upgrade to 11gR2 Grid Infrastructure on Linux/Unix [ID 969254.1]  Oracle Grid Infrastructure 11.2.0.2 Installation or Upgrade may fail due to Multicasting Requirement [ID 1212703.1]  Do You Need to Relink Oracle Clusterware When Upgrading the Operating System? [ID 743649.1]  Oracle 11g R1/R2 Real Application Clusters Essentials  Move to Oracle Database 11g The whole Story blogs.oracle.com/UPGRADE  http://download.oracle.com/docs/cd/E11882_01/server.112/e17222/toc.htm  http://www.oracle.com/technetwork/database/upgrade/index.html  http://oukc.oracle.com/static09/opn/core09/oracle9i_database/95960/060311_95960/index.htm

Presented by : Syed Jaffer Hussain

Slide # 131

A big thank you all for listening ...


You can write me at sjaffarhussain@gmail.com

Presented by : Syed Jaffer Hussain

Slide # 132