Solaris 10 u9+ Live Upgrade from Sol8/9

NOTE: as with all changes check work before making changes that would be difficult to undo.
Summary:
Fail resources over to secondary node. Rebuild bixfr01g to Sol 10 on MROOT. Bring back up
on Sol 9. Fail resources back to primary node from secondary node. Rebuild bixfr02g to Sol 10
on MROOT. Once upgrade is complete on secondary node, take down both nodes and bring
back up on Solaris 10/configure Veritas cluster 5.0/Final step Patch Solaris 10

Hostname / Regional Name:

bic08533/bixfr01g
bic08534/bixfr02g
Application
EDICONNECTDIRECT
IP address
139.76.72.19 bixfr01g
139.76.72.20 bixfr02g
Contact Database Application EDICONNECTDIRECT
MSM Support Level: Application Hosting OS: SunOS 5.9

Bixfr01g
Disk
Name

Size

c1t0d0

72G

/pci@1f,700000/scsi@2/disk@0,0:a

Root disk

OS status on disk
Current OS Disk with
Solaris 9

c1t1d0

72G

/pci@1f,700000/scsi@2/disk@1,0:a

Mirror
disk

Disk to be used for Sol

10 OS

c1t2d0

72G

/pci@1f,700000/scsi@2/disk@2,0:a

Alboot

Bixfr02g
Disk
Name

Size

c1t0d0

72G

/pci@1f,700000/scsi@2/disk@0,0:a

Root disk

OS status on disk
Current OS Disk with
Solaris 9

c1t1d0

72G

/pci@1f,700000/scsi@2/disk@1,0:a

Mirror
disk

Disk to be used for Sol

10 OS

c1t2d0

72G

/pci@1f,700000/scsi@2/disk@2,0:a

Alboot

Hardware Path

Hardware Path

Purpose

Purpose

The objective of the OS upgrade on this box is leaving the current OS untouched. Detach the mirror
disk and repartition the mirror disk. Install new Solaris 10 OS on the mirror disk and boot from the
mirror disk.

Current OS: Solaris 9

Target OS:
Solaris 10
Veritas Volume manager:
Yes
Solaris Volume manager:
Yes
EMC disk & Power path:
Yes
Cluster:
Yes
App. F/S under SVM and VxVM
Broot: No

Pre-Work:
1.
2.

Run /bto/sys/backdata script and upload the output. (Copy backdata script from other server, if it is
not present)
Send mail to BOSIP team to request to change the OS version to Solaris 10 one/two day before. (They
are working on US Day shift Weekdays)

Contact BCS to inform them the servers going to upgraded to Solaris 10 and to change file group type to
Solaris 10. List server regional name, IP address and hostname and sent to bosip.config@bellsouth.com.
Follow email with a phone call to Bosip @ 1-205-988-8828 if required. Ensure BOSIP update is complete
before installing DDS packages on Solaris 10.
3.
4.
5.
6.

Request for the full backup of the box as per the task.
Request EBR team to suspend all backup jobs until we contact them after the upgrade.
Contact DDS team before 24Hrs and let them aware of the DDS tasks.
Update Broot: Update Broot disk one day before. Exclude all application file systems from the
mk_broot.cfg file and rerun the Broot script.

7.

Disable functions
# vi /bto/sys/platform/root_cron/csa_cron - (comment out the following entries)
Broot update script cron entry
Reboot cron entry
SCIM cron entry
# /bto/sys/platform/ bin/merge_crons

8.

For PATROL, the new procedure before the OS is upgraded:

#cd /nas/common/patrol/sapatrol/cb
#./cb_before.sh
Be sure the /bto/sys/bmc/patrol/pasa_prod directory and its contents do not get removed.
Implementation

1.
2.

Disable alarms using NETCOOL (TNG and CAMCS via TNG website)
Detach mirror disk and remove from Disk suite control
Failover the service group to secondary node bixfr02g (bic08534):
hagrp -switch sedbr01 to bic08534

Booted from root disk under Disk suite

# df k / ( Ensure it is booted from md device)

# prtconf -pv |grep bootpath (note the hardware path and verify you are booted from
/pci@1f,700000/scsi@2/disk@0,0:a
(Identify the root D number and the primary and secondary disk from metastat)

SunOS bic08533 5.9 Generic_122300-53 sun4u sparc SUNW,Sun-Fire-V440

# echo |format
(Match the prtconf boot-device physical path with format output of the root disk physical path after ensuring you are booted from the correct root drive)
Detach the mirror from Disksuite
# metadetach d0 d2
# metadetach d10
# metadetach d20
#metadetach d30
#metadetach d40
#metadetach d50 d52

(root)
d12
(swap)
d22
(/var)
d32
(/opt)
d42
(/bto)
(/globaldevices )

# metaroot /dev/dsk/c1t0d0s0 and edit the /etc/vfstab to change disk format from metadevice to
cXtXdXsX format.
# grep md /etc/system
rootdev:/pseudo/md@0:0,0,blk
Comment out the above entry in /etc/system. Use * to comment
3.
4.
5.

After secondary mirror is detached, boot from the root disk and ensure it is still bootable
# init 6
Check if server comes on root disk (Should be in cXtXdXsX format)
Comment all application file systems
# cp -p /etc/vfstab /etc/vfstab.orig.`date`

# vi /etc/vfstab (Remove all application file systems)

Disable functions
# vi /bto/sys/platform/root_cron/csa_cron (comment out the following entries)
Reboot cron entry
Broot update script cron entry
SCIM cron entry
# /bto/sys/platform/ bin/ merge_crons
Make swap as dump devices
# dumpadm -d swap
Check with metastat -p and metadb and verify that all metadevices and metadbs are cleared from the
mirror disk.
Collect output of the following commands
# cp -p /etc/vfstab /bto/csa/vfstab.beforeupgrade
# cp -p /etc/system /bto/csa/system.beforeupgrade
# metastat -p > /bto/csa/metastatp.beforeupgrade
# metadb > /bto/csa/metadb.beforeupgrade
# cp -p /etc/system /bto/csa/system.beforeupgrade
# cp -p /etc/lvm/md.cf /bto/csa/md.cf.beforeupgrade
# cp -p /etc/lvm/mddb.cf /bto/csa/mddb.cf.beforeupgrade
# cp -p /etc/lvm/md.tab /bto/csa/md.tab.beforeupgrade
# grep VERSION /var/sadm/pkg/SUNWmdr/pkginfo
PKG_CLIENT_VERSION=9
VERSION=11.9.0,REV=2002.04.06.15.27
If the version is showing the same above, you should follow the steps, mentioned in the Step: 27 (Restoring
metadevices configurations). Other versions will automatically converted metadbs access by Solaris 10.

Clear metadevices
# metastat -p
# metaclear r d2 d12 d22 d32 d42 d52
# metadb
# metadb -d /dev/dsk/ c1t0d0s7
# metadb -d /dev/dsk/c1t1d0s7 (mroot disk)

6.

Install Solaris 10 Live upgrade packages

Check the LU packages ( current version on system is 11.8)
# pkginfo -l SUNWluu
# pkginfo -l SUNWlur

Remove old LU packages (version 11.8)

# pkgrm SUNWluu
# pkgrm SUNWlur
Install new LU packages (version 11.10)
# cd /bto/sys/csa
# mkdir packages
# chmod 755 packages
# cd packages
# ftp sundepot.bst.bls.com (90.152.52.80)
ftp> cd packages
ftp> binary
ftp> mget SUNWlur.zip SUNWluu.zip
ftp> bye
# unzip SUNWlur.zip
# unzip SUNWluu.zip
# pkgadd -d . SUNWlur
# pkgadd -d . SUNWluu
# pkginfo -l SUNWlur
# pkginfo -l SUNWluu
Check Version 11.10 is installed.
7.

Install Live upgrade Patches

Install the following patches (or higher) for the SUN packages (SUNWluu and SUNWlur) on the current
OS. paClient may not be loaded on the server if this is a new server build. If not loaded, use
patchadd to install patches.
***NOTE***

Do not apply rev 14 of patch 121430 (121430-14) -- instead, apply 121430-13.

Check for Patches. The below example for Solaris 8

# showrev -p | grep "Patch: 108987-15"
# showrev -p |grep 108987 ( check if higher versions exists)
# showrev -p | grep "Patch: 110934-21"
# showrev -p |grep 110934 ( check if higher version exists)
# showrev -p | grep "Patch: 121430-11"
# showrev -p |grep 121430 ( check if higher version exists)
****NOTE***** Dont install 121430 latest patch after the revision 121430-13. It will give error on
lu command in Solaris 8.
Install required patches
# /bto/sys/pa/bin/paClient -p 108987-15 110934-21 121430-11 (Install patches in this order)

# /bto/sys/pa/bin/paDownload.ksh
#/bto/sys/pa/bin/paApply.ksh
Check all application filesystems in /etc/vfstab are commented including /bto
# cat /etc/vfstab
If application filesystems or /bto is not commented out, comment it on /etc/vfstab
8.

Reboot the box even if patch is not installed and boot the box from main root disk.
# init 0
OK> boot
# df -k (Ensure that you are booted from Root disk)

9.

Partition the Solaris 10 target Root disk depending on the specification.

For the following use slice information presently allotted to each disk on each server
# format (the following info is generic and may not be exactly like your disk layout, these at least
represent the minimums so adjust the slices to meet the following)
Need to re-partion the new root disk (old broot)
no need for globaldevices partition in sol 10
/
30g
s0
/swap 4g
s1
/var
6g
s3
/opt
20g
s4
/bto
10g
s5

Current partitions----partition> p
Current partition table (original):
Total disk cylinders available: 14087 + 2 (reserved cylinders)
Part Tag
Flag Cylinders
Size
Blocks
0
root wm
0 - 8452
41.02GB (8453/0/0) 86017728
1
swap wu 8453 - 8855
1.96GB (403/0/0) 4100928
2 backup wu
0 - 14086
68.35GB (14087/0/0) 143349312
3
var wm 8856 - 9458
2.93GB (603/0/0) 6136128
4 unassigned wm 9459 - 11671
10.74GB (2213/0/0) 22519488
5
home wm 11672 - 11731 298.12MB (60/0/0)
610560
6
home wm 11732 - 13944
10.74GB (2213/0/0) 22519488

7 unassigned wm

(0/0/0)

10. Create file system on the Solaris 10 target disk

# newfs /dev/rdsk/c1t1d0s0
# newfs /dev/rdsk/c1t1d0s3
#newfs /dev/rdsk/c1t1d0s4
#newfs /dev/rdsk/c1t1d0s5
11. Edit the LU Sync list

# cd /etc/lu
# cp -p synclist synclist.<date>
# ifconfig -a (Verify the valid network interfaces, and add the /etc/hostname.<interfacename> files in
the synclist file)
# ls -ld /etc/hostname.*
# vi /etc/synclist
/var/mail
OVERWRITE
/var/spool/mqueue
OVERWRITE
/var/spool/cron/crontabs
OVERWRITE
/var/dhcp
OVERWRITE
/etc/passwd
OVERWRITE
/etc/shadow
OVERWRITE
/etc/group
OVERWRITE
/etc/opasswd
OVERWRITE
/etc/oshadow
OVERWRITE
/etc/pwhist
OVERWRITE
/etc/default/passwd
OVERWRITE
/var/log/syslog
APPEND
/var/adm/messages
APPEND
/etc/ftpd/ftpusers
OVERWRITE
/etc/defaultrouter
OVERWRITE
/etc/inet/netmask
OVERWRITE
/etc/defaultdomain
OVERWRITE
/etc/default/init
OVERWRITE
/etc/resolv.conf
OVERWRITE
/etc/nodename
OVERWRITE
/etc/hosts
OVERWRITE
/etc/net/ticlts/hosts
OVERWRITE
/etc/net/ticots/hosts
OVERWRITE
/etc/net/ticotsord/hosts
OVERWRITE
/etc/hostname.hme0
OVERWRITE
/etc/hostname.hme0:1
OVERWRITE
/etc/hostname.qfe2
OVERWRITE
/usr/openv/netbackup/bp.conf
OVERWRITE
12. Establish the new target boot environment

(In this example, the boot disk is c1t1d0s0 and the target disk is c1t0d0s0)
AT this point we can change the slice out of the disks as

# lucreate -c c1t0d0 -n c1t1d0 -s - -m /:/dev/dsk/ c1t1d0s0:ufs m

m -:/dev/dsk/ c1t1d0s1:swap

/var:/dev/dsk/ c1t1d0s3:ufs -

Enter the following command to make sure the new environment installed properly
# lustatus
-- Boot Environment

Is

Active Active

-- Name

Complete Now

Can

Copy

On Reboot Delete Status

-- -------------------------- -------- ------ --------- ------ --------

c1t0d0

--

c1t1d0

yes
no

yes

yes

no

no

no

yes

13. Mount the jumpstart servers /export/install

VARIOUS JUMPSTART SERVER THAT ARE PRESENT ARE GIVEN BELOW AS PER REGION.

# mount 90.144.48.14:/export/install /mnt (Jackson Data center)

# df -k (Ensure that /export/install from jumpstart is mounted)

14. Execute the luupgrade

This will load the flash archive to the target boot environment.
# ls -l /mnt/solaris/jump_servers/flars/gi_SunOS510_B01_09Q3.flar (Verify file exists)
# luupgrade -n c1t1d0 -f -s /mnt/solaris/os/sparc/sol10_01.2006/boot_install -a
/mnt/solaris/jump_servers/flars/gi_SunOS510_B01_09Q3.flar
15. Execute luactivate

Perform the luactivate against the target boot environment.

This command also copy all files specified in the /etc/lu/synclist file
# luactivate c1t1d0
# lustatus

16. Reboot the server

Reboot using init or shutdown command against new boot environment.
# init 6

While booting UP from the new boot environment, if it go to maintenance mode then execute the
following command.
# svcadm clear system/boot-archive
Mount old root disk to /mnt
# mount /dev/dsk/ c1t0d0s0 /mnt
Update the ssh key
# cp -p /mnt/.ssh/auth* /.ssh/
17. Remove old Boot Enviornment

Once the server is up, execute the ludelete command to remove reference to the inactive boot
environment
# df -k (Ensure that it is booting from New disk)
# lustatus (Verify boot environment exists)
# ludelete c1t0d0
# rm /etc/lutab
Remove unwanted directory (Optional)
# cd /export/install
# rm -r solaris (This command can take some time)
Rename /var/svc/profile/name_service.xml /var/svc/profile/name_service.orig (Optional)
# cd /var/svc/profile
# mv name_service.xml name_service.orig

Create a symbolic link for the name service profile.

# ln -s ns_files.xml name_service.xml
# ln -s ns_dns.xml name_service.xml
# ln -s ns_nis.xml name_service.xml
# ln -s ns_nis+.xml name_service.xml
# ln -s ns_none.xml name_service.xml
18. Comparing the files

Check the following files and the files mentioned in the /etc/lu/synclist and edit as needed.
/etc/netmasks
/etc/resolv.conf (usually not on the server)

/etc/inet/hosts
/etc/hosts
/etc/net/ticlts/hosts
/etc/net/ticots/hosts
/etc/net/ticotsord/hosts
/etc/nodename
/etc/hostname.xxx (3 interface cards)
# wc /etc/hosts /mnt/etc/hosts
129 525 4378 /etc/hosts
129 525 4378 /mnt/etc/hosts
258 1050 8756 total
EDIT /etc/net/*/hosts files with appropriate hostname of the server
Compare /etc/passwd and /etc/shadow files.
If word count is different for /etc/passwd and /etc/shadow, then mount the original root disk
and copy the /etc/shadow file over and execute pwconv to sync the two files.
# wc -l /etc/passwd
# wc -l /etc/shadow
# cp -p /mnt/etc/shadow /etc/shadow
# pwconv (to sync shadow and passwd files)

Check Network Speed Setting

# cd /mnt/etc/rc2.d
# ls -l|egrep "ndd|net|tune|shmenic" (Ensure the script is used for network speed setting)
# cp -p /mnt/etc/rc2.d/<filename> /etc/rc2.d/<filename> (for ex: S96net_tune)

19. Copy Home Directory

# ls -l /home
# ls -l /mnt/home
# ls -l /export/home (Dont copy if /export/home is a separate mount point)
# ls -l /mnt/export/home
Verify that which directory has data and retain the only correct data
Some servers have home directories pointing to /export/home and after upgrade; the data retains in
/home. So we need to clean /home directory and restore /export/home from the old root disk.
# cd /home
# rm -r *
Verify with /etc/passwd file to use the correct home directory
Run one of the below - based on which has data /mnt/home or /mnt/export/home
# cd /mnt/export/home

# chmod 755 /export/home

# find . -xdev -depth | cpio -pdumv /export/home
If the data is on /mnt/home
# cd /mnt/home
# chmod 755 /home
# find . -xdev -depth | cpio -pdumv /home
20. Copy TNG Table

# mkdir -p /bto/sys/tng/catmp
# chmod 755 /bto/sys/tng/catmp
# cp -p /mnt/bto/sys/tng/catmp/TNG_tier1_client_config_table /bto/sys/tng/catmp/
21. FORMAT issue

If the command format shows some error messages at the top referring to MD21, then do the following
to fix it.
# cd /etc
# cp -p format.dat format.dat.<date>
# vi format.dat (Comment all entries with MD21 and save the file)
22. Correct the Root shell

# grep root /etc/passwd (Verify the shell has the value /bin/ksh, otherwise correct it)
23. Fix Profile

#cd /
# vi .profile (Ensure PATH=$PATH:.... (Remove the $PATH at the end and put it in the beginning)
# exit (exit and login again)

24. Fix LOCALE

Fix for message local not set correctly. Do the following to fix it, if you are getting this error while
logging.
# cp -p /etc/default/init /etc/default/init.orig
# vi /etc/default/init (Remove all LC entries)

25. Fix NAS

Check the NAS is working

# ls -l /nas/common
#df -k (Ensure nas/common mounted)
If NAS is not working, check the /etc/resolv.conf file and verify there are any unnecessary spaces before any
line start. Remove the spaces and save. Check again NAS
# vi /etc/resolv.conf (Remove any spaces on the starting of any line)

26. Compare CSA Cron

# df -k (Ensure old root is mounted on /mnt, if not mount it)

Compare the entries in /mnt/bto/sys/platform/root_cron/csa_cron and
/bto/sys/platform/root_cron/csa_cron
Add the missing entries and leave it commented (Jobs like reboot/broot update should be left
commented)
Also copy any required cron scripts listed in csa_cron from the old root disk

Make a copy of the /etc/system file

# cp -p /etc/system /etc/system.aftersol10upgrade
Compare /etc/system fie with old /etc/system file and update the kernel parameter (Higher in value)
# diff /mnt/etc/system /etc/system
Remove the unwanted kernel parameter as needed.
Remove Oracle setting kernel commented values - If oracle is not in your box.
For Example following are the kernel parameters may required for the application for reference
set enable_sm_wa=1
set msgsys:msginfo_msgmap=2048
set msgsys:msginfo_msgtql=8192
set msgsys:msginfo_msgmax=65536
set msgsys:msginfo_msgseg=8192
set msgsys:msginfo_msgssz=256
set msgsys:msginfo_msgmnb=65535
set semsys:seminfo_semaem=32767
set semsys:seminfo_semmap=5434
set semsys:seminfo_semvmx=32767
set semsys:seminfo_semopm=100
set shmsys:shminfo_shmmni=16384
set semsys:seminfo_semmns=16624
set msgsys:msginfo_msgmni=8192
set shmsys:shminfo_shmseg=2048
set shmsys:shminfo_shmmin=1
set semsys:seminfo_semmni=5459
set semsys:seminfo_semmnu=4096
set semsys:seminfo_semmsl=2000
set semsys:seminfo_semume=512
set semsys:seminfo_semusz=1024
forceload: sys/msgsys
forceload: sys/shmsys
forceload: sys/semsys

set rstchown=0
set shmsys:shminfo_shmmax=4294967295
set rlim_fd_cur=2048
set rlim_fd_max=4096
set tmpfs:tmpfs_minfree=6400
set pg_contig_disable=1
Note :- Source SUN Doc - 817-0547
Obsolete parameters might be included in the /etc/system file on this Solaris system. If so, the
parameters are used to initialize the default resource control values as in previous Solaris releases.
However, using the obsolete parameters is not recommended.
The following related parameters have been removed. If these parameters are included in the
/etc/system file on this Solaris system, the parameters are commented out.

semsys:seminfo_semmns
semsys:seminfo_semvmx
semsys:seminfo_semmnu
semsys:seminfo_semaem
semsys:seminfo_semume
semsys:seminfo_semusz
semsys:seminfo_semmap
shmsys:shminfo_shmseg
shmsys:shminfo_shmmin
msgsys:msginfo_msgmap
msgsys:msginfo_msgseg
msgsys:msginfo_msgssz
msgsys:msginfo_msgmax

27. Perform post-install tasks

# cd /opt/gi/gi_SunOS510_B01_09Q3/bin
Execute post-install script to perform post-install configuration of DDS software along with other
functions specific to the release. Messages will display as software is processed.
# ./gi_refresh.ksh ../media
Execute the script to validate the gold image content have been installed correctly.
# ./gi_validate.ksh

28. Restoring metadevices configurations

cat /mnt/bto/sys/csa/metadb.beforeupgrade (the following is an example use actual server info)

flags
first blk
block count
a m p luo
16
1034
/dev/dsk/c1t1d0s7
a p luo
1050
1034
/dev/dsk/c1t1d0s7
a p luo
16
1034
/dev/dsk/c1t1d0s7

a p luo

1050

1034

/dev/dsk/c1t1d0s7

29. Clean Reboot

# cp -p /mnt/.ssh/auth* /.ssh/
# umount /mnt
# init 6
# metadb
# metastat -p
30. Install Storage Foundation 5.0 MP3 (Veritas Volume Manager)

Identify your hardware model and get the licence from license document from the SharePoint to match your
hardware.
# /usr/platform/`uname -i`/sbin/prtdiag -v |head -1
Check the document to match the hardware from above command.0
# df -k /opt(Ensure /opt is not a separate file system, if it is a separate then Dont Proceed)
# cp -p /etc/passwd /etc/passwd.03202012vxvm
# cp -p /etc/shadow /etc/shadow.03202012vxvm
# wc -l /etc/passwd /etc/shadow (Ensure the count matches)
Add the following entry at the end of the file /etc/passwd
# vi /etc/passwd
install:x:0:1:installpatch braindamage:/:/bin/true
:wq!
# pwconv
# wc -l /etc/passwd /etc/shadow (Ensue the count matches)
Check if NAS is configured on the box, if yes we can install from the NAS location
# cd /nas/common/veritas/SUN/SF5.0_MP3
# ./installer -precheck
(This will check the installer can able to install the Storage foundation on the box. Select Option 5 for install
storage foundation and look for the messages. The script will print the output SF can be installed on this box
if everything is okay.

Install Storage Foundation

# ./installer
Select
: Install/Upgrade a Product (Option I)
Select
: Veritas Storage Foundation (Option 5)I
Enter System name
: Provide hostname of the box
Enter License Key : Provide License key for SUN E4500/E5500
VRTS STORAGE FOUNDATION STANDARD 5.0
SOL TIER B STD LIC
License Key(s):
3JZG-ZNBY-Z3KB-M3P4-KRHA-PPZP-P
Configure SF

: Select No

Check the version after installation (it should show the version 5.0MP3)
# modinfo |grep -i vx
# pkginfo -l VRTSvxvm
# pkginfo -l VRTSvxfs
Reboot the box
# init 6
Start Veritas Volume manager manually
# rm /etc/vx/reconfig.d/state.d/install-db
# vxiod set 10
# vxconfigd -k -m disable
# vxdctl enable
# vxdctl init `uname -n`
#vxdctl enable
Uncomment Veritas filesystems from the /etc/vfstab
# cp /etc/vfstab /etc/vfstab.VxVM.commented
# cp /etc/vfstab /etc/vfstab.modify
# vi /etc/vfstab.modify
# cp /etc/vfstab.modify /etc/vfstab
Check all the veritas mount points exists, if not create using mkdir command. Compare the
permission and ownership with previous OS (mount the old root disk if needed)
Start all the veritas volumes manually
# vxdg list
# vxvol -g <DGname> startall
# vxprint -th |grep ^v (Check all volumes are ENABLE state)
Mount the veritas file systems with mount command.
# mountall
# df -h (Check and confirm all file systems mounted)
Clean reboot
# init 6
# df -k (Ensure all file systems mounted including veritas file systems)
Again comment all veritas file systems in /etc/vfstab and take a reboot.
# vi /etc/vfstab # cp /etc/vfstab.VxVM.commented /etc/vfstab
grep vx /etc/vfstab
# init 6
# df -k (Ensure no veritas file systems mounted)
31. Veritas 5.0 MP3 Rolling Patch 2 Installation

Stop all veritas volumes on each diskgroup

# vxdg list
# vxvol -g <DGname> stopall
# vxprint -ht |grep ^v (Should be show all volumes on DISABLE & CLEAN state

# vxprint -Aht -e v_open (verify no volumes are remain open)

# /opt/VRTS/bin/vxsvcctrl status (Check the VEA service running)
# /opt/VRTS/bin/vxsvcctrl stop (If VEA service running, Stop the service using this command)

Download the RP2 patches from NAS

# cd /nas/common/veritas/SUN/SF5.0_MP3/RP2
# cp -p 5.0MP3RP2-patches.tar.gz /bto/csa/
# cd /bto/csa
# gunzip 5.0MP3RP2-patches.tar.gz
# tar xf 5.0MP3RP2-patches.tar
Keep in mind Below two will not be installing as per OS version
123200-05 - Sun 5.8
123202-05 - Sun 5.10
123201-05 - Sun 5.9

(Must be Installed)

The following are the lists of patches need to be installed. Use the following order to install. Patches marked in
RED colour is VCS patches and we can ignore if VCS is not installed on the box.
122058-12 -123090-03
123202-05
123722-02
123823-05
139354-01
139358-02
139359-02
139737-01
139739-01
139742-02
139741-02
139743-01
139744-01
139754-02
140657-01
140661-01
141279-01
141745-01
Apply RP2 Patches
# patchadd /bto/csa/patches/volume_manager/patches/140657-01
# cd /bto/csa/patches/storage_foundation/patches
# vi patch_RP2
122058-12
123202-05
123722-02
123823-05

139354-01
139737-01
139739-01
139742-02
139741-02
139743-01
139744-01
140661-01
141279-01
141745-01
wq!
# for i in `cat /bto/csa/patches/storage_foundation/patches/patch_RP2`
> do
> patchadd $i
> echo Patch $i Done
> done
# modinfo |grep -i vx ( Should be showing 5.0MP3 RP2)
Make sure all patches installed
# showrev -p | grep <Patch Number>
Uncomment all fileystem of vxvm:
# vi /etc/vfstab
# cp /etc/vfstab.modify /etc/vfstab
# grep vx /etc/vfstab
# init 6
# df -k (Ensure all filesytems mounted properly)
Check the version is showing 5.0MP3 RP2
# modinfo |grep -i vx
# pkginfo -l VRTSvxvm
# pkginfo -l VRTSvxfs
Remove install entry from /etc/passwd
# vi /etc/passwd
# pwconv
# wc -l /etc/passwd /etc/shadow (Confirm the count matches)
Clean Reboot
# init 6

1.

VERITAS Cluster Server INSTALL 5.0MP3

Download installation files for VCS 5.0 MP3 and also Agent Pack (This pack may be required to update the
agents like Oracle, NetListner.)

# cd /var/tmp/
ftp 90.152.52.80
ftp> bin
ftp> cd veritas/VCS5_SF5/solaris
ftp> get 5.0MP3-sparc.tar.gz
ftp> get AgentPack-1Q2008-2008-03-19b.cd1.tar.gz
# gunzip 5.0MP3-sparc.tar.gz
# tar -xvf 5.0MP3-sparc.tar
# cd dvd1-sol_sparc/cluster_server
#. /installvcs
# pkginfo -l VRTSvcs
Cluster configuration can be completed when both servers have been upgraded.
After VCS installation we have to install RP2 pkgs for VCS also (which are 139358-02 and 139359-02)
After installing RP2 please check that #pkginfo l VRTSvcs; pkginfo l VRTScsocw ; pkginfo l VRTSvcsor all
must show MP3RP2.
And install latest oracle agent pkgs (if oracle is there) from NAS server below path:
/nas/common/veritas/SUN/old_versions/SF5.0_MP3/cluster_server_agents/oracle_agent/patches/12367003.tar.gz
And also install WebSphereMQ6 agent (VRTSmq6) if it is there. (Copy this pkg from crxdbr01/02:/var/tmp or
/export/home/sg748j and install.)
And take the backup of current config files and restore the old config files from old disk.
#mkdir p /var/tmp/vcs_bkp
#cp -p /etc/VRTSvcs/conf/config/*.cf /var/tmp/vcs_bkp
#cp -p /etc/llttab /var/tmp/vcs_bkp/llttab.bkp
#cp -p /etc/llthosts /var/tmp/vcs_bkp/llthosts.bkp
#/sbin/gabconfig -a > /var/tmp/vcs_bkp/gabconfig.out
#cp -p /etc/gabtab /var/tmp/vcs_bkp/gabtab.bkp
And mount the old disk and restore the files from sol8 disk:
#cp /mnt/etc/VRTSvcs/conf/config/main.cf
/etc/VRTSvcs/conf/config/main.cf
#cp /mnt/etc/llthosts
/etc/llthosts
#cp /mnt/etc/gabtab
/etc/gabtab
#cd /etc/VRTSagents/ha/conf/Oracle
#cp -p OracleTypes.cf /etc/VRTSvcs/conf/config/OracleTypes.cf
#cp p /etc/VRTSagents/ha/conf/WebSphereMQ6 /etc/VRTSvcs/conf/config/

1.

Reboot system
# shutdown -i6 -g0 y

32. Configure Netbackup Client

# /bto/sys/ebr/post_dds_config
The script will ask for the following inputs, provide the proper value of your server.
Some applications require special configurations.Please select one of the following categories (the full name
or first character of the name is acceptible):
(B)SLD
(O)PEDS Remote - NOT Corporate OPEDS (For corporate choose N)
(U)NE-319
(Q)UANTUM
(N)ONE OF THE ABOVE (includes AIC, BRIC, CRIC, and BBT)
N for NONE
What is the regname of the server you are currently on?
(Unless server is for BSLD or OPEDS, regname must start with:
br, cr, jr, ai, bi, or ci)
bixfr01g
bixfr02g
What is the IP-address you will use for backups on bixfr01g?
N/A
This server appears to have been a client previously.
Are you moving this client to the new BBT infrastructure in EBR?
(answer: y or n) NO
Contact EBR Team to check if they can connect to the server from their netbackup software. If yes, ask them
for a test backup for checking the connectivity speed.
33. Restore /bto ( it is a separate mount point)

Ask EBR team to restore the /bto file system without overwrite option against the AOTS task.
30.a) Please restore below file before the sendmail push (Need to add ATTsend mail)
/etc/mail/aliases
/etc/mail/sendmail.cw
/etc/mail/local-host-names
/etc/mail/virtusertable
/etc/mail/virtuser-domains

34. DDS Push (Please request Tim Ryan PSA perform DDS pkg push)

There should be 2 tasks in the CR for DDS team

1. DDS Package verify with Model server
2. Post Upgrade DDS push
verify history is completed before install packages. 1-205-444-2985. This is a production server, so the dds
packages will need to be installed by DDS Operations. /bto is on a separate mount point, so no need to

contact app support for any dds packages installation tasks.

MODEL SERVER IP: 90.38.34.119 (for Sun)

This is a request to use the DDS Verify Tool to update the DDS History. Please use the List, Verify, and
Update functions, in order to update the DDS History of each Target Server above.
Post Upgrade DDS Push
Find the DDS packages currently installed on the server.
#/bto/sys/csa/bin/dds
It will list the current packages available on server. Compare the list with the SCIM data and sort out the
packages need to be installed. We can ignore eranet, ebrpatch and ugc packages as it is not available in the
DDS hub.
Do the pre work for the DDS packages need to be installed. Pre-work for some common packages are following
below.
sendmail_00083
# grep <hostname> /etc/hosts
Check and confirm the FQDN is present on the /etc/hosts, if not add the FQDN name otherwise sendmail
installation will fail. Use the following two commands to find the FQDN from DNS.
# nslookup <hostname>
# nslookup <ip-address>
# vi /etc/hosts (Add the FQDN)

etac_00168 is no longer used, instead we are pushing etacpltn* see attachment on CR

Download the ETAC precheck utility script and run the script. It will show the prework status, do the changes if
needed.
#cd /var/tmp
#ftp 90.38.34.128
username: anonymous Password: attid (ex: np0974)
ftp>binary
ftp>hash
ftp>cd /pub/Security
ftp> get pre_cksvr.SunOS.tar
ftp>bye
#tar xvf pre_cksvr.SunOS.tar
#./pre_cksvr
Check the script is successful and ETAC is ready to install

WE CAN ASK DDS TEAM TO START THEIR ACTIVITY ON CRXDB-1P AND CRXDB-2P, ONCE PRE-WORK
DONE.

Patrol software:
Check the following entry should be present in /etc/passwd file. if not, add it
patrol:x:50020:50020:techadm1.bis.bls.com:/bto/sys/bmc/patrol:/bin/ksh
Check the following entry should be present in /etc/group file. if not, add it
patrol::50020:
Check the following entry should be present in /etc/ftpd/ftpusers file. if not, add it
Patrol
Change patrol home directory from /bto/sys/bcm/patrol to /usr/localcw/opt/patrol.
Make sure the /bto/sys/bmc/patrol/B4OUT file and /bto/sys/bmc/patrol/pasa_prod_bkup directory exist. If
they dont there, they will need to be copied from the old root disk.
Run /nas/common/patrol/saptrol/cb/cb_after.sh (this script will install in the new location (preserving the
old data) and start patrol)

35. Create Dump Device

# swap -l (Check swap is loaded from metadevice)

# dumpadm
(Check the dumpdevice is pointed to the metadevice, and Ensure the Save core directory is pointed to proper
directory, if not do the following)
# dumpadm -d swap
# mkdir -p /bto/sys/crash/`hostname`
# dumpadm -s /bto/sys/crash/`hostname`
36. Create devalias for new booting devices

# cd /bto/sys/csa
# eeprom nvramrc > oldalias.bak
# vi aliaslist (add the required alias names started with devalias aliasname and physical path)
devalias root /pci@1f,700000/scsi@2/disk@0,0:a
devalias mroot /pci@1f,700000/scsi@2/disk@1,0:a
devalias altboot /pci@1f,700000/scsi@2/disk@2,0:a
:wq!

# eeprom nvramrc="`cat aliaslist`"

# eeprom nvramrc (Ensure all alias names updated)
# eeprom boot-device="root mirror"
37. Setting permission as per the application requirement

# chmod 755 /usr/local

# chmod 755 /usr/local/bin
38. Install ATT SUDO utility TOP(3.7),LSOF(4.82) (Required)

# cd /nas/usr/sbc/sudo/pkg
# ls -l ATTsudo-sparc.pkg
# pkginfo -x |grep -i sudo (Ensure no SUDO packages installed)
# ls -l /usr/local/bin/sudo (Ensure no sudo binary files exists)
# pkgadd -d ATTsudo-sparc.pkg
# mount /dev/dsk/c1t1d0s0 /mnt
# cp -p /mnt/etc/sudoers /usr/localcw/opt/sudo/sudoers.d/SMCsudoers
#cp -p /mnt/usr/localcw/opt/sudo/sudoers.d/CBSsudoers /usr/localcw/opt/sudo/sudoers.d/CBSsudoers

# vi /usr/localcw/opt/sudo/sudoers.d/emocse
#EMOC-SE
%emocse ALL=/usr/local/bin/rootsh,/usr/localcw/bin/eksh
%emoct2 ALL=/usr/localcw/bin/eksh,/usr/local/bin/rootsh
# vi /usr/localcw/opt/sudo/sudoers.d/sysadmin
# System administrators
%sysadmin
ALL=(ALL) ALL
# chmod 440 /usr/localcw/opt/sudo/sudoers.d/emocse
# chmod 440 /usr/localcw/opt/sudo/sudoers.d/sysadmin
# chown root:root /usr/localcw/opt/sudo/sudoers.d/emocse
# chown root:root /usr/localcw/opt/sudo/sudoers.d/sysadmin
Edit PATH statement in /etc/profile to add /usr/localcw/bin
# vi /etc/profile
PATH=$PATH:/usr/localcw/bin
export PATH
# /etc/local/profile
# ln -f -s /usr/localcw/bin/sudo /usr/local/bin/sudo
Test SUDO functionality
Login with your ATTID
# sudo -i
If it comes up with password prompt, it means sudo is working fine

If it gives some syntax error in one of SMCsudoers or SBCsudoers, it means there is an error in those
files and most likely, that file is not in use on the server.
Install top software
Login to saxon (89.30.203.23) ; sudo to root
#scp /export/home/blgbngz/top-3.6.sol10-sparc-local.gz NEWSERVER:/tmp

Login into upgraded server:

#cd /tmp
>tmp#gunzip top-3.6-sol10-sparc-local.gz
>tmp#pkgadd -d /tmp/top-3.6-sol10-sparc-local
The following packages are available:
1 SMCtop top
(sparc) 3.6
The following packages are available:
Select package(s) you wish to process (or 'all' to process
all packages). (default: all) [?,??,q]: all
Processing package instance <SMCtop> from </tmp/top-3.6-sol10-sparc-local>
top( sparc) 3.6
This appears to be an attempt to install the same architecture and
version of a package which is already installed. This installation
will attempt to overwrite this package.

LeFebvre et al
Using </usr/local> as the package base directory.
## Processing package information.
## Processing system information
17 package pathnames are already properly installed.
## Verifying disk space requirements.
## Checking for conflicts with packages already installed
## Checking for setuid/setgid programs.
Installing top as <SMCtop>
## Installing part 1 of 1.
[verifying class <none>]
Installation of <SMCtop> was successful.
tmp>pkginfo -l SMCtop
PKGINST: SMCtop
NAME: top
CATEGORY: application
ARCH: sparc
VERSION: 3.6

BASEDIR: /usr/local
VENDOR: LeFebvre et al
PSTAMP: Steve Christensen
INSTDATE: Dec 11 2006 17:58
EMAIL: steve@smc.vnet.net
STATUS: completely installed
FILES: 17 installed pathnames
7 directories
3 executables
558 blocks used (approx)

For installation of lsof software:

See note below. You would probably want the highlighted one. cat /etc/release and if you
are at update 3 or less then use the one right above it (u3). Use pkgadd d
/nas/usr/sbc/lsof/ATTlsof-4.82-sol10u4-sparc.pkg (for example) to install it.

====================================================================
All,

Chuck Floyd has graciously and quickly recompiled the new lsof packages and I have put on
our nas. The location is under the respective OS release at /nas/usr/sbc/lsof. See below.
Please test these out and let me or Chuck know if this works for you.

Thank You
/nas/usr/sbc/lsof/ATTlsof-4.82-sol10u3-sparc.pkg
/nas/usr/sbc/lsof/ATTlsof-4.82-sol10u4-sparc.pkg
/nas/usr/sbc/lsof/ATTlsof-4.82-sol8-sparc.pkg
/nas/usr/sbc/lsof/ATTlsof-4.82-sol9-sparc.pkg

39.

Need to install ATTSssh:

Ref. link http://wiki.web.att.com/display/USH/ATTssh
Disable ssh and then remove below pkgs before installing ATTssh.
SUNWsshcu, SUNWsshdr, SUNWsshdu, SUNWsshr, SUNWsshu
Then Install ATTssh : 5.8p2,REV=1 from NAS server:
# cd /nas/usr/sbc/pkgs
#pkgadd -d ATTssh-5.10-sparc-64.pkg

40. Need restore below directories with NO Overwrite optionies: as per apps request. (copy using cpio

from Solaris 9 image is probably easier than EBR.)

/opt/java
/opt/mqm
/opt/data (copy must preserve symbolic links this is required only when /opt/data is not a mount
point)
/var/app/
/var/opt
/usr/dmexpress and /usr/syncsort (copy must preserve symbolic links.)
/var/spool/cron/crontabs
41. Create One-way Root mirroring (Primary submirror only DO NOT ATTACH SECONDARY)

Configure Primary Root disk One-way mirroring using Solaris Volume Manager
# metadb -f -ac3 /dev/dsk/c1t1d0s7
#metadb a-c3 /dev/dsk/c1t0d0s7
#metainit f d2 1 1 /dev/dsk/c1t1d0s0
# metainit -f d12 1 1 /dev/dsk/ c1t1d0s1
# metainit -f d22 1 1 /dev/dsk/ c1t1d0s3
# metainit -f d32 1 1 /dev/dsk/ c1t1d0s4
#metainit f d42 1 1 /dev/dsk/ c1t1d0s5

#metainit d0 m d2
# metainit d10 -m d12
# metainit d20 -m d22
#metainit d30 m d32
#metainit d40 m d42
#metainit d50 m d52
# cp -p /etc/vfstab /etc/vfstab.noSVM.date
# metaroot d0
# vi /etc/vfstab (change the swap and /var slices to corresponding metadevices entry)
# sync; init 6
# df -h (Ensure that root and var mounted from metadevices)

42. Perform CSA Sanity test

43. Uncomment Cron entries

# vi /bto/sys/platform/root_cron/csa_cron - (Uncomment the following entries, not Broot entry)

Reboot cron entry
SCIM cron entry
# /bto/sys/platform/ bin/ merge_crons

44. Enable Netcool Monitoring

45. Verify MIR report
46. Notify Application team that Upgrade complete

Once we got confirmation from the application team; we will proceed with the secondary mirror attachment.