Netbackup

Netbackup Tips Glossary

Term CLI GUI Media Server Master Server Command Line Interface Graphical User Interface Definition

Starting and Stopping Netbackup

Stopping Netbackup

y y y y y

/usr/openv/netbackup/bin/K77netbackup --> graceful shutdown /usr/openv/netbackup/bin/bpps -a --> check for any remaining processes /usr/openv/netbackup/bin/goodies/bp.kill_all ---> kills all remaining netbackup processes, not necessarily graceful /usr/openv/netbackup/bin/bpps -a --> check for any remaining processes kill -9 <pid> for any remaining. NOTE: unkillable processes may require a reboot

Starting Netbackup

/usr/openv/netbackup/bin/S77netbackup --> after bp.kill_all, to restart

Common Tasks
Starting the Administration GUI

y y

java from the windows client x-windows from the server - /usr/openv/netbackup/bin/xnb &

Checking Backup Status

y y

Activity Monitor or /usr/openv/netbackup/bin/admincmd/bpdbjobs -report

Cleaning a tape manually

y y

Identify the drive name to be cleaned o tpclean -L Manually clean the drive: o tpclean -C <drive name>

Determining what tapes were used for a backup

y y

GUI
o

Backup and Restore --> Find the file system --> Preview Media Button Find the correct backup images  bpimagelist -U -client <CLIENT> -d <ST ARTDATE> -e <ENDDATE> Find the media used for those images  bpimagelist -U -client <CLIENT> -d <ST ARTDATE> -e <ENDDATE> -media

CLI
o

Listing the files in a backup Find the tape(s) used (above procedure using bpimagelist) cd /usr/openv/netbackup/db/jobs/done Run the following script and redirect it's output to a text file: for file in `grep MOUNTING *|grep <MEDIA_ID>|awk '{print $1}'|sed 's/:MOUNTING//'` do echo $file grep PATH_WRITTEN $file|awk '{print $3}' echo " " echo "==========================================End of Image======================================" echo " " done

This process works for NBU V3.4:

y y y y y y

cd /usr/openv/netbackup/db/images/<CLIENT> ls -ltr --> this will identify the directory with the proper date verify directory with "bpdbm -ctime <Unixtime> cd <Unixtime> ls -ltr --> lists all of the backups for this client on this date cat <POLICY>_<Unixtime>_<BU Type>.f | awk '{print $10}' --> this prints out the files in the backup

For NBU > V3.4

bpflist --help --> undocumented netbackup command to list files from a binary .f file

Inventory the Robot

y y

Inventory Robot --> /opt/openv/volmgr/bin/vmcheckxxx -rt robot_type -rn robot_number -list (where robot_type is tld, acs, . . .) Inventory Robot and Update Configuration --> /opt/openv/volmgr/bin/vmupdate -rt robot_type -rn robot_number -list (where robot_type is tld, acs, . . .)

Listing Properties of the Volume Pools

vmpool -listall

Scratch Tapes

y y

Count scratch tapes: /usr/openv/volmgr/bin/vmquery -pn Scratch | grep -c "robot slot" Moving tapes to the scratch pool o If Needed - Expire the tape

 bpexpdate -ev <T APE ID> -d 0 -force -host <Media Manager> Move the tape  vmchange -p 2 -m <TAPE ID>

Checking Drive Usage

/usr/openv/volmgr/bin/vmoprcmd

Taking a drive down or up

y y

/usr/openv/volmgr/vmoprcmd -down <drive index> /usr/openv/volmgr/vmoprcmd -up <drive index>

Performing a Restore

From the GUI o user backup & restore --> configuration --> client o user backup & restore --> configuration --> client to restore o directory to search o directory depth o date range o file --> browse backups for restore

Adding New Tapes to the Library

Using the GUI o Media Management --> Actions --> New --> Single Volume . . --> o Media Type (ie DLT) o Robot Type (ie TLD) o Media ID (from Inventory) o Slot Number (from Inventory) o Robot Number (ie 0) o Volume Group o Volume Pool (ie Scratch) Using the CLI o vmadd -m <media id> -mt <tape type> -verbose -rt <robot type> -b <barcode> -rn <robot number> -rc1 <slot> -p <pool number> -mm <max mounts>

 vmpool -listall --> lists all pools, both name and number For example: vmadd -m 000151 -mt dlt -verbose -rt tld -b 000151 -rn 0 -rc1 8 -p 2 -mm 0

Re-using Tapes from other systems or older Netbackups

y y y y

Expire the media o bpexpdate -ev MEDI A_ID -d 0 -force -host HOST Deassign the media o vmquery -deassignbyid MEDIA_ID 4 0 Move to the scratch pool o vmchange -m MEDIA_ID -p POOL# Relabel the media o bplabel -ev CIM572 -d dlt -p Scratch

Changing the attributes of media

y y

Changing the barcode o vmchange -barcode CYM100D -m CYM100 Changing the Volume Pool o vmchange -m MEDI A_ID -p POOL#

To expire media

bpexpdate -ev <medai id> -d 0 -force -host <media server>

To unfreeze media

y y

List the frozen media o /usr/openv/netbackup/bin/goodies/available_media | grep -i FROZEN Unfreeze the media o bpmedia -unfreeze -ev <media id> -h <media server>

To relabel a tape

y y

bplabel -ev <media id> -d <tape density> -p <pool name> bplabel -ev 000687 -d dlt -p TriVrgt_OFFSITE

To remove media from the Netbackup database

y y y y

Verify that there are no images on the tape o bpimmedia -mediaid 000687 -L Expire the tape o bpexpdate -ev 000687 -d 0 -host scorpius -force Get the status and pool number of the tape o vmquery -m 000687 Deassign the tape o vmquery -deassignbyid <media id> <pool number> <status code from vmquery -m> o vmquery -deassignbyid 000687 4 0x0 Delete the tape o vmdelete -m 000687

Installing the Netbackup Client

/update_clients -ForceInstall -ClientList /tmp/clients.lst o requires that TMPDIR and TEMPDIR be set correctly

Excludng files from backup on a client

y y

Create /usr/openv/netbackup/exclude_list Put the file specifications of the files/directories to be excluded o /mnt/directory/*

Displaying Information about a Tape

y y y y y

vmquery -m <media id> --> Displays attributes about a particular tape bpmedialist -U -mcontents -ev 000687 --> Displays media contents bpmedialist -U -mlist --> List of all media bpmedialist -U -mlist -ev CYM966 --> Listing of a particular media id bpimmedia -mediaid 000687 -L --> Listing of images on a tape

Robtest Commands
y

Starting robtest o robtest

y y y y

o 1 --> to select TLD 0 Getting help o ? Looking at contents of the tape drives o sd Looking at the contents of the library o ss Moving a tape from a drive to a library slot o s d --> to identify drive number that has tape (Contains Cartridge = yes, Barcode=XXXXXX) o s s --> to identify an empty slot in the tape library (Netbackup will need to be re-inventoried) o m d# s# --> from from drive # to slot # o s d --> verify the tape drive is empty o s s --> verify the library slot has the tape

Configuration Files
/usr/openv/netbackup/bp.conf

y y y y

configuration file, sets backup server and backup clients force statement must be correct client to browse from client to restore to

/usr/openv/volmgr/vmconf

Logfiles
To utilize logfiles, create the corresponding directory in /usr/openv/netbackup/logs Server Logfile directories:

y y

admin - adminstrative commands bpbrm - backup and restore manager

y y y y y y y y y y y

bpcd - client daemon bpdbjobs - database manager program process bpdm - disk manager process bpjava-msvc - Java application server authentication service bpjava-usvc - process that services Java requests bprd - request daemon process bpsched - scheduler process that runs on master servers bptm - tape/optical media management process user-ops - required directory for use by Java programs xbpadm - X based administration utility xbpmon - X based job monitor process

Client Logfile directories:

y y y y y y y y y y y y y

bp - client user interface process bparchive - archive program bpbackup - backup program bpbkar - program that generates golden images bpcd - client daemon bpjava-msvc - Java application server authentication service bpjava-usvc - process that services Java requests bplist - program that lists backed up and archived files bpmount - program that determines local mountpoints and wildcard expansion for multiple streams bphdb - Oracle database backup program start process db_log - database specific extension log tar - tar process log during restores user_ops

Media Manager logging automatically goes to the system log using syslogd logging facility

.Logging will only occur if these directories are created. These directories will generate a lot of data and should be deleted when no longer necessary. To increase the amount of logging information set VERBOSE=2 in /usr/open/netbackup/bp.conf (default is VERBOSE=1)

Processes

ltid acsd vmd

Useful Commands
bpcllist - list classes bpclinfo <class> -L --> displays info about a class vmpool - volume pools vmpool -listall vmpool -listscratch bplabel -ev <media id> -d hcart bpbackup db --> backs up the catalog bpclclients <policy> --> lists the clients for a particular policy (class)

Troubleshooting
bperror -statuscode <-- displays information about the netbackup error. No Backups are running:

y y y

Check system log file for error messages Stop and restart all the netbackup processes Look for a downed drive o /usr/openv/volmgr/bin/ vmoprcmd o /usr/openv/volmgr/bin/ vmoprcmd -up 0 --> this will bring up drive 0 if it's control shows as down Look for pending requests o /usr/openv/volmgr/bin/ vmoprcmd or gui --> device management o If there is a pending request either re-assign it to a drive, or deny the request

Downed drive does not come back up or does not stay up

y y

Check for a hardware problem by looking for messages on the tape library Make sure there is not a tape stuck in the drive

Use robtest (described above) to look at the drives  If there is a tape stuck in the drive, try to remove it using robtest  If robtest fails, then you must manually remove it.

Verify the Client is communicating properly:

y y y

bpclncmd -ip <ip address> --> from both client and server bpclntcmd -hn <hostname> --> from both client and server bpclntcmd -pn --> from client only

Device Actions
Device Management --> info about tape drives

y y

dlt hcart (ultrium)

Media Actions
Media id must agree with # of the tape Create a media id

y y

actions -->new-->single volume-->dlt cart (not dlt2) put it into the "netbackup" volume pool

Netbackup Client

To check things out do this: It could be a couple things. Mostly DNS, bp.conf, or something stupid. On the client run this command /usr/openv/netbackup/bin/bpclntcmd -pn /usr/openv/netbackup/bin/bpclntcmd -server "server name" /usr/openv/netbackup/bin/bpclntcmd ip "ip_address"

One of these usually fails and your able to fix it right off

1074 ./bpclntcmd -hn corpbu1 1075 ./bpclntcmd -ip 10.194.1.129 1076 ping 10.194.1.129 1077 ./bpclntcmd -hn corpldv1 1078 ./bpclntcmd -hn corpbu1.corporate.vox.net 1079 ping corpldv1 1080 ./bpclntcmd -ip 10.194.1.120

Must be able to resolve correctly from the master server and the client or it will not work!!!

Examples :
Team, FYI & Ref. how to check backup client/server connection. Regards Santosh
From: Pathak, Santosh (TCS Consultant) Sent: Sunday, January 16, 2011 10:22 PM To: Gurumoorthy, Balaji (TCS) Subject: RE: Seiadmwbs03

Backup is successfull 14th, 15th Jan 2011 this weekend. pathaks@saiadsbkp01$ sudo bpimagelist -hoursago 48 -client seiadmwbs03-b -U Backed Up Expires Files KB C Sched Type Policy ---------------- ---------- -------- -------- - ------------ ----------01/15/2011 07:48 01/27/2011 53470 4873709 Y Full Backup seiadmwbs03 01/15/2011 03:00 01/27/2011 74145 38171730 Y Full Backup seiadmwbs03 01/14/2011 23:55 01/26/2011 15 537944 Y Full Backup seiadmwbs03
From: Pathak, Santosh (TCS Consultant) Sent: Sunday, January 16, 2011 10:18 PM

To: Gurumoorthy, Balaji (TCS) Subject: RE: Seiadmwbs03

NetBackup can connect this hosts by both ways Namd and IP. pathaks@saiadsbkp01$ bpclntcmd -hn seiadmwbs03-b host seiadmwbs03-b: seiadmwbs03-b at 10.10.182.133 (0xa0ab685) aliases: pathaks@saiadsbkp01$ bpclntcmd -ip 10.10.182.133 checkhaddr: host : seiadmwbs03-b: seiadmwbs03-b at 10.10.182.133 (0xa0ab685) checkhaddr: aliases: Policy is also active. pathaks@saiadsbkp01$ sudo bppllist seiadmwbs03 -L|grep Act Active: yes Please check with network folks, if they need to enable anything on backup network? Let me know still need any info. Regards Santosh
From: Gurumoorthy, Balaji (TCS) Sent: Sunday, January 16, 2011 10:11 PM To: Pathak, Santosh (TCS Consultant) Subject: Seiadmwbs03

Backup ip 10.10.182.133 Check if backup connectivity is there to this server from backup server? Thanks Balaji Team, FYI and Ref. Below command is the way to confirm that specific mountpoint/filesystem is backed up or not on NetBackup. It is NOT simple as NetWorker or CommVault. Ram Please let us know if you have figure out any other way from GUI. I checked that also. When we browse the filesystem for restore job, it displays backup information and we need to select it and click on Preview. So it will display volume information. Thanks Santosh

From: Pathak, Santosh (TCS Consultant) Sent: Saturday, January 29, 2011 6:52 PM To: Krishnasamy, Rajeshwaran (TCS); Pandith, Nandan (TCS); Prasad, Shambu (TCS); TCS-Ashburn-Unix Cc: TCS-Ashburn-Backup-Storage Subject: (COMPLETED - INC 54144) RE: Daily status

Rajesh/Shambu and team, Please inform to user that FULL backup is completed and confirm us, so I can resolve the ticket. Backup Log for ref:-

saiadsdbq20
root@saiadslhp03 # bpimagelist -d 01/28/2011 -e 01/29/2011 -client saiadsdbq20-b -U -policy saiadsdbq20 -L|grep -i "backup id:"|awk '{print $3}'| while read bid; do bpflist -l -d 01/28/2011 -e 01/29/2011 -st FULL policy saiadsdbq20 -backupid $bid -client saiadsdbq20-b|egrep -i "SSQA|ORAUTL";done no entity was found 1 0 6 50 1 1 0 0 30933130 /SSQA/ 16877 root root 0 1296269043 1295901244 1295901244 1 0 16 56 1 1 0 0 30933394 /SSQA_audit_log/ 16832 oracle oinstall 0 1296309711 1296309686 1296309686 no entity was found no entity was found no entity was found no entity was found 145129 0 8 50 55581066 1 0 0 22282240 /ORAUTL/ 16877 root root 0 1296176517 1248994730 1248994730 154557 0 6 50 56972204 1 0 0 30933130 /SSQA/ 16877 root root 0 1296269043 1295901244 1295901244 164512 0 16 56 57185880 1 0 0 30933394 /SSQA_audit_log/ 16832 oracle oinstall 0 1296279586 1296279587 1296279587

saiadsdbq21
root@saiadslhp03 # bpimagelist -d 01/28/2011 -e 01/29/2011 -client saiadsdbq21-b -U -policy saiadsdbq21 -L|grep -i "backup id:"|awk '{print $3}'| while read bid; do bpflist -l -d 01/28/2011 -e 01/29/2011 -st FULL policy saiadsdbq21 -backupid $bid -client saiadsdbq21-b|egrep -i "SSQA|ORAUTL";done 1 0 16 56 1 1 0 0 30933394 /SSQA_audit_log/ 16832 oracle oinstall 0 1296285191 1296285158 1296285158 no entity was found 1 0 6 51 1 1 0 0 30933282 /SSQA/ 16877 oracrs dba 0 1296177304 1244226864 1244226864 no entity was found no entity was found 145775 0 8 50 40235423 1 0 0 22282240 /ORAUTL/ 16877 root root 0 1296177284 1249011283 1249011283 155168 0 6 51 41607770 1 0 0 30933282 /SSQA/ 16877 oracrs dba 0 1296177304 1244226864 1244226864

165813 0 16 56 41826907 1 0 0 30933394 /SSQA_audit_log/ 16832 oracle oinstall 0 1296278599 1296278511 1296278511

Thanks Santosh
From: Krishnasamy, Rajeshwaran (TCS) Sent: Saturday, January 29, 2011 12:43 PM To: Pathak, Santosh (TCS Consultant); Pandith, Nandan (TCS); Prasad, Shambu (TCS); TCS-AshburnUnix Cc: TCS-Ashburn-Backup-Storage Subject: RE: (UPDATE and Need info - INC 54144) RE: Daily status

Santosh, No, both are not same. /SSQA is mounted locally from Storage disk and /backup/SSQA is NAS share, not local File system. /dev/dsk/c1t5006016139A02500d3s2 nas03:/ssqa 15G 8.3G 6.4G 57% /SSQA 48G 27G 21G 56% /backup/SSQA

Best Regards, Rajesh Ashburn UNIX/LINUX Support Work: (858)-942-5629 Mobile: (201)-783-9772
From: Pathak, Santosh (TCS Consultant) Sent: Saturday, January 29, 2011 9:26 AM To: Pandith, Nandan (TCS); Prasad, Shambu (TCS); TCS-Ashburn-Unix Cc: TCS-Ashburn-Backup-Storage Subject: (UPDATE and Need info - INC 54144) RE: Daily status Importance: High

Hi Nandan/Shambu, FULL backups are completed for SAIADSDBQ20 and SAIADSDBQ21 this week on 29th Jan, 2011 (Saturday). REQUESTED FILE SYSTEMS for FULL Backup Can anyone confirm /SSQA = /backup/SSQA? As I see /ORAUTL and /backup/SSQA are locally mounted filesystems, not /SSQA. /SSQA /ORAUTL/oraasm /ORAUTL/oracrs

INCLUDED FILE SYSTEMS in backup:

saiadsdbq20

Include: Include: Include:

ALL_LOCAL_DRIVES = this includes all locally mounted filesystems /backup/SSQA /backup/ENQA

saiadsdbq21
Include: ALL_LOCAL_DRIVES = this includes all locally mounted filesystems

Backup report for ref:-

Saiadsdbq20
01/29/2011 01/29/2011 01/29/2011 01/29/2011 01/29/2011 01/29/2011 01/29/2011 01/29/2011 01/29/2011 01/29/2011 01/29/2011 01/28/2011 09:23 09:06 09:01 09:01 08:57 08:47 08:38 03:07 00:53 00:46 00:11 23:31 02/10/2011 02/10/2011 02/10/2011 02/10/2011 02/10/2011 02/10/2011 02/10/2011 02/10/2011 02/10/2011 02/10/2011 02/10/2011 02/09/2011 73457 6661381 47481 7519067 43826 6520928 2883 7871 20156 8186378 1 32 1962 996 1272 3116 5175 24311896 58762 3946392 3859 44162590 164512 28705089 Y Y Y Y Y Y Y Y Y Y Y Y Full Full Full Full Full Full Full Full Full Full Full Full Backup Backup Backup Backup Backup Backup Backup Backup Backup Backup Backup Backup saiadsdbq20 saiadsdbq20 saiadsdbq20 saiadsdbq20 saiadsdbq20 saiadsdbq20 saiadsdbq20 saiadsdbq20 saiadsdbq20 saiadsdbq20 saiadsdbq20 saiadsdbq20

Saiadsdbq21
01/29/2011 01/29/2011 01/29/2011 01/29/2011 01/29/2011 01/29/2011 01/29/2011 01/29/2011 01/29/2011 01/28/2011 09:23 02:13 01:46 01:46 01:27 01:00 00:46 00:40 00:18 23:31 02/10/2011 02/10/2011 02/10/2011 02/10/2011 02/10/2011 02/10/2011 02/10/2011 02/10/2011 02/10/2011 02/09/2011 19767 6364252 2655 5686 26285 3913110 36254 7264955 59391 6470491 2058 4465 1962 996 1 32 59178 6857764 165813 20995486 Y Y Y Y Y Y Y Y Y Y Full Full Full Full Full Full Full Full Full Full Backup Backup Backup Backup Backup Backup Backup Backup Backup Backup saiadsdbq21 saiadsdbq21 saiadsdbq21 saiadsdbq21 saiadsdbq21 saiadsdbq21 saiadsdbq21 saiadsdbq21 saiadsdbq21 saiadsdbq21

Thanks Santosh
From: Pathak, Santosh (TCS Consultant) Sent: Tuesday, January 25, 2011 6:24 PM To: Pandith, Nandan (TCS); Prasad, Shambu (TCS); TCS-Ashburn-Unix; TCS-Ashburn-Backup-Storage Subject: RE: Daily status

Nandan, We have FULL backups available on 22nd Jan, 2011 for both the hosts last week. It will run FULL backup again this Week. Let us know on which date, these hosts needs to backed up FULL.

Saiadsdbq20
01/22/2011 15:38 saiadsdbq20 01/22/2011 15:33 saiadsdbq20 01/22/2011 15:32 saiadsdbq20 01/22/2011 15:32 saiadsdbq20 01/22/2011 15:32 saiadsdbq20 01/22/2011 15:31 saiadsdbq20 01/22/2011 15:30 saiadsdbq20 01/22/2011 13:48 saiadsdbq20 01/22/2011 13:48 saiadsdbq20 01/22/2011 13:28 saiadsdbq20 01/22/2011 13:21 saiadsdbq20 01/22/2011 13:18 saiadsdbq20 02/03/2011 02/03/2011 02/03/2011 02/03/2011 02/03/2011 02/03/2011 02/03/2011 02/03/2011 02/03/2011 02/03/2011 02/03/2011 02/03/2011 3853 5174 58742 1638 20151 1 1930 72319 4112 46977 43331 878857 991071 3946038 3759 8292232 32 996 6425098 9059 7288471 6291360 Y Y Y Y Y Y Y Y Y Y Y Y Full Backup Full Backup Full Backup Full Backup Full Backup Full Backup Full Backup Full Backup Full Backup Full Backup Full Backup Full Backup

165017 28255075

Saiadsdbq21
01/22/2011 14:15 saiadsdbq21 01/22/2011 14:13 saiadsdbq21 01/22/2011 14:13 saiadsdbq21 01/22/2011 09:15 saiadsdbq21 01/22/2011 09:01 saiadsdbq21 01/22/2011 08:25 saiadsdbq21 01/22/2011 08:25 saiadsdbq21 01/22/2011 08:04 saiadsdbq21 01/22/2011 07:51 saiadsdbq21 01/22/2011 05:45 saiadsdbq21 02/03/2011 02/03/2011 02/03/2011 02/03/2011 02/03/2011 02/03/2011 02/03/2011 02/03/2011 02/03/2011 02/03/2011 26265 35718 1 19767 1930 2781 58698 58287 2992 3912788 7034165 32 6440518 996 5911 6628806 6235301 6232 Y Y Y Y Y Y Y Y Y Y Full Backup Full Backup Full Backup Full Backup Full Backup Full Backup Full Backup Full Backup Full Backup Full Backup

165271 20547656

Thanks Santosh
From: Pathak, Santosh (TCS Consultant) Sent: Tuesday, January 25, 2011 6:17 PM To: Pandith, Nandan (TCS); Prasad, Shambu (TCS); TCS-Ashburn-Unix; TCS-Ashburn-Backup-Storage Subject: RE: Daily status

Sorry typo..i will check..

From: Pandith, Nandan (TCS) Sent: Tuesday, January 25, 2011 6:16 PM To: Pathak, Santosh (TCS Consultant); Prasad, Shambu (TCS); TCS-Ashburn-Unix; TCS-Ashburn-BackupStorage Subject: RE: Daily status

Santosh, The server name is saiadsdbq20 and saiadsdbq21. I guess you have not got the hostname correct. Please check and let us know. Thanks!!
From: Pathak, Santosh (TCS Consultant) Sent: Tuesday, January 25, 2011 3:10 PM To: Pandith, Nandan (TCS); Prasad, Shambu (TCS); TCS-Ashburn-Unix; TCS-Ashburn-Backup-Storage Subject: RE: Daily status

Hi Shambu/Nandan, Following two hosts are not configured in backup policy. Please create a Netasthra SR and assign to backup team to add into backups. Also provide us backup network IP associated with those hosts. root@saiadslhp03 # bppllist saidbsdbq20 -U the specified policy does not exist in the configuration database (230) root@saiadslhp03 # bppllist saidbsdbq21 -U the specified policy does not exist in the configuration database (230) Thanks Santosh
From: Pandith, Nandan (TCS) Sent: Monday, January 24, 2011 12:35 PM To: Pandith, Nandan (TCS); Prasad, Shambu (TCS); TCS-Ashburn-Unix; TCS-Ashburn-Backup-Storage Subject: RE: Daily status

Ticket has been already assigned to Santosh.

Backup team- please have a look into this below Service Request. If any questions please revert back to the submitter.
From: Pandith, Nandan (TCS) Sent: Monday, January 24, 2011 9:31 AM To: Prasad, Shambu (TCS); TCS-Ashburn-Unix Subject: RE: Daily status

This ticket should go to back team correct?

From: Prasad, Shambu (TCS) Sent: Monday, January 24, 2011 9:29 AM To: TCS-Ashburn-Unix Subject: FW: Daily status

Nandan/Rajesh, Can you please look in to INC000000054144. Thanks, Shambu.

From: Pallanti,Madhukar (TCS) Sent: Monday, January 24, 2011 10:22 AM To: Prasad, Shambu (TCS) Cc: TCS-Ashburn-DBA; Srinivasan, Suresh (TCS); VenkatRaju, Rajesh (TCS Consultant) Subject: RE: Daily status

Hi Team, We completed scheduling in dbp21/22/23 for application monitoring. Changed archive log backup scheduling time from 0-21 to 5-21 in the below servers . Saiadsdbp20 seiadsdbp20 saiadsdbp26 Regarding PATCH: since there is no space on the server saiadsdbq20 and 21,we raised an SR to backup team for taking backup of ORACLE mount points. Refer INC000000054144 Kindly confirm the retention period for the above SR. Thanks, Madhukar & Yusuf SCA-DBA Support 1800-734-1493

Balaji, We have FULL backups of both clients on last week as below. Please plan out your activity as per that. seiadmwbp02 - 8th Jan, 2011 (Saturday 12:42 ET) Full backup completes by 4:39 ET on Saturday (early morning) seiadmwbs03 8th Jan, 2011 (Saturday 14:57 ET) Full backup completes after noon (around 3:00pm ET) If want to kick-off keep on hold backups or kick-off later. Please open TV ticket as it handles by backup server. pathaks@saiadsbkp01$ sudo bpimagelist -hoursago 168 -client seiadmwbp02-b -U Backed Up Expires Files KB C Sched Type Policy ---------------- ---------- -------- -------- - ------------ ----------01/13/2011 20:15 01/27/2011 18 4159 Y Differential seiadmwbp02 01/13/2011 20:14 01/27/2011 335 390231 Y Differential seiadmwbp02 01/13/2011 20:12 01/27/2011 15 528398 Y Differential seiadmwbp02 01/12/2011 20:22 01/26/2011 25 29447 Y Differential seiadmwbp02 01/12/2011 20:22 01/26/2011 333 379625 Y Differential seiadmwbp02 01/12/2011 20:22 01/26/2011 15 528398 Y Differential seiadmwbp02 01/11/2011 20:23 01/25/2011 20 4105 Y Differential seiadmwbp02 01/11/2011 20:23 01/25/2011 331 378079 Y Differential seiadmwbp02 01/11/2011 20:22 01/25/2011 15 528381 Y Differential seiadmwbp02 01/10/2011 20:13 01/24/2011 25 29283 Y Differential seiadmwbp02 01/10/2011 20:13 01/24/2011 401 514357 Y Differential seiadmwbp02 01/10/2011 20:12 01/24/2011 15 528385 Y Differential seiadmwbp02 01/08/2011 12:42 01/20/2011 5912 781965 Y Full Backup seiadmwbp02 01/08/2011 12:39 01/20/2011 55192 5174826 Y Full Backup seiadmwbp02 01/08/2011 04:39 01/20/2011 15 528390 Y Full Backup seiadmwbp02 pathaks@saiadsbkp01$ sudo bpimagelist -hoursago 168 -client seiadmwbs03-b -U

Backed Up --------------------01/13/2011 20:15 seiadmwbs03 01/13/2011 20:15 seiadmwbs03 01/13/2011 20:12 seiadmwbs03 01/12/2011 20:23 seiadmwbs03 01/12/2011 20:23 seiadmwbs03 01/12/2011 20:22 seiadmwbs03 01/11/2011 20:23 seiadmwbs03 01/11/2011 20:23 seiadmwbs03 01/11/2011 20:22 seiadmwbs03 01/10/2011 20:24 seiadmwbs03 01/10/2011 20:24 seiadmwbs03 01/10/2011 20:24 seiadmwbs03 01/08/2011 14:57 seiadmwbs03 01/08/2011 14:55 seiadmwbs03 01/08/2011 14:52 seiadmwbs03

Expires Files KB ---------- -------- -------01/27/2011 01/27/2011 01/27/2011 01/26/2011 01/26/2011 01/26/2011 01/25/2011 01/25/2011 01/25/2011 01/24/2011 01/24/2011 01/24/2011 01/20/2011 01/20/2011 01/20/2011 1331 994 15 30 326 15 41 323 15 35 356 15 16864 409186 537959 30583 388900 537980 6637 388058 537998 30584 521751 538023

C Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y

Sched Type Policy ------------ -----Differential Differential Differential Differential Differential Differential Differential Differential Differential Differential Differential Differential Full Backup Full Backup Full Backup

74100 38134671 53414 15 4855695 538074

From: Gurumoorthy, Balaji (TCS) Sent: Friday, January 14, 2011 5:38 PM To: TCS-Ashburn-Backup-Storage Cc: TCS-Ashburn-Windows; Duchene, Denis (TCS); Veeraraghavan Govindaraj (TCS) Subject: Reg backup for Seiadmwbs03 and Seiadmwbp02

Santosh/Backup team, We are going to replace HP system board on below two windows servers tonight. Seiadmwbs03 Seiadmwbp02 The schedule is between 11pm to 3am PST tonight (1/14/11). We want to know if the weekly full backups will be completed tonight before 11pm tonight? If not can a full backup be triggered and get it completed before 11pm tonight both the above servers?

Thanks Balaji

Hi All, Please go through attached Oracle instances information and RMAN Backup Schedules on Ashburn Backup server. Daily RMAN backups CDL 14 Days retention (Onsite) Daily job running through cron to do duplication of RMAN backup images from CDL to LTO4 tapes 8 Week Retention (offsite) Monthend job runs through cron to do duplication of RMAN backup images from CDL to LTO4 tapes 1 Year Retention (offsite) Let me know any questions. Thanks Santosh
From: Veeraraghavan Govindaraj (TCS) Sent: Friday, September 03, 2010 3:20 PM To: 'Alcaraz, Mark L' Cc: Pathak, Santosh (TCS Consultant); Prasad, Shambu (TCS); Muthusamy, Senthilmurugan(TCS) Subject: RE: Retention policy of Oracle backup

Thanks Mark!. Find attached the excel with the changes as you mentioned. Review and let know if the retention policies are fine now.

Also on your comments, find below my understanding Firstly Every day, the Oracle RMAN backup job(bk_rman_10g.ksh) would run from user ORACLEs CRON job and the RMAN backup set would be generated on to the disk (cdl) -> This RMAN backup at CDL will be retained for 14 days Then Every day, the Veritas Net backup would run a job that would duplicate(make a copy) of the RMAN backupset stored in the CDL and its backed up into the tape -> every day RMAN tape backup will be retained for 8 weeks Every month , the Veritas Net backup would run a job that would duplicate(make a copy) of the RMAN backupset stored in the CDL and its backed up into the tape -> every month RMAN tape backup will be retained for 1 year Please let know if my understanding from your below comment is correct. Thanks,

Veera http://www.datadisk.co.uk/html_docs/veritas/veritas_netbackup_cs.htm#client Netbackup Cheat Sheet Master Daemons | Media Daemons | Catalog | Log Files | Server | Volume | Media | Tape/Robot | Archive | Client Master Server Daemons/Processes Request daemon Scheduler Netbackup database manager Job Monitor Media Server Daemons/Processes Communications daemon Backup and restore manager Tape Manager Disk Manager Media Manager Bar code reader Remote device management/ controls volume database Roboticdaemon (one on each media server) talks to tldcd Robotic control daemon talks to the robot directl via scsi Catalogs Master Server bpcd bpbrm (started with bpcd) bptm (started with bpbrm) bpdm (started with bpbrm) ltid avrd (started with ltid) vmd (started with ltid) bprd bpsched (started with bprd) bpdbm (started with bpsched) bpjobd (started with bpdbm)

tldd (started with ltid)

tldcd (started with ltid)

Information about backed-up files Storage Unit, Global Configuration, Catalog backup configuration. Backup Policy information Job status information Netbackup logs with error and status information Information on volumes, volume pools, scratch pool and volume groups

image - /opt/openv/netbackup/db config - /opt/openv/netbackup/db class - /opt/openv/netbackup/db jobs - /opt/openv/netbackup/db error - /opt/openv/netbackup/db

volume - /opt/openv/volmgr/database Media Server

Tracks assigned volumes (media that has media - /opt/openv/netbackup/db data them) Information about devices managed by the media server Log and Information Files Netbackup and Patch versions Media Version Patch Level history Buffer size /opt/openv/netbackup/bin/version /opt/openv/volmgr/version /opt/openv/netbackup/patch/patch.history /opt/openv/netbackup/db/config/SIZE_DAT A_BUFFERS /opt/openv/netbackup/db/config/NUMBER _DATA_BUFFERS /opt/openv/netbackup/NET_BUFFER_SZ (default = 32) /opt/openv/java/auth.conf /opt/openv/netbackup/db/config/cat_form at.cfg device - /opt/openv/volmgr/database

Number of buffers

Network Buffer Size Java GUI authorisation Catalog type (binary or ASCII)

Netbackup and media manager parameter files Corrupt Database image files (5.0 and above) Server Commands Check license details

/opt/openv/netbackup/bp.conf /opt/openv/volmgr/vm.conf /opt/openv/netbackup/db.corrupt

/opt/openv/netbackup/bin/admincmd/get_license_key netbackup start

Start Netbackup

/opt/openv/netbackup/bin/initbprd (master) /opt/openv/volmgr/bin/vmd (media)

netbackup stop Stop Netbackup (does not disconnect GUI /opt/openv/netbackup/bin/admincmd/bprdreq -terminate (master) sessions) /opt/openv/netbackup/bin/bpdbm -terminate (master) Stop Netbackup and kill all GUI sessions Start the GUI Scan for tape devices Display all Netbackup processes lists servers errors display information on a error code Reread bp.conf file without stopping Netbackup /opt/openv/netbackup/bin/goodies/bp.kill_all /opt/openv/netbackup/bin/jnbSA sgscan (solaris) ioscan (HPUX) bpps -a bperror -U -problems -hoursago <number of hours> bperror -U -backstat -by_statcode -hoursago <number of hours> bperror -statuscode <statuscode> [-recommendation] bprdreq -rereadconfig bpdbm -consistency 1 bpdbm -consistency 2 Check database consistency Check for the below lines: Bad image header Does not exist Netbackup Recovery

Device catalog is intact

bprecover -l -m <media ID> -d dlt (listing) bprecover -r -m <media ID> -d dlt (recovering) bprecover -l -tpath <tape_path> (listing) bprecover -r -tpath <tape_path> (recovering) bprecover -l -dpath <disk_path> (listing) bprecover -r -dpath <disk_path> (recovering)

Device catalog is gone or corrupted

Disk backups Volume Commands

Tape Drive and Inventory Commands List drive status, detail drive info and pending requests List the tape drive status List the pending requests Control a tape device List all changes in the robot(but do not update) vmoprcmd vmoprcmd -d ds vmoprcmd -d pr vmoprcmd [-reset][-up][-down] <drive number> vmupdate -recommend -rt tld -rn 0 vmcheckxxx -rt tld -rn 0 -recommend

Empty the robot and re-inventory (using vmupdate -rt tld -rn <robot number> -rh <silo slave> -vh <host> barcodes) nostderr -use_barcode_rules -use_seed -empty_ie Tape Media Commands List all pools List tapes in pool List all tapes in the robot List cleaning tapes List tape volume details Delete a volume from the catalog Change a tapes expiry date vmpool -listall -bx vmquery -pn <pool name> -bx vmquery -rn 0 -bx |grep 'TLD' | sort +4 vmquery -mt dlt_clean -bx vmquery -m <media ID> vmdelete -m <media ID> vmchange -exp 12/31/06 23:59:58 -m <media ID>

Change a tape's media pool Media commands List the storage units Freeze or unfreeze media List media details List media contents List backup Image Information Expire client images Expire a tape List all netbackups jobs Move media from one media server to another Tape/Robot commands List tape drives List cleaning times on drives clean a drive change a drives cleaning frequency set a drives cleaning time to zero

vmchange -p <pool number> -m <media ID>

bpstulist -U bpmedia [-freeze][-unfreeze] -ev <media ID> bpmedialist -ev <media ID> bpmedialist -U mcontents -m <media ID> bpimagelist -backupid <image ID> bpimage -cleanup -allclients bpexpdate -d 0 -ev <media ID> -force bpdbjobs -report [-hoursago] bpmedia -movedb -newserver <media server> -oldserver <media server>

tpconfig -d tpclean -L tpclean -C <drive number> tpclean -F <drive> <frequency> tpclean -M <drive> robtest commands that can be used are as follows:

Move tapes within robot using robtest

s s (show slots) s d (show drives) s i (show load port) m s250 d5 (move tape from slot 250 into drive 5) uload d5 (unload tape from drive 5) m d5 s250 (move tape from drive 5 to slot 250)

m s250 i1 (mov tape from slot 250 to load port 1) List load port tapes List all slot contents List tape drive contents Move a tape in s100 to drive 1 Move a tape to load port 1 Archiving Commands list archive info archive and remove images restore archive files Client commands bpclntcmd [-ip <ip addres>] bpclntcmd [-hn <hostname>] bpclntcmd [-pn] bpclntcmd [-sv] bpcatlist -client all -before Jul 01 2006 bpcatlist -client all -before Aug 01 2006 bpcatlist -before Jul 01 2006 | bpcatarc | bpcatrm bpcatlist -before Jul 01 2006 | bpcatres echo "s i q" | tldtest -r /dev/sg/c0t4l0 echo "s s q" | tldtest -r /dev/sg/c0t4l0 echo "s d q" | tldtest -r /dev/sg/c0t4l0 echo "m s100 d1" | tldtest -r /dev/sg/c0t4l0 echo "m s100 i1" | tldtest -r /dev/sg/c0t4l0

test client connectivity