Beruflich Dokumente
Kultur Dokumente
8.5
Using Data Protection for Domino to Backup and Restore Domino 8.5
with DAOS
By Peter Symonds
Version 1.0
Copyright Notice
Copyright IBM Corporation 2009. All rights reserved. May only be used pursuant
to a Tivoli Systems Software License Agreement, an IBM Software License
Agreement, or Addendum for Tivoli Products to IBM Customer or License
Agreement. No part of this publication may be reproduced, transmitted,
transcribed, stored in a ret rieval system, or translated into any computer
language, in any form or by any means, electronic, mechanical, magnetic,
optical, chemical, manual, or otherwise, without prior written permission of
IBM Corporation. IBM Corporation grants you limited permiss ion to make hardcopy
or other reproductions of any machine -readable documentation for your own use,
provided that each such reproduction shall carry the IBM Corporation copyright
notice. No other rights under copyright are granted without prior written
permission of IBM Corporation. The document is not intended for production and
is furnished “as is” without warranty of any kind. All warranties on this
document are hereby disclaimed, including the warranties of merchantability and
fitness for a particular p urpose.
U.S. Government Users Restricted Rights -- Use, duplication or disclosure
restricted by GSA ADP Schedule Contract with IBM Corporation.
Trademarks
IBM, the IBM logo, Tivoli, the Tivoli logo, AIX, Cross -Site, NetView, OS/2,
Planet Tivoli, RS/6000, Tivoli Certified, Tivoli Enterprise, Tivoli Enterprise
Console, Tivoli Ready, and TME are trademarks or registered trademarks of
International Business Machines Corporation or Tivoli Systems Inc. in the
United States, other countries, or both.
Lotus is a registered trademark of Lotus Development Corporation.
Microsoft, Windows, Windows NT, and the Windows logo are trademarks of
Microsoft Corporation in the United States, other countries, or both.
UNIX is a registered trademark of The Open Group in the Unite d States and other
countries.
C-bus is a trademark of Corollary, Inc. in the United States, other countries,
or both.
PC Direct is a trademark of Ziff Communications Company in the United States,
other countries, or both and is used by IBM Corporation unde r license.
ActionMedia, LANDesk, MMX, Pentium, and ProShare are trademarks of Intel
Corporation in the United States, other countries, or both. For a complete list
of Intel trademarks, see http://www.intel.com/sites/corporate/trademarx.htm.
SET and the SET Logo are trademarks owned by SET Secure Electronic Transaction
LLC. For further information, see http://www.setco.org/aboutmark.html.
Java and all Java-based trademarks and logos are trademarks or registered
trademarks of Sun Microsystems, Inc. in the Un ited States and other countries.
Other company, product, and service names may be trademarks or service marks of
others.
Notices
References in this publication to Tivoli Systems or IBM products, programs, or
services do not imply that they will be availabl e in all countries in which
Tivoli Systems or IBM operates. Any reference to these products, programs, or
services is not intended to imply that only Tivoli Systems or IBM products,
programs, or services can be used. Subject to valid intellectual property or
other legally protectable right of Tivoli Systems or IBM, any functionally
equivalent product, program, or service can be used instead of the referenced
product, program, or service. The evaluation and verification of operation in
conjunction with other products, except those expressly designated by Tivoli
Systems or IBM, are the responsibility of the user. Tivoli Systems or IBM may
have patents or pending patent applications covering subject matter in this
document. The furnishing of this document does not give you any license to
these patents. You can send license inquiries, in writing, to the IBM Director
of Licensing, IBM Corporation, North Castle Drive, Armonk, New York 10504 -1785,
iii
U.S.A.
iv
v
About the Tivoli Field Guides
Sponsor
Tivoli Customer Support sponsors the Tivoli Field Guide program.
Authors
Those who write field guides belong to one of these three groups:
Tivoli Support and Services Engineers who work directly with customers
Tivoli Customers and Business Partners who have experience using Tivoli software in a
production environment
Tivoli developers, testers, and architects
Audience
The field guides are written for all customers, both new and existing. They are applicable to
external audiences including executives, project leads, technical leads, team members, and to
internal audiences as well.
Field Guides for technical issues are designed to address specif ic technical scenarios or
concepts that are often complex to implement or difficult to understand, for example:
endpoint mobility, migration, and heartbeat monitoring.
Field Guides for business issues are designed to address specific business practices tha t
have a high impact on the success or failure of an ESM project, for example: change
management, asset Management, and deployment phases.
Purposes
The Field Guide program has two major purposes:
Availability
All completed field guides are available free to registered customers and internal IBM employees
at the following Web site:
http://www.ibm.com/software/sysmgmt/products/support/Field_Guides.html
vii
mailto:Tivoli_eSupport_Feedback@us.ibm.com
viii
Table of Contents
OVERVIEW ................................................................................................... 1
ix
RESTORE PROCESSING ..................................................................................................... 6
ACTIVATION .................................................................................................................... 6
DETERMINE THE MISSING NLO FILES ............................................................................. 6
RESTORE THE MISSING NLO FILES .................................................................................. 7
RESYNCHRONIZE THE DAOS CATALOG .......................................................................... 7
RESTORE AT DOCUMENT LEVEL ...................................................................................... 7
EXAMPLE...................................................................................................... 9
SETUP PROCESSING .......................................................................................................... 9
BACKUP PROCESSING ..................................................................................................... 10
Backup the Database ................................ ................................ .................. 10
Backup the NLO Files ................................ ................................ .................. 11
CREATE THE CONDITION TO BE RECOVERED FROM ....................................................... 12
RESTORE PROCESSING ................................................................................................... 12
Restore the Database ................................ ................................ .................. 12
Activate the Restored Database ................................ ................................ ..13
Restore the NLO File ................................ ................................ ................... 16
Restore at Document Level ................................ ................................ .........17
x
Data Protection for Domino Support for Domino
8.5
Using Data Protection for Domino to Backup and Restore Domino 8.5
with DAOS
Data Protection for Domino provides a full c apacity to backup and restore Domino 8.5 NSF and
NTF databases and transaction logs either offline or online. This document provides an overview
of the Data Protection for Domino product and describes the additional steps necessary to
backup and restore Domino 8.5 NLO files.
1
Overview
With version 8.5, IBM Lotus Domino server employs the Domino attachment and object service to
save significant space at the file level by sharing data identifie d as identical between databases
(applications) on the same serv er in NLO files. In databases that use DAOS, the Domino server
no longer saves a separate and complete copy of every document attachment. Instead, the
server saves a reference to each attached file in an NLO file, and it refers to the same NLO file
from multiple documents in one or more databases on the same server. NLO files may be present
on a Domino 8.5 server if DAOS is enabled on the server, and DAOS participation has been
elected for some of the NSF databases.
NLO files are not supported by Data Prot ection for Domino. They must be backed up and
restored using the Tivoli Storage Manager Backup -Archive Client. If DAOS is not enabled for an
individual NSF, and/or on the server, the current Data Protection for Domino backup and restore
procedures should be followed.
2
Domino Server Backup and Restore Strategy
Considerations
You can choose different backup strategies depending on your specific requirements regarding
network traffic, backup window, and acceptable restore times. Your choice of strategy will include
selecting the type of backup commands to use and the type of transaction logging to be done on
the Domino server.
1
Use Data Protection for Domino to Backup NSF and
NTF Databases
Data Protection for Domino provides backup and restore functions for t he Domino NSF and NTF
databases (including template files) and associated transaction logs. However, Data Protection
for Domino does not provide a complete disaster recovery solution for a Domino server by itself.
You need to use the Tivoli Storage Manager Backup-Archive Client in conjunction with Data
Protection for Domino for a complete disaster recovery solution.
The backup of the NLO files should be d one after the backup of the NSF and NTF databases.
This will ensure that the NLO files in the backup are a superset of what is referenced by the NSF
databases.
The DAOS deferred delete interval should be set to be longer than the interval between backups.
If the backups are done weekly, the shortest recommended DAOS deferred delete interval is 8
days. Setting the delete interval longer than the backup interval will guarantee that all NLO files
will be backed up. If there is a retention limit for backups, th e DAOS delete interval should be set
to longer than that retention limit to ensure that all referenced NLO files will exist if a NSF
database is restored from the oldest backup.
Personal copies (replicas) of Domino databases that are stored on Notes clients (not on the
Domino server) are not protected by Data Protection for Domino. You can use the Tivoli Storage
Manager Backup-Archive Client on the Notes client platform to backup and restore these files or
rely on Domino server replication if you need to recover them .
2
Other Considerations
To restore an individual Notes document, you must restore the entire database with an alternate
name. Choose a time when the document existed for both the restore /pit and activate /applylogs
commands but before the document was de leted, and then copy the desired document using the
Notes client.
Data Protection for Domino can only backup transaction logs from a Domino server that has
archival logging in effect. Transaction logs cannot be backed up from a Domino server that has
circular or linear logging in effect.
When using archival transaction logging, the frequency of the archivelog command use depends
on the size of your log and the rate of change for logged databases. Perform archival transaction
logging several times per day if you generate a large volume of changes at a rapid rate.
When restoring a group of logged databases for which transactions need to be applied, activate
them together when possible. This avoids restoring the same transaction log files multiple times.
Restored transaction log files are deleted during a database recover y by the Domino server.
Activating and applying logs to the database separately requires retransmitting log files for each
database.
3
Domino Database Backup
Data Protection for Domino can perf orm full and incremental online backups of individual NSF
and NTF databases when archival logging is in effect. If archival loggin g is not in effect, only full
offline backups of NSF databases can be performed.
NSF and NTF databases should be backed up usi ng Data Protection for Domino to ensure that
an internally consistent image of the NSF is saved and that the Domino transaction logs are
archived as part of the backup process. Attempting to back up an NSF or NTF database without
using Data Protection for Domino while the Domino server is running (and possibly in the process
of modifying the file) may result in an unusable image being saved.
Data Protection for Domino provides two types of database backups: incremental and selective.
Incremental Backups
An incremental backup will perform a full online backup of Domino databases under the following
conditions:
1. The database is within the Domino data path or symbolically linked to the Domino data
path by directory or database links.
2. The database is not excluded from backup by exclude statements within the Tivoli
Storage Manager include-exclude options file.
3
3. If the database is logged, the DBIID has changed.
4. If the database is not logged, it has been modified since the last backup occurred (data
and non-data modification dates are checked).
The incremental command includes a function that determines if active backup database copies
exist on the Tivoli Storage Manager server that were deleted from the Domino se rver or excluded
from backup. If so, they are marked inactive so automatic expiration of these backup copies can
occur according to defined management class parameters for backup files.
The incremental command normally specifies a wild card qualified name, and the databases that
match the wild card qualification and meet the selection criteria for an incremental backup will be
backed up.
It is recommended to use the Tivoli Storage Manager Backup -Archive Client incremental
command to backup NLO files because once they are written they are never changed. If selective
backups of the NLO files are made, each additional backup of the same file results in an identical
additional backup. If incremental backups of the NLO files are made, only a single backup file is
created.
When backing up NSF and NLO files, first backup the NSF databases and then backup the NLO
files.
The Data Protection for Domino command to incrementally backup NSF databases is
The Tivoli Storage Manager Backup-Archive Client command to incrementally backup all NLO
files is
Notice that the Tivoli Storage Manager Client incremental backup command of the NLO files must
specify the fully qualified path name of the NLO files to be backed up.
Selective Backups
A selective backup unconditionally backs up the specified databases, unless they are excluded
from backup through exclude statements within the Tivoli Storage Manager include -exclude
options file.
It is not recommended to use the Tivoli Storage Manager Backup -Archive Client selective
command to backup NLO files because once they are written they are never changed. If selective
backups of the NLO files are made, each additional backup of the same file results in an
additional identical backup.
When backing up NSF, NTF, and NLO files, first backup the NSF and NTF databases and then
incrementally backup the NLO files .
The Data Protection for Domino command to selectively backup NSF databases is
4
domdsmc sel database_se lection_criteria
The Tivoli Storage Manager Backup -Archive Client command to incrementally backup all NLO
files is
4
Domino Transaction Log Archive
Data Protection for Domino provides the capability to create archives of transaction logs when
archival logging is in effect. There are no changes required in archiving Domino transaction logs
when DAOS is enabled.
A transaction log captures database changes so full database backups are not required as
frequently. Updates to a logged database are recorded in the Domino server transaction log.
Changes to a database since the last full backup can be applied from the transaction log after the
backup is restored from the last full backup. Enabling transaction logging for al l databases on a
Domino server is not required, so the backup process must handle both logged and non -logged
databases. Domino allows the active transaction log to be backed up , as well.
The Data Protection for Domino archive log capability stores filled t ransaction log files on the
Tivoli Storage Manager Server so that space allocated for these files can be reused by the
Domino logger. The archivelog command is available when transaction logging on the Domino
server is enabled in archival mode. Filled tran saction log files must be archived frequently enough
to ensure the transaction log never fills completely and stops the Domino server.
Transaction log files stored on the Tivoli Storage Manager server are automatically restored as
needed for a database rec overy.
Archived transaction log files are retained on the Tivoli Storage Manager server as long as a
database backup exists that needs these log files for a complete recovery.
The Data Protection for Domino command to archive the Domino server transaction log is
domdsmc archivelog
Note: When circular or linear loop logging is used on the Domino server (or when logging is
disabled on the Domino Server), transaction log files are not archived.
5
Domino Database Restore
5
The restoration of a Domino NSF or NT F database is a two-step recovery process. The first step
is to use the Data Protection for Domino domdsmc restore command to restore one or more
databases from the Tivoli Storage Manager server backup storage to the Domino server.
The second step is to use the Data Protection for Domino domdsmc activate command to bring
the restored databases online for use by the Domino server and optionally apply transactions
from the transaction log to update the database to the latest level.
These two steps can be comb ined into one step by specifying the / activate=yes option on the
restore command.
When the restored NSF database is enabled for DAOS, then one or more NLO files may also
need to be recovered and additional steps are required. The first step is to determine if there are
any missing NLO files referenced by the restored NSF databases. If there are missing NLO files,
a second additional step is necessary to use the Tivoli Storage Manager Backup -Archive Client to
restore the required NLO files.
Restore Processing
The restore process retrieves previously backed up copies of the databases to be restored from
the Tivoli Storage Manager server and restores them to the Domino server storage. You can
restore the database with the original name (replace), with a diffe rent database file name, to the
same name in a different Domino server directory, or to a different Domino server.
Activation
After the NSF and NTF database(s) have been restored, the Data Protection for Domino
domdsmc activate command is used to apply any changes to the restored databases from the
recovery logs and to activate the NSF and NTF databases that are being restored.
This activation step brings restored databases online for use by the Domino server. You can
optionally apply transactions from the transaction log to update the database. Transactions can
be applied up to a specific point in time or up through the most recen t changes recorded in the
transaction log. If archival logging is in effect, Data Protection for Domino automatically restores
archived transaction log files as needed.
The Data Protection for Domino command to activate and apply logs to one or more databa ses is
6
Issue the DAOS Manager tell daosmgr listnlo command from the Domino server console to
discover the names of any missing NLO files that are referenced by the restored NSF databases.
If the DAOS deferred delete interval is longer than the age of the restored backup, there will be
no missing NLO files. However , if the age of the backup is greater than the DAOS deferred delete
interval, you may also have to restore the missing NLO files.
The server command to determine the NLO files that must also be restored is
The file missingnlo.txt contains a list of NLO files that are referenced by the restored NSF
database that are not found on the Domino server. {They are output in fully -qualified form.}
Note the option –latest on the restore command. Thi s option specifies that the latest copy,
whether active or inactive, should be used. If this option is not specified and the nlo file has been
expired by an incremental backup, you will get the message “ANS1302E No object on server
match query” and the restore operation will fail.
If the catalog is still synchronized after the restoration, this command will simply close.
A database can be restored to the production server under a temporary name , and the desired
document can be copied to the appropri ate database. If, for performance reasons, the production
server cannot be used in the restore process, the database can be restored to an alternate server
and copied to the production server. It is recommended that you perform alternate server restores
when possible to reduce demands on the Domino production server. Alternate server restores
can be performed to an alternate partition or to a separate Domino server by using the following
steps:
7
2. The user can copy the necessary documents from the restored NSF to the live NSF .
3. When the user has finished copying the data from the restored NSF to the live NSF,
delete the restored NSF.
4. If the document includes a DAOS attachment, restore any missing NLO files and
resynchronize the DAOS catalog with the tell daosmgr resync command to repair the
reference counts.
6
Disaster Recovery
You need to use the Tivoli Storage Manager Backup -Archive Client in conjunction with Data
Protection for Domino for a complete disast er recovery solution. Disaster recovery of a Domino
server requires rebuilding the directory structure, restoring the non -database files with the Tivoli
Storage Manager Backup-Archive Client, and recovering the database files to the latest level with
Data Protection for Domino. The following steps outline the process to be followed while
recovering a Domino server. The existence of NLO files only changes the first step where NLO
files are recovered along with other non -database files such as notes.ini.
1. Make sure the new installation is configured in the same manner as the damaged one
(for example, the same directory structure, d irectory location, and logdir path).
2. Use the Tivoli Storage Manager Backup -Archive Client to recover the non-database
Domino server files such as notes.ini, cert.id and server.id. If a Domino attachment and
object service is present, the NLO files should also be r ecovered at this time.
3. Use a text editor to modify the notes.ini file for the Domino server with this setting:
TRANSLOG_Status=0
4. Use Data Protection for Domino to restore the transaction log file to be used in the log
recovery procedure. This should be the last transaction log file archived prior to the loss
of the active transaction log.
5. Delete the contents of the Domino t ransaction log directory except for the log file restored
in Step 4.
6. Use a text editor to modify the notes.ini file for the Domino server with these settings:
TRANSLOG_Recreate_Logctrl=1TRANSLOG_Status=1
7. Use Data Protection for Domino to restore (but no t to activate) the databases you want
to recover to the latest level within the archived log extents.
8. Use the Tivoli Storage Manager Backup -Archive Client to recover the latest NLO files.
9. Use Data Protection for Domino to activate the databases you are rec overing and apply
transaction logs. (The TRANSLOG_Recreate_Logctrl parameter in the notes.ini file will
be automatically reset to 0).
10. Launch the Domino server. With the disaster recovery complete, it is now safe to start the
Domino server and execute server tasks and functions.
11. Use the Selective backup function in Data Protection for Domino to perform full backups
of all databases. (This is recommended to ensure proper recoverability using subsequent
transaction log files).
12. Use Data Protection for Domino to archive the transaction log. The transaction log file
used in the recovery procedure will be modified and available for archiving. This
transaction log will also have the ID of the current logger.
8
Restore of Archived Transaction Logs
This Data Protection for Domino function allows a single, archived transaction log file to be
restored independently of a routine database restore. Restoring a single, archived transaction log
file assists with disaster recovery operations. By retrieving the most recent a rchived log file, it is
possible to rebuild the Domino transaction log control file. This allows archived transaction log
files to be used to recover restored database backups to a more current state, even after a loss of
the active transaction log. Note t hat more than one archived transaction log file can be restored at
a time.
8
Example
This chapter provides a complete example of restoring an individua l document and its attachment
in a Notes database that uses the Domino attachment and object service.
Setup Processing
The first step in this process is to create a Notes database with the DAOS enabled. Once the
database has been created, add a new docume nt (containing an attachment) to the database.
The picture below shows the test Journal database entry with a jpg file attached :
9
The Domino 8.5 server stores the attachment in an NLO file. If you look in the
notesdata/DAOS/0001 directory with the UNIX Is command, you should see an NLO file
corresponding to the document and its attachment.
> ls
FB662CBD45033E03F65E0F278F44F4206A3C429300014752.nlo
Backup Processing
Backup the Database
You should backup the database with Data Protection for Domino after all changes have been
made to the test database.
The following shows the results of issuing a Data Protection for Domino command to backup the
test database:
10
ACD5221I The /opt/tivoli/tsm/client/domino/bin64/domdsmc_notes/domdsm.log log file has been
pruned successfully.
Notice that the Tivoli Storage Manager Backup -Archive Client command specifies the fully
qualified name of the NLO files to be backed up, “/local/notesdata/DAOS/* -su=yes. The
“DAOS/*” indicates that everything in the DAOS directory and everything in the next level are to
be backed up.
The following shows the results of issuing a Tivoli Storage Manager Backup-Archive Client
incremental backup command to backup NLO files:
11
Total number of objects inspected: 1
Total number of objects backed up: 1
Total number of objects updated: 0
Total number of objects rebound: 0
Total number of objects deleted: 0
Total number of objects expired: 0
Total number of objects failed: 0
Total number of bytes transferred: 82.15 KB
Data transfer time: 0.00 sec
Network data transfer rate: 315,966.79 KB/sec
Aggregate data transfer rate: 38.51 KB/sec
Objects compressed by: 0%
Elapsed processing time: 00:00:02
If you have multiple databases or documents that attach the same file, there will be only one NLO
entry and the creation date of the NLO file will correspond to the date of the f irst attachment. You
can still delete the NLO file, but its deletion will affect all databases and documents that reference
that attachment.
First delete the document in myattachjou1.nsf containing the attachment, then swit ch to the
DAOS directory and remove the NLO file containing the attachment for myattachjou1.nsf. The
example below changes to the DAOS/0001 directory, lists the files in that directory , and then
deletes the NLO file.
> cd /local/notesdata/DAOS/0001
> ls
FB662CBD45033E03F65E0F278F44F4206A3 C429300014752.nlo
> rm *
> ls
Restore Processing
Restore the Database
The first step in restoring an individual document in a database is to restore a down level copy of
the database containing the document to be recovered to an alternate directory. In th is example,
the directory recoverDir is the alternate directory used to restore the down level database.
The following shows the results of issuing a Data Protection for Domino command from the
database to the alternate directory recoverDir.
12
Data Protection for Lotus Domino
Version 5, Release 5, Level 1.02
(C) Copyright IBM Corporation 1999, 2008. All rights reserved.
Notice that the restore operation issued the following informational message
This is a good time to issue the tell daosmgr resync command on the Domino server console.
notes@sjtlnx07:/local/notesdata/ recoverDir> ls
myattachjou1r.nsf.dad
13
You must issue the Data Protection for Domino activate command to make the database
available.
Recovery is not complete at this point. The Notes database has been recovered, and the deleted
document can be viewed.
You can access the document in recoverDir/myattachjou1r.nsf now, and it looks like everything is
restored.
14
But when you try to view the attachment, a “File does not exist” erro r is displayed.
15
And the server console also shows a missing file message
You can also easily discover the names of the missing file(s) by issuing the tell daosmgr listnlo
command and then examining the file lis tnlo.txt.
cat /local/notesdata/listnlo.txt
/local/notesdata/DAOS/0001/FB662CBD45033E03F65E0F278F44F4206A3C429300014752.nlo
Note the option –latest on the restore command. This option specifies that the latest copy,
whether active or inactive should be used. If this option is not specified and the NLO file has been
expired by an incremental backup, you will get the message “ANS1302E No object on server
match query” and the restore operation will fail.
Restoring 84,091
/local/notesdata/DAOS/0001/FB662CBD45033E03F65E0F278F 44F4206A3C429300014752.nlo
[Done]
16
Restore processing finished.
Once the missing NLO file has been restored, you can view the document an d its attachment
17
3. When the user has finished copying the data fro m the restored database to the live
database, delete the restored database r ecoverDir/myattachjour.nsf.
18