Problem

All backups performed by one media server fail with STATUS 117: Access to perform the
operation was denied

Error

At media server, bptm log:

03:00:43.446 [5996.6060] <2> read_config_file: using 262144 value from C:\Program
Files\Veritas\NetBackup\db\config\SIZE_DATA_BUFFERS
03:00:43.446 [5996.6060] <2> io_init: using 262144 data buffer size
03:00:43.446 [5996.6060] <2> put_long: (11) network write() error: An existing connection
was forcibly closed by the remote host. ; socket = 812
03:00:43.446 [5996.6060] <2> set_job_details: Can't send tfile buffer, errno 2
03:00:43.446 [5996.6060] <16> bptm event_msg_to_monitor: failed to set job_details on
master server <Master-Server-Name>
03:00:43.446 [5996.6060] <2> io_init: CINDEX 0, sched Kbytes for monitoring = 20000
03:00:43.446 [5996.6060] <2> io_set_recvbuf: setting receive network buffer to 1049600 bytes
...
03:00:51.168 [5996.6060] <2> logconnections: BPDBM CONNECT FROM <IP-MediaServer>.52029 TO <IP-Master-Server>.1556 fd = 2800
03:00:52.978 [5996.6060] <2> db_startrequest: protocol error 1
03:00:52.978 [5996.6060] <2> db_begin: db_startrequest() failed: Access to perform the
operation was denied
03:00:52.978 [5996.6060] <2> db_getIMAGE: db_begin() failed: Access to perform the
operation was denied
03:00:52.978 [5996.6060] <2> put_long: (11) network write() error: An existing connection
was forcibly closed by the remote host. ; socket = 828
03:00:52.978 [5996.6060] <2> set_job_details: Can't send tfile buffer, errno 0
03:00:53.197 [5996.6060] <2> vnet_pbxConnect: pbxConnectEx Succeeded
03:00:53.197 [5996.6060] <2> job_connect: SO_KEEPALIVE set on socket 828 for client
<Master-Server-Name>
03:00:53.197 [5996.6060] <2> logconnections: BPJOBD CONNECT FROM <IP-MediaServer>.52030 TO <IP-Master-Server>.1556 fd = 828
03:00:54.070 [5996.6060] <2> job_connect: Connected to the host <Master-Server-Name>
contype 10 jobid <54933> socket <828>
03:00:54.070 [5996.6060] <2> job_connect: Connected on port 52030

03:00:54.492 [5996.6060] <2> get_long: (1) cannot read (byte 1) from network: An existing
connection was forcibly closed by the remote host.
03:00:54.492 [5996.6060] <2> job_monitoring_exex: Failed to get frame type
03:00:54.492 [5996.6060] <2> job_disconnect: Disconnected
03:00:54.492 [5996.6060] <2> ConnectionCache::connectAndCache: Acquiring new connection
for host <Master-Server-Name>, query type 1
03:00:54.710 [5996.6060] <2> vnet_pbxConnect: pbxConnectEx Succeeded
03:00:54.710 [5996.6060] <2> logconnections: BPDBM CONNECT FROM <IP-MediaServer>.52031 TO <IP-Master-Server>.1556 fd = 2800
03:00:56.223 [5996.6060] <2> db_end: Need to collect reply
03:00:56.332 [5996.6060] <16> get_image_info: db_getIMAGE() failed: Access to perform
the operation was denied (117)
03:00:56.332 [5996.6060] <2> bptm: EXITING with status 117 <---------At master server, bpdbm log:
04:00:51.401 [6248.1252] <2> nbconf_create_authorization_service_rec:
../../libvlibs/nbconf_private.c.384: AZ Service Host: <Master-Server-Name>
04:00:51.401 [6248.1252] <2> nbconf_create_authorization_service_rec:
../../libvlibs/nbconf_private.c.385: AZ Service Port: 0 0 0x00000000
04:00:51.542 [6248.1252] <2> logconnections: BPDBM ACCEPT FROM <IP-MediaServer>.52029 TO <IP-Master-Server>.1556 fd = 516
04:00:51.651 [6248.1252] <2> db_valid_master_server: <WRONG-Media-Server-Name> is not
a valid server
...
04:00:52.620 [6248.1252] <2> nbconf_create_authentication_domain_rec:
../../libvlibs/nbconf_private.c.261: AT Domain Name: <WRONG-Media-Server-Name>
...
04:00:52.620 [6248.1252] <2> nbconf_create_authorization_service_rec:
../../libvlibs/nbconf_private.c.384: AZ Service Host: <Master-Server-Name>
04:00:52.620 [6248.1252] <2> nbconf_create_authorization_service_rec:
../../libvlibs/nbconf_private.c.385: AZ Service Port: 0 0 0x00000000
04:00:52.761 [6248.1252] <16> process_request: requestor <WRONG-Media-Server-Name>
is not a valid server for IMAGE request 81
04:00:52.761 [6248.1252] <2> process_request: request complete: exit status 117 Access to
perform the operation was denied; query type: 81

Environment

Master:
Windows 2003
NetBackup 7.1.0.2
Media:
Windows 2008
NetBackup 7.1.0.2

Cause

At master server, make sure that reverse name resolution works fine:
Install_path\veritas\netbackup\bin\bpclntcmd -hn <Media-Server-Name>
Install_path\veritas\netbackup\bin\bpclntcmd -ip <Media-Server-Name>
Make sure that Master server can connect to the Media server:
install_path\netbackup\bin\admincmd\bptestbpcd -client <Media-Server-Name>
Make sure that Media server can connect to the Master server:
install_path\netbackup\bin\admincmd\bptestbpcd -client <Master-Server-Name>
If NBAC is disabled, backups fail with STATUS 37: operation requested by an invalid
server(37)

Solution

Fix name resolution at the master server, then run the following command to remove the host
name / IP address cache use by NetBackup:
install_path\netbackup\bin\admincmd\bptestbpcd -clear_host_cache