dGB Wiki | Main / Cluster Processing

http://intranet/wiki/pmwiki.php/Main/ClusterProcessing?action=print

From dGB Wiki

Main: Cluster Processing

The Cluster Processing Utility in OpendTect (Linux only)
1. Prerequisites: Any Cluster Management Tool which can assign jobs to cluster nodes and manage them. We tested it with SLURM which is easy to install and even easier to use. Make sure that SLURM (or equivalent) bin directory is included in your PATH variable. set the value of environment variable DTECT_CLUSTER_PROC to Yes. 2. WorkFlow: Start OpendTect and go to Processing Create Volume output Attribute (3D) Choose Cluster in the Submit to options menu in the resulting window. In the window that pops up on Proceed, specify the number of inlines per job and the paths for storing parameter and script files. In the field named Cluster Processing command, if you are not using SLURM, replace srun with the command in your Cluster Management Tool used to run a process. Make sure the Cluster Management Tool is up and running. In case of SLURM, this means that slurmctld should be running on the master and slurmd should be running on every node. When asked Execute now?, press Yes and the jobs will be submitted to your cluster using the Cluster Processing command specified in the previous step.

Installing SLURM:
Munge installation: cd /usr cp -a /users/arnaud/Documents/munge-0.5.10.tar.bz2 . tar -jxvf munge-0.5.10.tar.bz2 cd munge-0.5.10 ./configure prefix=/usr sysconfdir=/etc localstatedir=/var libdir=/usr/lib64 && make && make install chmod 0700 /etc/munge chmod 0711 /var/lib/munge chmod 0700 /var/log/munge\\ chmod 0755 /var/run/munge cp -a /users/arnaud/Documents/munge.key /etc/munge chown daemon.root /etc/munge/munge.key chmod 0400 /etc/munge/munge.key add in munge below Provides: # Default-Start: 3 5

1 of 2

08/21/2012 04:17 PM

dGB Wiki | Main / Cluster Processing

http://intranet/wiki/pmwiki.php/Main/ClusterProcessing?action=print

# Default-Stop: 0 1 2 6 /etc/init.d/munge start chkconfig munge on

Slurm installation (as root): cd /usr cp -a /users/arnaud/Documents/slurm-2.3.1.tar.bz2 . tar -jxvf slurm-2.3.1.tar.bz2 cd slurm-2.3.1 ./configure prefix=/usr sysconfdir=/etc localstatedir=/var libdir=/usr/lib64 && make && make install Configuration file is at /users/appman/cluster_processing/slurm_statesave/slurm.conf: ln -sf /users/appman/cluster_processing/slurm_statesave/slurm.conf /etc/slurm.conf cp /usr/slurm-2.3.1/etc/init.d.slurm /etc/init.d/slurm edit /etc/init.d/slurm such as CONFIDIR=/etc/ and LIBDIR=/usr/lib64 /etc/init.d/slurm start chkconfig slurm on Monitoring: sview
Retrieved from http://intranet/wiki/pmwiki.php/Main/ClusterProcessing Page last modified on August 21, 2012, at 12:45 PM

2 of 2

08/21/2012 04:17 PM