Project

General

Profile

Setup job submission server » History » Version 6

Neil Voss, 05/19/2010 03:17 PM

1 1 Neil Voss
h1. Setup job submission server
2
3 6 Neil Voss
In this case, we are setting up a job submission server that will have all of the data directories mounted and external packages installed (EMAN, Xmipp, etc.) on the system. Most institutions have a job submission server already, but the data is not accessible. Appion is not set up for this scenario except for large reconstruction jobs. 
4 1 Neil Voss
5 6 Neil Voss
h2. PBS and the Torque Resource Manager
6 1 Neil Voss
7 6 Neil Voss
PBS stands for a "Portable Batch System":http://en.wikipedia.org/wiki/Portable_Batch_System. It is a job submission system meaning that users submit many jobs and the server prioritizes and executes each job as resources permit. Below we show how to install the popular open source PBS system called "TORQUE":http://en.wikipedia.org/wiki/TORQUE_Resource_Manager. 
8 1 Neil Voss
9 6 Neil Voss
A TORQUE cluster consists of one head node and many compute nodes. The head node runs the *pbs_server daemon* and the compute nodes run the *pbs_mom daemon*. Client commands for submitting and managing jobs can be installed on any host (including hosts not running pbs_server or pbs_mom). More documentation about Torque is "available here.":http://www.clusterresources.com/products/torque/docs/
10
11
h2. Head node installation
12
13
h3. Install Torque-server
14
15
Torque available in with Fedora and CentOS 5.4 (through the EPEL). For YUM based systems type:
16
17 1 Neil Voss
<pre>
18 6 Neil Voss
sudo yum -y install torque-server torque-scheduler
19 1 Neil Voss
</pre>
20
21 6 Neil Voss
h2. Compute node installation
22
23
h3. Install Torque-mom
24
25
Torque available in with Fedora and CentOS 5.4 (through the EPEL). For YUM based systems type:
26
27
<pre>
28
sudo yum -y install torque-mom torque-client
29
</pre>
30
31
h3. Activate Torque-mom
32
33
Enable the torque pbs_mom daemon on reboot:
34
35
<pre>
36
sudo /sbin/chkconfig pbs_mom on
37
sudo /sbin/service pbs_mom start
38
</pre>
39 2 Neil Voss
40
_________
41
42 5 Neil Voss
[[Setup Remote Processing|^ Setup Remote Processing]] | [[Configure web server to submit jobs|Configure web server to submit jobs >]]
43 2 Neil Voss
44
______