Project

General

Profile

Setup job submission server » History » Revision 6

Revision 5 (Neil Voss, 05/19/2010 02:16 PM) → Revision 6/43 (Neil Voss, 05/19/2010 03:17 PM)

h1. Setup job submission server 

 In this case, we are setting h2. Setting up a job submission server that will have all of the data directories mounted and external packages installed (EMAN, Xmipp, etc.) PBS on the system. Most institutions have a job submission processing server already, but the data is not accessible. Appion is not set up for this scenario except for large reconstruction jobs. side  

 h2. Install PBS and the Torque Resource Manager 

 PBS stands for You'll need to install a "Portable Batch System":http://en.wikipedia.org/wiki/Portable_Batch_System. It is a System":http://en.wikipedia.org/wiki/Portable_Batch_System for job submission system meaning that users submit many jobs and the server prioritizes and executes each job submission, such as resources permit. Below we show how to install the popular open source PBS system called "TORQUE":http://en.wikipedia.org/wiki/TORQUE_Resource_Manager.  

 A TORQUE cluster consists of one head node and many compute nodes. The head node runs the *pbs_server daemon* and the compute nodes run the *pbs_mom daemon*. Client commands for submitting and managing jobs can be installed on any host (including hosts not running pbs_server or pbs_mom). More documentation about Torque is "available here.":http://www.clusterresources.com/products/torque/docs/ 

 h2. Head node installation 

 h3. Install Torque-server 

 Torque available in comes with Fedora and CentOS 5.4 (through the EPEL). 5.4. For YUM based systems type: 

 <pre> 
 sudo yum -y install torque-server torque-scheduler 
 </pre> 

 h2. Compute node installation 

 h3. Install Torque-mom 

 Torque available in with Fedora and CentOS 5.4 (through the EPEL). For YUM based systems type: 

 <pre> 
 sudo yum -y install torque-mom torque-client 
 </pre> 

 h3. Activate Torque-mom 

 Enable the After installing torque pbs_mom daemon on reboot: 

 <pre> 
 sudo /sbin/chkconfig pbs_mom on 
 sudo /sbin/service pbs_mom start 
 </pre> it needs to be configured. Sorry, we have no documentation for configuring torque at this time. You may try http://www.clusterresources.com/products/torque-resource-manager.php 

 _________ 

 [[Setup Remote Processing|^ Setup Remote Processing]] | [[Configure web server to submit jobs|Configure web server to submit jobs >]] 

 ______