Project

General

Profile

Setup Remote Processing » History » Revision 23

Revision 22 (Amber Herold, 05/13/2011 10:11 AM) → Revision 23/24 (Amber Herold, 05/08/2012 11:01 AM)

h1. Setup Remote Processing 

 The web interface for Appion allows one to directly login to a computer and process Appion jobs. But this requires a job submission system to be installed. 

 h2. Types of clusters: 

 * Local cluster a.k.a. processing host — This is a cluster that has all of the data directories mounted locally and all processing software installed. This configuration is used for all jobs except Refine Reconstruction jobs. 
 * Refine Reconstruction cluster a.k.a. cluster — This is a cluster that is used for Refine Reconstruction jobs. It therefore only needs a limited selection of software. It is possible that the data is not accessible and will need to be transfered for processing.  

 *Note:* The Local Cluster and Refine Reconstruction Cluster can be the same machine, but you will still need to perform all the setup instructions below for each type of cluster. 

 h2. Local Cluster Appion processing setup 

 The following applies to both the web-server computer (setup earlier) and a job submission system on a local cluster. The job submission system usually consists of a head node (main computer) for receiving and scheduling jobs and individual processing nodes (slave computers) for running jobs. All of these system CAN exist on an single computer. 

 # [[Setup job submission server]] 
 # [[Install SSH module for PHP]] 
 # [[Configure web server to submit job to local cluster]] 
 # [[Testing job submission]] 
 # [[Potential job submission problems]] 

 h2. Appion Refinement Reconstruction Processing through ssh setup 

 # [[Configure_web_server_to_submit_jobs|Edit the default_cluster.php file]] (Appion version 2.1 and earlier only) 



 ______ 

 [[Create a Test Project|< Create a Test Project]] 

 ______