Setup Remote Processing » History » Revision 16
Revision 15 (Neil Voss, 05/27/2010 02:55 PM) → Revision 16/24 (Neil Voss, 05/27/2010 04:02 PM)
h1. Setup Remote Processing The web interface for Appion allows one to directly login to a computer and process Appion jobs. But this requires a job submission system to be installed. h2. Types of clusters: * Local cluster a.k.a. processing host — this is a cluster that has all of the data directories mounted locally and all processing software installed * Remote cluster a.k.a. cluster — this is a cluster that has a limited selection of software and the data is not accessible The following applies to the both a web-server computer (setup earlier) and job submission system on a local cluster. system. The job submission system usually consists of a head node (main computer) and individual processing nodes (slave computers) for running jobs. All As of these system CAN can exist on an single individual computer. # [[Setup job submission server]] # [[Install SSH module for PHP]] # [[Configure web server to submit job to local cluster]] jobs]] # [[Testing job submission]] # [[Potential job submission problems]] h2. Remote Appion Processing through ssh A more advanced way to run appion script is done through an ssh session. This is equivalent of having you ssh into a computer and starting the appion processes. # [[Edit There are two kinds of appion processes: * The first is a single-node process that can be run on a stand-alone workstation or the default_cluster.php file]] head-node of a computer cluster without PBS. * The second is a multiple-node process that requires PBS to run on the cluster. When you use "Just Show Command" option, it is always a single-node process, but if you run through ssh it could be either, depending on the demand of the process. For example, imageuploader.py is typically always run as single-node process while maxlikeAlignment.py is either run on single-node with "Just Show Command" or as a PBS job submission when you run through ssh. ______ [[Create a Test Project|< Create a Test Project]] ______