Project

General

Profile

Setup Remote Processing » History » Version 22

Amber Herold, 05/13/2011 10:11 AM

1 13 Neil Voss
h1. Setup Remote Processing
2 9 Neil Voss
3
The web interface for Appion allows one to directly login to a computer and process Appion jobs. But this requires a job submission system to be installed.
4
5 16 Neil Voss
h2. Types of clusters:
6 1 Amber Herold
7 22 Amber Herold
* Local cluster a.k.a. processing host — This is a cluster that has all of the data directories mounted locally and all processing software installed. This configuration is used for all jobs except Refine Reconstruction jobs.
8
* Refine Reconstruction cluster a.k.a. cluster — This is a cluster that is used for Refine Reconstruction jobs. It therefore only needs a limited selection of software. It is possible that the data is not accessible and will need to be transfered for processing. 
9 1 Amber Herold
10 22 Amber Herold
*Note:* The Local Cluster and Refine Reconstruction Cluster can be the same machine, but you will still need to perform all the setup instructions below for each type of cluster.
11
12 17 Amber Herold
h2. Local Cluster Appion processing setup
13 1 Amber Herold
14 20 Amber Herold
The following applies to both the web-server computer (setup earlier) and a job submission system on a local cluster. The job submission system usually consists of a head node (main computer) for receiving and scheduling jobs and individual processing nodes (slave computers) for running jobs. All of these system CAN exist on an single computer.
15 17 Amber Herold
16 1 Amber Herold
# [[Setup job submission server]]
17 14 Neil Voss
# [[Install SSH module for PHP]]
18
# [[Configure web server to submit job to local cluster]]
19 1 Amber Herold
# [[Testing job submission]]
20
# [[Potential job submission problems]]
21 14 Neil Voss
22 22 Amber Herold
h2. Appion Refinement Reconstruction Processing through ssh setup
23 14 Neil Voss
24 21 Amber Herold
# [[Configure_web_server_to_submit_jobs|Edit the default_cluster.php file]]
25 14 Neil Voss
26
27
28 3 Amber Herold
______
29
30
[[Create a Test Project|< Create a Test Project]]
31 4 Amber Herold
32
______