Project

General

Profile

Setup Remote Processing » History » Version 10

Neil Voss, 05/19/2010 02:12 PM

1 9 Neil Voss
h1. Remote Processing Setup
2
3
The web interface for Appion allows one to directly login to a computer and process Appion jobs. But this requires a job submission system to be installed.
4
5
The following applies to the both a web-server computer (setup earlier) and job submission system. The job submission system usually consists of a head node (main computer) and individual processing nodes (slave computers) for running jobs. As of these system can exist on an individual computer.
6
7
# [[Setup job submission server]]
8
# [[Configure web server to submit jobs]]
9 10 Neil Voss
# [[Testing job submission]]
10 9 Neil Voss
# [[Potential Problems]]
11 2 Amber Herold
12 1 Amber Herold
13 5 Neil Voss
h2. Testing 
14 1 Amber Herold
15 5 Neil Voss
h3. Testing php-ssh2 installation
16 1 Amber Herold
17
Check your info.php as you did with mrctool installation.  Corrected installed extension should show up in the output of info.php.  Reference http://emg.nysbc.org/documentation/leginon/bk02ch04s07.php under the section *Check php information* and *Alternative approach if mrc module does not show up in info.php output*.
18
19 5 Neil Voss
h3. Testing ssh log in 
20 1 Amber Herold
21
Use the top right form on the processing page to log in as if doing an ssh session. The page will acknowledge that you have been logged in if the setup is correct.  You will be able to edit description of a run and to hide failed runs when logged in. The option for submitting the job appears at the bottom of the processing form whenever available.
22
23 5 Neil Voss
h3. Testing simple appion processing job submission 
24 1 Amber Herold
25
Upload template is a good example to try:
26
# Create a small mrc image as your template to be uploaded.
27
# Select Upload template in Import tools in the appionweb processing menu of an existing session.
28
# Type in the needed information.
29
# When you finish filling the form, instead of clicking on "Just show command", choose your processing host and run the job by clicking "Upload Template".
30
# For simple process such as this, the webpage will take a little while to refresh until the job is completed.
31
# If you get the message "Template is uploaded", the process is successful and if you refresh the page you will find the template in the available list. 
32
33 5 Neil Voss
h3. Testing PBS-required appion processing job submission 
34 1 Amber Herold
35
Particle selection such as DogPicker is a good example to try:
36
# Click on DoG Picking under Particle Selection menu
37
# Enter the required parameters
38
# When you finish filling a form for an appion processing, choose your processing host and run the job.  Pages for monitoring the job become available after the job is queued and subsequently begins running. If the status appears as "Running or Queued" at first, the setup is likely correct.
39
# After a while, the process will be completed and the status becomes "Done" when you click to have the Status updated on the page.
40
41 5 Neil Voss
h3. Check _your_cluster.php_ setup 
42 1 Amber Herold
43
For reconstructions involving iterations of different parameters such as EMAN reconstruction by refinement, the _your_cluster.php_ is used to generate the script.  Examine the script created on the web form and modify _your_cluster.php_  You can copy the script to your cluster and test run/modify it until it is correct.
44 3 Amber Herold
45
46
______
47
48
[[Create a Test Project|< Create a Test Project]]
49 4 Amber Herold
50
______