Project

General

Profile

Actions

Setup Remote Processing

The web interface for Appion allows one to directly login to a computer and process Appion jobs. But this requires a job submission system to be installed.

Types of clusters:

  • Local cluster a.k.a. processing host — This is a cluster that has all of the data directories mounted locally and all processing software installed. This configuration is used for all jobs except Refine Reconstruction jobs.
  • Refine Reconstruction cluster a.k.a. cluster — This is a cluster that is used for Refine Reconstruction jobs. It therefore only needs a limited selection of software. It is possible that the data is not accessible and will need to be transfered for processing.

Note: The Local Cluster and Refine Reconstruction Cluster can be the same machine, but you will still need to perform all the setup instructions below for each type of cluster.

Local Cluster Appion processing setup

The following applies to both the web-server computer (setup earlier) and a job submission system on a local cluster. The job submission system usually consists of a head node (main computer) for receiving and scheduling jobs and individual processing nodes (slave computers) for running jobs. All of these system CAN exist on an single computer.

  1. Setup job submission server
  2. Install SSH module for PHP
  3. Configure web server to submit job to local cluster
  4. Testing job submission
  5. Potential job submission problems

Appion Refinement Reconstruction Processing through ssh setup

  1. Edit the default_cluster.php file (Appion version 2.1 and earlier only)

< Additional Database Server Setup After Web Server Installation | Create a Test Project >


Updated by Amber Herold over 10 years ago · 24 revisions