Cluster job overview¶

From the user perspective, a refinement job includes 3 parts:

1. Preparation step
   • prepares any data that is needed for the method to be run
   • includes modifying a selected stack to be in any required format
2. Run step
   • User selects which cluster they would like to run the job on
   • The job file is built and submitted to a queue
3. Upload step
   • Results are converted to a format that Appion accepts
   • Converted results are uploaded to the Appion Database

From a programming perspective, the following pieces of code need to be written:

1. GUI prep step launch form
2. Python prep step run script
3. GUI run step launch form
4. Python run step run script
5. GUI upload step launch form
6. Python upload step run script
7. GUI results viewing page

Many of these pieces use the object-oriented programming feature of inheritance to create base classes that take care of common functions.