2010 Appion Developer Workshop » History » Version 8
Neil Voss, 06/08/2010 10:23 AM
1 | 1 | Neil Voss | h1. 2010 Appion Developer Workshop |
---|---|---|---|
2 | |||
3 | h2. Setting up a development enviroment |
||
4 | |||
5 | h4. Subversion |
||
6 | |||
7 | <pre> |
||
8 | svn checkout http://emg.nysbc.org/svn/myami/trunk/ myami/ |
||
9 | </pre> |
||
10 | |||
11 | h4. Sinedon.cfg |
||
12 | |||
13 | At AMI, you do not normally need a sinedon.cfg file, but if you have your own testing environment you will need one. |
||
14 | |||
15 | h4. Web page |
||
16 | |||
17 | At AMI, put myamiweb into your ami_html directory and it will be available on both cronus3 and fly as http://cronus3.scripps.edu/~username/myamiweb/ |
||
18 | |||
19 | You will need to run Eric's web setup wizard to get it working: http://cronus3.scripps.edu/~username/myamiweb/setup/ |
||
20 | |||
21 | |||
22 | |||
23 | ______ |
||
24 | |||
25 | h2. Add a new option to a program |
||
26 | |||
27 | * Problem statement: Add student's T distribution to maxlike alignment, see #552 |
||
28 | * Goal: allow user to use the @-student@ option for maxlike alignment using a radio button |
||
29 | * Steps to implement: |
||
30 | *# add feature to python code |
||
31 | *## add command line input |
||
32 | *## check flag to add to xmipp program |
||
33 | *## insert value into database |
||
34 | *# add feature to web page |
||
35 | *## add radio button to web page |
||
36 | *## add help message |
||
37 | *## receive variable from $_POST |
||
38 | *## check if value is valid |
||
39 | *## add flag to command line |
||
40 | |||
41 | 2 | Neil Voss | h2. Add an output directory to hierarchical classification |
42 | 1 | Neil Voss | |
43 | 2 | Neil Voss | * You cannot change the directory if the filesystem is full. |
44 | 1 | Neil Voss | |
45 | ______ |
||
46 | |||
47 | h2. Organization of the Python programs |
||
48 | |||
49 | We have two major folders in the appion folder: |
||
50 | |||
51 | * appionlib: contains libraries, a collection of common functions that are needed by more than one python program, e.g., ssnrResolution, averageStack, and lowPassFilter. |
||
52 | * bin: contains the programs that take command line input, e.g., makestack2.py, templateCorrelator.py, maxlikeAlignment.py |
||
53 | |||
54 | Other useful directories: |
||
55 | |||
56 | * pyami: a collection of common functions to both appion and leginon, save MRC file, save SPIDER file, etc. |
||
57 | |||
58 | 6 | Neil Voss | h2. Most important python files: |
59 | 1 | Neil Voss | |
60 | 6 | Neil Voss | h3. Database mapping file |
61 | 3 | Neil Voss | |
62 | 1 | Neil Voss | * source:trunk/appion/appionlib/appiondata.py: describes how the database is put together, if you need to add a new column go here |
63 | |||
64 | 3 | Neil Voss | .bq see also source:trunk/leginon/leginondata.py and source:trunk/leginon/projectdata.py |
65 | 1 | Neil Voss | |
66 | 6 | Neil Voss | h3. Appion Script hierarchy |
67 | 1 | Neil Voss | |
68 | 6 | Neil Voss | h4. basicScript |
69 | 5 | Neil Voss | |
70 | 1 | Neil Voss | * source:trunk/appion/appionlib/basicScript.py |
71 | 5 | Neil Voss | * contains all the base functions: @setupParserOptions@, @checkConflicts@, @start@ |
72 | * used only for basic scripts outside of the pipeline, e.g., _source:trunk/appion/bin/makeSnapshots.py_, _source:trunk/appion/bin/ApDogPicker.py_ |
||
73 | 1 | Neil Voss | * write a log file |
74 | 5 | Neil Voss | * running statistics |
75 | 1 | Neil Voss | |
76 | 6 | Neil Voss | h4. appionScript |
77 | 5 | Neil Voss | |
78 | * source:trunk/appion/appionlib/appionScript.py |
||
79 | * Most common function class used 68 programs in appion, e.g., _source:trunk/appion/bin/uploadStack.py_, _source:trunk/appion/bin/subStack.py_, and _source:trunk/appion/bin/maxlikeAlignment.py_ |
||
80 | * based on basicScript, but |
||
81 | ** adds database connection to log information about run |
||
82 | 7 | Neil Voss | ** adds default commandline options, such as @--runname@, @--commit/--no-commit@, @--rundir@, @--projectid@, |
83 | 1 | Neil Voss | |
84 | 7 | Neil Voss | h4. appionLoop2 |
85 | 1 | Neil Voss | |
86 | 7 | Neil Voss | * source:trunk/appion/appionlib/appionLoop2.py |
87 | * based on appionScript but loops over all images in a session |
||
88 | * ideal when the same function needs to be run on all images, e.g. ACE |
||
89 | * used in 15 programs, e.g., _source:trunk/appion/bin/pyace.py_, _source:trunk/appion/bin/pyace2.py_, and _source:trunk/appion/bin/makestack2.py_ |
||
90 | |||
91 | h4. filterLoop |
||
92 | |||
93 | * source:trunk/appion/appionlib/filterLoop.py |
||
94 | * based on appionLoop2 but add low pass, high pass, plane regression and other filters |
||
95 | * used in only two functions, manualmask.py and _source:trunk/appion/bin/jpgmaker.py_ (a program to make jpeg cache images of the session) |
||
96 | |||
97 | h4. particleLoop2 |
||
98 | |||
99 | * source:trunk/appion/appionlib/particleLoop2.py |
||
100 | * based on filterLoop but adds particle picking capabilies |
||
101 | ** creates the jpeg with the circles |
||
102 | ** uploads particle picks to the database |
||
103 | 8 | Neil Voss | * used in 7 different particle pickers, e.g., _source:trunk/appion/bin/manualpicker.py_, _source:trunk/appion/bin/tiltAutoAligner.py_ and _source:trunk/appion/bin/templateCorrelator.py_ |
104 | 7 | Neil Voss | |
105 | |||
106 | 1 | Neil Voss | ______ |
107 | |||
108 | h2. Organization of the PHP programs |
||
109 | |||
110 | |||
111 | |||
112 | ______ |
||
113 | |||
114 | h2. Create a program from scratch |
||
115 | |||
116 | * Problem statement: I have program X that I want to put into the pipeline: |
||
117 | ** EMAN 2d alignment, "refine2d.py":http://blake.bcm.tmc.edu/eman/eman1/progs/refine2d.py.html or "classalign2":http://blake.bcm.tmc.edu/eman/eman1/progs/classalign2.html |
||
118 | ** Bsoft program, nothing really any good |
||
119 | |||
120 | |||
121 | ______ |
||
122 | |||
123 | h2. Create a program, database structure, and report pages from scratch (if time) |
||
124 | |||
125 | * 3D MSA? |