Minimum Requirements and current NRAMM setup » History » Version 29
Anchi Cheng, 10/21/2013 09:26 PM
1 | 1 | Amber Herold | h1. Minimum Requirements and current NRAMM setup |
---|---|---|---|
2 | |||
3 | h2. Electron Microscope with its Controling Computer (Windows) |
||
4 | 6 | Anchi Cheng | |
5 | 16 | Anchi Cheng | Microscope need to have the capacity for external control and network connected (See [[Network Configuration]] section for details on that. Here are known examples of Leginon implementation: |
6 | |||
7 | * FEI: Tecnai, Polara, Titan Krios with TEM Scripting |
||
8 | * JEOL: 1230, JEM3100FSC |
||
9 | 1 | Amber Herold | |
10 | 19 | Anchi Cheng | h2. Digital Camera |
11 | 1 | Amber Herold | |
12 | 21 | Anchi Cheng | Gatan, Tietz, FEI Eagle-minimal 1kx1k, Direct Electron DE-12 |
13 | 20 | Anchi Cheng | |
14 | 27 | Anchi Cheng | *Note: We are working on FEI Falcon camera integration.* |
15 | 23 | Anchi Cheng | |
16 | 7 | Anchi Cheng | h2. A Second Computer Running Linux (CentOS at NRAMM) |
17 | 1 | Amber Herold | |
18 | 8 | Anchi Cheng | At NRAMM, we separate the three activities into different computers that serve about 15 people with three microscopes that could be running at the same time. All scopes share the same database, web server, and file server. Each microscope has its own processing computer. |
19 | 5 | Anchi Cheng | |
20 | 28 | Anchi Cheng | *We don't recommend using a computer with Windows PC as the second computer as an option. One group is able to use an unusually power WIndows PC (The one come with Gatan K2 Summit) as the processing server, though* |
21 | 8 | Anchi Cheng | |
22 | 1 | Amber Herold | h3. CPU |
23 | |||
24 | Minimal 2 GHz; |
||
25 | |||
26 | 8 | Anchi Cheng | NRAMM: |
27 | 7 | Anchi Cheng | |
28 | 8 | Anchi Cheng | * Processing server: Single quad core (Intel Xeon E5540 2 2.53GHz). One computer per microscope. |
29 | * Database server: Duo quad core (2.6GHz) |
||
30 | * Web server: Single quad core (Intel Xeon 3.00GHz) |
||
31 | 6 | Anchi Cheng | |
32 | 1 | Amber Herold | |
33 | |||
34 | h3. RAM |
||
35 | |||
36 | 14 | Anchi Cheng | The whole system with its image processing, database query and web serving, needs a lot of memory. Realistically, you will need minimal of 4GB memory for all processing+database+web server activities for one microscope operation with 4k camera that serves two persons (one operates the scope, one just look at the images from the web viewers) at the same time. We know of at least one successful daily usage at this configuration. For 2k camera, an all-in-one computer with 3GB memory has also been used successfully. If you are buying a new computer, get at least 6GB memory would be a good idea. |
37 | 7 | Anchi Cheng | |
38 | 8 | Anchi Cheng | At NRAMM, to serve about 15 people viewing images and with three microscopes that could be running at the same time: |
39 | 7 | Anchi Cheng | |
40 | 8 | Anchi Cheng | * Processing server: 4GB physical memory and 2 GB swap for years, and now at 6GB and 6GB, respectively. One computer per microscope |
41 | 17 | Christopher Irving | * Database server: 16GB memory and 18GB swap. |
42 | 6 | Anchi Cheng | * Web server: 4GB memory and 6GB swap. |
43 | 1 | Amber Herold | |
44 | |||
45 | |||
46 | |||
47 | |||
48 | h3. Hard drive |
||
49 | |||
50 | |||
51 | |||
52 | 10 GB for the softwares and maybe a few hours worth of data collection. Much larger |
||
53 | 10 | Anchi Cheng | for routine use. NRAMM 45Tb and growing although some are archived. |
54 | 1 | Amber Herold | |
55 | |||
56 | 5 | Anchi Cheng | |
57 | 1 | Amber Herold | |
58 | |||
59 | h3. Network connection speed |
||
60 | 7 | Anchi Cheng | |
61 | 1 | Amber Herold | 100 Mbps might be possible; NRAMM 1 Gbps |
62 | |||
63 | 29 | Anchi Cheng | h2. Special notes about frame-saving camera such as DE-12 and K2 Summit |
64 | |||
65 | These camera are capable of saving movies of an exposure in addition to returning an integrated image back to Leginon. As a result, if the function is used, the disk space required is multiple of that of the image. Leginon saves the frames as non-gain corrected 16-bit integer, rather than dark/gain-corrected 32-float mrc. Therefore, the additional storage requirement is approximately *number_of_frames/2* times larger. Typical number_of_frames used in DE is 10-50 frames and in K2 Summit 20-30 frames. These frames should be off-loaded from the camera computer or saved to network drive as soon as possible so not to over-load the camera computer. |
||
66 | |||
67 | In addition, to use the information in the frame movies, these raw frames must be gain/dark corrected and saved as 32-bit float mrc stack. For K2 Summit Counted/Super-resolution mode, alignment of the frames is also esssential. This means that at some point, the data related to one image will be |
||
68 | <pre> |
||
69 | number_of_frames * (0.5 + 1 + 1) |
||
70 | </pre> |
||
71 | times more than non-frame saving ones. Factoring in that hundreds of such image may be acquired within a 24 hr session, it is therefore important to take this into account in allocating the data storage system for long term. |
||
72 | |||
73 | NRAMM's current setup: |
||
74 | # Raw frames are transferred off camera with rsync using rawtransfer.py which also removed the finished frame stack on the camera to make room for more to come. |
||
75 | # These raw frames are needed if default frame processing does not give optimal results. We keep these on network drive for 30 days and make it user's responsibility to archive this on external drives. |
||
76 | # If frame alignment is performed (usually finished within a day or two after data acquisition), the un-aligned frame stack is removed since majority of the problem require re-correction. |
||
77 | # The frame-aligned stack is integrated and saved in the Leginon database as "-a" images. 95% of the users do not require frame-aligned stack after this point. |
||
78 | |||
79 | 1 | Amber Herold | h2. Leginon system components developed at Leginon home |
80 | 4 | Amber Herold | |
81 | 1 | Amber Herold | Leginon Home: "http://www.leginon.org/":http://www.leginon.org/ |
82 | |||
83 | h2. Supporting packages and programs available through internet or your Linux distribution |
||
84 | |||
85 | There are minimum of ten packages or single programs, some of them are included in your |
||
86 | Linux distribution. |
||
87 | |||
88 | |||
89 | |||
90 | |||
91 | |||
92 | |||
93 | |||
94 | h2. Leginon supporting programs available upon request |
||
95 | |||
96 | |||
97 | |||
98 | 18 | Anchi Cheng | *adaexp.exe* that is required if film exposure is to be made through Leginon on FEI Tecnai |
99 | 13 | Amber Herold | machines is available by request. Please contact Max Otten: (mto at nl.feico.com) |
100 | 2 | Amber Herold | and let him know what version of the Tecnai user interface you are using. |
101 | |||
102 | |||
103 | |||
104 | |||
105 | ______ |
||
106 | |||
107 | [[Graphical User Interface|< Graphical User Interface]] | [[Getting Started|Getting Started >]] |
||
108 | |||
109 | 1 | Amber Herold | ______ |