Minimum Requirements for frame-saving direct detectors » History » Revision 2
Revision 1 (Anchi Cheng, 09/14/2017 06:57 PM) → Revision 2/5 (Anchi Cheng, 09/14/2017 07:23 PM)
h1. Minimum Requirements for frame-saving direct detectors The limitation is the frame processing server. h2. Using gpu-based frame alignment: A good gpu is needed for frame alignment using the program described in Li et. al. (2013) Nat. Method vol. 10 pp584-590 and variants of it. If real-time speed is desired, parallel processing on multiple hosts may be needed. Here is an example that we designed design as a back up for our typically distributed system. Good for a few days of data collection of Krios/K2 combination. collection. - Advanced HPC Mercury GPU408 4U rack mountable workstation - Dual 2.1GHz 8-core CPUs (16 cores total can run database, webserver, leginon, and Appion pre-processing and very minimal post-processing) appion processing) - 128 Gb RAM - 1 Tb SSD scratch space - GTX 1050 GPU for graphical display. - Two GTX 1070 GPU cards (will support real-time frame alignment in counted mode) - 12 Tb of storage in RAID configuration (will support 3-4 days of data collection) - 10GB network card to support direct transfer from K2 camera and connection to the scope. To expand from this: * Add more storage space or connect to a network storage solution. * Add more gpus or have a over-flow frame processing computer to share. h2. Recommendation: Have one primary frame processing computer per direct detector to be used by the person currently using the scope. And an over-flow frame processing computer to share among scopes and users not able to finish during their session. Our experience is that primary frame processing computer can not keep up with super-resolution data collection if binning is not applied ahead of the time. The shared gpu can also be used for gCTF, gAutomatch and other light-weight gpu programs. Counted mode movies can be processed fast enough with just primary frame processing computer. h2. For CPU programs that do frame alignment: A 12 core-computer with Torque scheduler can be used for DE-20 frame alignment. The rest can be used for Leginon data collection if needed. We have not tried it, though.