Setup movie upload with diffrtransferpy » History » Revision 3
Revision 2 (Anchi Cheng, 04/29/2020 07:21 PM) → Revision 3/5 (Anchi Cheng, 04/29/2020 07:29 PM)
h1. Setup movie upload with diffrtransferpy
leginon/diffrtransfer.py is used to convert raw binary files from TIA to smv format that is more familiar to crystallography community and upload them to leginon database to be viewed through myamiweb. This is set up similarly to rawtransfer.py that is used to transfer direct detector frame movies.
<pre>
python diffrtransfer.py
Usage: diffrtransfer.py [options]
Options:
-h, --help show this help message and exit
--source_path=PATH Mounted parent path to transfer, e.g. --source_path=/mnt/microed
--check_interval=CHECK_INTERVAL
Seconds between checking for new data
--no_wait optional flag: Catch up upload without waiting for more images to come per series
</pre>
1. Mount TIA_EXPORTED_DATA_NETWORK_DIR in fei.cfg on microscope PC TIA_EXPORTED_DATA_NETWORK_DIR on your linux host where diffrtransfer.py will be run from. This mounted point is --source_path
2. The default check_interval is 40 seconds.
3. The script needs access to the same libraries leginon needs as well as the database. It is therefore easiest to run as root like a service on the leginon processing host.
4. Files that failed, typically due to timing of data transfer, user interruption of data collection, are moved to a subdirectory bad_diffraction_series_id on the source_path. If it is determined later that these files are o.k. to upload, moving the *.bin will expose them for transfer again.
For example, the following will check and process all *.bin files in /mnt/microed and repeat every 30 seconds for new ones.
<pre>
python diffrtransfer.py --source_path=/mnt/microed --check_interval=30
</pre>