Bug #2011
closed
Added by Dipali Sashital over 12 years ago.
Updated over 12 years ago.
Affected Version:
Appion/Leginon 2.1.0
Description
I was running some alignments on guppy using cl2d and maxlikeAlignment. I ran into an issue with each of them. For the cl2d run, it was unable to make an average.mrc file. You can see the error in the log file: /ami/data00/appion/12aug09a/align/cl2d2/cl2d2.appionsub.log
For the maxlike run, it appears to not have access to a library, giving the following error:
/opt/Xmipp/bin/xmipp_mpi_ml_align2d: error while loading shared libraries: libmpi.so.0: cannot open shared object file: No such file or directory
You can see the log file here: /ami/data00/appion/12aug09a/align/maxlike6/maxlike6.appionsub.log
Thanks so much for your help!
- Status changed from New to Assigned
- Assignee set to Sargis Dallakyan
How did you run this job? If you used qsub command, please try using qsub -V.
-V Declares that all environment variables in the qsub command’s environment are to be exported to the batch job.
I helped Ryan Hoffman yesterday who was getting similar error message (error while loading shared libraries: libmpi.so.0: cannot open shared object file: No such file or directory). qsub -V solved it for him.
I tried to test cl2d.(/ami/data00/appion/zz07jul25b/align/cl2d25) Did not get so far:
/opt/myamisnap/lib/pyami/tifffile.py:903: UserWarning: Failed to import _tifffile.decodepackbits
warnings.warn("Failed to import %s" % module_function)
/opt/myamisnap/lib/pyami/tifffile.py:903: UserWarning: Failed to import _tifffile.decodelzw
warnings.warn("Failed to import %s" % module_function)
... Time stamp: 12aug21l18
... Function name: runXmippCL2D
... Appion directory: /opt/myamisnap/lib
... Using split database
^[[32mConnected to database: 'ap303'^[[0m
... Committing data to database
... Getting stack data for stackid=88
Old stack info: ^[[36m'test ... 361 eman centered substack id 87'^[[0m
Traceback (most recent call last):
File "/opt/myamisnap/bin/runXmippCL2D.py", line 623, in <module>
cl2d = CL2D()
File "/opt/myamisnap/lib/appionlib/appionScript.py", line 81, in __init__
self.checkConflicts()
File "/opt/myamisnap/bin/runXmippCL2D.py", line 94, in checkConflicts
apDisplay.printError("There is no MPI installed")
File "/opt/myamisnap/lib/appionlib/apDisplay.py", line 57, in printError
raise Exception, colorString("\n *** FATAL ERROR ***\n"+text+"\n\a","red")
Exception: ^[[31m
*** FATAL ERROR ***
There is no MPI installed
^G^[[0m
... Running on host: guppy-29
I am getting a bit further than that with cl2d, but I'm still getting the error that it cannot create average.mrc after making the initial aligned stack. I am also still getting the libmpi errors when running maxlike, even when running with qsub -V.
New cl2d logfile is /ami/data00/appion/12aug09a/align/cl2d2/cl2d2.appionsub2.log
New maxlike logfile is /ami/data00/appion/12aug09a/align/maxlike6/maxlike6.appionsub2.log
Everyone, if you have a .appion.cfg file in your guppy home directory (ls -a to see hidden files), you must add a -V option to the AdditionalHeaders field:
ProcessingHostType=Torque
Shell=/bin/csh
ScriptPrefix=
ExecCommand=/usr/local/bin/qsub
StatusCommand=/usr/local/bin/qstat
AdditionalHeaders= -m e, -j oe, -V
PreExecuteLines=
By doing this, you will be able to launch jobs from the website that use MPI.
CL2D works on Garibaldi for me, and it does not output the following error like guppy does:
/opt/myamisnap/lib/pyami/tifffile.py:903: UserWarning: Failed to import _tifffile.decodepackbits
warnings.warn("Failed to import %s" % module_function)
/opt/myamisnap/lib/pyami/tifffile.py:903: UserWarning: Failed to import _tifffile.decodelzw
warnings.warn("Failed to import %s" % module_function)
This is right at the start of the output file in /ami/data00/appion/zz07jul25b/align/cl2d28.
Do we need to install this tifffile stuff?
Sargis, I have updated everyone's .appion.cfg file in guppy /home dir.
Now I just need you to figure out where the template is for this file for when a new user is added, if there is one, so that can be changed as well.
- Status changed from Assigned to In Test
Thanks Amber and Dipali. I have downloaded Xmipp-2.4-src and installed it on guppy with MPI support:
cd /root/src/Xmipp-2.4-src
./scons.configure QTDIR=/usr/lib64/qt-3.3 MPI_LIBDIR=/usr/lib64/openmpi/lib/ MPI_LIB=mpi MPI_INCLUDE==/usr/include/openmpi-x86_64
./scons.compile
For the template of .appion.cfg: we a backup copy of the old templates under /ami/archive/18/guppy/etc/skel. We can copy it to /etc/skel, in which case it would be added to the home folder of every new user when we do useradd. However, if we decide to use /opt/myamisnap/.appion.cfg for all new users, which is easier to maintain and update, then no further action is necessary.
If we intend to only use the global copy of .appion.cfg, we need to figure out how to make that scenario work on a cluster, because currently it does not.
Also, please assign to Dipali to test and close out only if it works for her.
- Assignee changed from Sargis Dallakyan to Dipali Sashital
- Status changed from In Test to Closed
I tested both maxlike and cl2d and they both worked. Thanks so much for your help Sargis and Amber!
Also available in: Atom
PDF