Project

General

Profile

Actions

Bug #2011

closed

cl2d and xmipp issues

Added by Dipali Sashital over 12 years ago. Updated over 12 years ago.

Status:
Closed
Priority:
Normal
Category:
-
Target version:
-
Start date:
08/20/2012
Due date:
% Done:

0%

Estimated time:
Affected Version:
Appion/Leginon 2.1.0
Show in known bugs:
No
Workaround:

Description

I was running some alignments on guppy using cl2d and maxlikeAlignment. I ran into an issue with each of them. For the cl2d run, it was unable to make an average.mrc file. You can see the error in the log file: /ami/data00/appion/12aug09a/align/cl2d2/cl2d2.appionsub.log

For the maxlike run, it appears to not have access to a library, giving the following error:

/opt/Xmipp/bin/xmipp_mpi_ml_align2d: error while loading shared libraries: libmpi.so.0: cannot open shared object file: No such file or directory

You can see the log file here: /ami/data00/appion/12aug09a/align/maxlike6/maxlike6.appionsub.log

Thanks so much for your help!

Actions #1

Updated by Amber Herold over 12 years ago

  • Status changed from New to Assigned
  • Assignee set to Sargis Dallakyan
Actions #2

Updated by Sargis Dallakyan over 12 years ago

How did you run this job? If you used qsub command, please try using qsub -V.

-V Declares that all environment variables in the qsub command’s environment are to be exported to the batch job.

I helped Ryan Hoffman yesterday who was getting similar error message (error while loading shared libraries: libmpi.so.0: cannot open shared object file: No such file or directory). qsub -V solved it for him.

Actions #3

Updated by Amber Herold over 12 years ago

I tried to test cl2d.(/ami/data00/appion/zz07jul25b/align/cl2d25) Did not get so far:

/opt/myamisnap/lib/pyami/tifffile.py:903: UserWarning: Failed to import _tifffile.decodepackbits
  warnings.warn("Failed to import %s" % module_function)
/opt/myamisnap/lib/pyami/tifffile.py:903: UserWarning: Failed to import _tifffile.decodelzw
  warnings.warn("Failed to import %s" % module_function)
 ... Time stamp: 12aug21l18
 ... Function name: runXmippCL2D
 ... Appion directory: /opt/myamisnap/lib
 ... Using split database
^[[32mConnected to database: 'ap303'^[[0m
 ... Committing data to database
 ... Getting stack data for stackid=88
Old stack info: ^[[36m'test  ... 361 eman centered substack id 87'^[[0m

Traceback (most recent call last):
  File "/opt/myamisnap/bin/runXmippCL2D.py", line 623, in <module>
    cl2d = CL2D()
  File "/opt/myamisnap/lib/appionlib/appionScript.py", line 81, in __init__
    self.checkConflicts()
  File "/opt/myamisnap/bin/runXmippCL2D.py", line 94, in checkConflicts
    apDisplay.printError("There is no MPI installed")
  File "/opt/myamisnap/lib/appionlib/apDisplay.py", line 57, in printError
    raise Exception, colorString("\n *** FATAL ERROR ***\n"+text+"\n\a","red")
Exception: ^[[31m
 *** FATAL ERROR ***
There is no MPI installed
^G^[[0m
 ... Running on host: guppy-29

Actions #4

Updated by Dipali Sashital over 12 years ago

I am getting a bit further than that with cl2d, but I'm still getting the error that it cannot create average.mrc after making the initial aligned stack. I am also still getting the libmpi errors when running maxlike, even when running with qsub -V.

New cl2d logfile is /ami/data00/appion/12aug09a/align/cl2d2/cl2d2.appionsub2.log

New maxlike logfile is /ami/data00/appion/12aug09a/align/maxlike6/maxlike6.appionsub2.log

Actions #5

Updated by Amber Herold over 12 years ago

Everyone, if you have a .appion.cfg file in your guppy home directory (ls -a to see hidden files), you must add a -V option to the AdditionalHeaders field:

ProcessingHostType=Torque

Shell=/bin/csh

ScriptPrefix=

ExecCommand=/usr/local/bin/qsub

StatusCommand=/usr/local/bin/qstat

AdditionalHeaders= -m e, -j oe, -V

PreExecuteLines=

By doing this, you will be able to launch jobs from the website that use MPI.

Actions #6

Updated by Amber Herold over 12 years ago

CL2D works on Garibaldi for me, and it does not output the following error like guppy does:

/opt/myamisnap/lib/pyami/tifffile.py:903: UserWarning: Failed to import _tifffile.decodepackbits
  warnings.warn("Failed to import %s" % module_function)
/opt/myamisnap/lib/pyami/tifffile.py:903: UserWarning: Failed to import _tifffile.decodelzw
  warnings.warn("Failed to import %s" % module_function)

This is right at the start of the output file in /ami/data00/appion/zz07jul25b/align/cl2d28.
Do we need to install this tifffile stuff?

Actions #7

Updated by Amber Herold over 12 years ago

Sargis, I have updated everyone's .appion.cfg file in guppy /home dir.
Now I just need you to figure out where the template is for this file for when a new user is added, if there is one, so that can be changed as well.

Actions #8

Updated by Sargis Dallakyan over 12 years ago

  • Status changed from Assigned to In Test

Thanks Amber and Dipali. I have downloaded Xmipp-2.4-src and installed it on guppy with MPI support:

cd /root/src/Xmipp-2.4-src
./scons.configure QTDIR=/usr/lib64/qt-3.3 MPI_LIBDIR=/usr/lib64/openmpi/lib/ MPI_LIB=mpi MPI_INCLUDE==/usr/include/openmpi-x86_64
./scons.compile

For the template of .appion.cfg: we a backup copy of the old templates under /ami/archive/18/guppy/etc/skel. We can copy it to /etc/skel, in which case it would be added to the home folder of every new user when we do useradd. However, if we decide to use /opt/myamisnap/.appion.cfg for all new users, which is easier to maintain and update, then no further action is necessary.

Actions #9

Updated by Amber Herold over 12 years ago

If we intend to only use the global copy of .appion.cfg, we need to figure out how to make that scenario work on a cluster, because currently it does not.

Actions #10

Updated by Amber Herold over 12 years ago

Also, please assign to Dipali to test and close out only if it works for her.

Actions #11

Updated by Sargis Dallakyan over 12 years ago

  • Assignee changed from Sargis Dallakyan to Dipali Sashital
Actions #12

Updated by Dipali Sashital over 12 years ago

  • Status changed from In Test to Closed

I tested both maxlike and cl2d and they both worked. Thanks so much for your help Sargis and Amber!

Actions

Also available in: Atom PDF