Project

General

Profile

Actions

Bug #2558

closed

"Duplicate entry" error duing particle clustering

Added by Melody Campbell over 11 years ago. Updated over 9 years ago.

Status:
Closed
Priority:
Normal
Category:
-
Target version:
-
Start date:
10/13/2013
Due date:
% Done:

0%

Estimated time:
Affected Version:
Appion/Leginon 2.1.0
Show in known bugs:
No
Workaround:

Description

Hi,

I've been trying to cluster particles after doing imagic msa feature analysis. The routine always stops after sorting into one of the specified class groupings (ie. i ask to split into 64,128,200,256 classes and it only sorts into 64 classes). The session is: /ami/data15/appion/13mar09f/align/imagicmsa16

I keep getting the error below:

13Oct13ue.appionsub.log
... Time stamp: 13oct13q23
... Function name: imagicMSAcluster
... Appion directory: /opt/myamisnap/lib
... Load average is high 4.0
... New load average 4.0
... Using split database
Connected to database: 'ap368'
... Committing data to database
... Run directory: /ami/data15/appion/13mar09f/align/imagicmsa16
!!! WARNING: directory '/ami/data15/appion/13mar09f/align/imagicmsa16' already exists.
... Writing function log to: imagicMSAcluster.log
... Running on host: guppy-29
... Uploading ScriptData....
... Running on host: guppy-29
... Found 4 processors on this machine
... Running Appion version 'trunk'
Running IMAGIC .batch file: See imagicMSAcluster log file(s) corresponding to # of classes for details
... inserting clustering parameters into database

==========================
processing class averages for 58 classes ==========================

... completed in 10 min 4 sec
finished IMAGIC in 10 min 4 sec
EMAN: proc2d /ami/data15/appion/13mar09f/align/imagicmsa16/classums_58_eigens_58_imagesignored_0_membersignored_0.hed /ami/data15/appion/13mar09f/align/imagicmsa16/classums_58_eigens_58_imagesignored_0_membersignored_0.hed.norm.hed norm
... inserting clustering stack into database
Inserting particle classification data, please wait

{'expid': 11349, 'description': 'what the hell is wrong no ignoring', 'num_eigenimages': 58, 'projectid': 368, 'apix': 2.1290399999999998, 'boxsize': 112, 'ignore_members': 0, 'ignore_images': 0, 'runname': '13Oct13ue', 'nproc': None, 'num_classes': '58,64,100,128,200', 'commit': True, 'rundir': '/ami/data15/appion/13mar09f/align/imagicmsa16', 'num_particles': 27097, 'jobtype': None, 'analysisId': '85'}
... stack pixel size: 2.12904
... stack box size: 112
Traceback (most recent call last):
File "/opt/myamisnap/bin/imagicMSAcluster.py", line 331, in <module>
imagicCluster.start()
File "/opt/myamisnap/bin/imagicMSAcluster.py", line 323, in start
self.insertClusterStack(numclusters)
File "/opt/myamisnap/bin/imagicMSAcluster.py", line 266, in insertClusterStack
cpartq.insert()
File "/opt/myamisnap/lib/sinedon/data.py", line 390, in insert
db.insert(self, **kwargs)
File "/opt/myamisnap/lib/sinedon/dbdatakeeper.py", line 253, in insert
self._insert(newdata, force=force)
File "/opt/myamisnap/lib/sinedon/dbdatakeeper.py", line 287, in _insert
return self.recursiveInsert(newdata, force=force)
File "/opt/myamisnap/lib/sinedon/dbdatakeeper.py", line 280, in recursiveInsert
dbid = self.flatInsert(newdata, force=force)
File "/opt/myamisnap/lib/sinedon/dbdatakeeper.py", line 315, in flatInsert
newid = myTable.insert([formatedData], force=force)
File "/opt/myamisnap/lib/sinedon/sqldict.py", line 345, in insert
c.execute(q)
File "/usr/lib64/python2.6/site-packages/MySQLdb/cursors.py", line 173, in execute
self.errorhandler(self, exc, value)
File "/usr/lib64/python2.6/site-packages/MySQLdb/connections.py", line 36, in defaulterrorhandler
raise errorclass, errorvalue
_mysql_exceptions.IntegrityError: (1062, "Duplicate entry '16376644' for key 1")

Actions #1

Updated by Sargis Dallakyan over 11 years ago

  • Status changed from New to In Test
  • Assignee changed from Amber Herold to Melody Campbell

Run the following command to fix 'ap368' database:

[root@cronus4 ap368]# myisamchk --safe-recover *
myisamchk: error: 'Ap3dDensityData.frm' is not a MyISAM-table

---------

myisamchk: error: 'Ap3dDensityData.MYD' is not a MyISAM-table

---------

- recovering (with keycache) MyISAM-table 'Ap3dDensityData.MYI'
Data records: 593

---------

myisamchk: error: 'ApAce2ParamsData.frm' is not a MyISAM-table

---------

myisamchk: error: 'ApAce2ParamsData.MYD' is not a MyISAM-table
...
- recovering (with keycache) MyISAM-table 'ScriptProgramRun.MYI'
Data records: 1383

---------

myisamchk: error: 'ScriptUserName.frm' is not a MyISAM-table

---------

myisamchk: error: 'ScriptUserName.MYD' is not a MyISAM-table

---------

- recovering (with keycache) MyISAM-table 'ScriptUserName.MYI'
Data records: 2
[root@cronus4 ap368]# pwd
/database/mysql/ap368

Please try again to see if this fixed it.

Actions #2

Updated by Anchi Cheng over 9 years ago

  • Status changed from In Test to Closed
Actions

Also available in: Atom PDF