Bug #2558
closed"Duplicate entry" error duing particle clustering
0%
Description
Hi,
I've been trying to cluster particles after doing imagic msa feature analysis. The routine always stops after sorting into one of the specified class groupings (ie. i ask to split into 64,128,200,256 classes and it only sorts into 64 classes). The session is: /ami/data15/appion/13mar09f/align/imagicmsa16
I keep getting the error below:
13Oct13ue.appionsub.log
... Time stamp: 13oct13q23
... Function name: imagicMSAcluster
... Appion directory: /opt/myamisnap/lib
... Load average is high 4.0
... New load average 4.0
... Using split database
Connected to database: 'ap368'
... Committing data to database
... Run directory: /ami/data15/appion/13mar09f/align/imagicmsa16
!!! WARNING: directory '/ami/data15/appion/13mar09f/align/imagicmsa16' already exists.
... Writing function log to: imagicMSAcluster.log
... Running on host: guppy-29
... Uploading ScriptData....
... Running on host: guppy-29
... Found 4 processors on this machine
... Running Appion version 'trunk'
Running IMAGIC .batch file: See imagicMSAcluster log file(s) corresponding to # of classes for details
... inserting clustering parameters into database
==========================
processing class averages for 58 classes
==========================
... completed in 10 min 4 sec
finished IMAGIC in 10 min 4 sec
EMAN: proc2d /ami/data15/appion/13mar09f/align/imagicmsa16/classums_58_eigens_58_imagesignored_0_membersignored_0.hed /ami/data15/appion/13mar09f/align/imagicmsa16/classums_58_eigens_58_imagesignored_0_membersignored_0.hed.norm.hed norm
... inserting clustering stack into database
Inserting particle classification data, please wait
{'expid': 11349, 'description': 'what the hell is wrong no ignoring', 'num_eigenimages': 58, 'projectid': 368, 'apix': 2.1290399999999998, 'boxsize': 112, 'ignore_members': 0, 'ignore_images': 0, 'runname': '13Oct13ue', 'nproc': None, 'num_classes': '58,64,100,128,200', 'commit': True, 'rundir': '/ami/data15/appion/13mar09f/align/imagicmsa16', 'num_particles': 27097, 'jobtype': None, 'analysisId': '85'}
... stack pixel size: 2.12904
... stack box size: 112
Traceback (most recent call last):
File "/opt/myamisnap/bin/imagicMSAcluster.py", line 331, in <module>
imagicCluster.start()
File "/opt/myamisnap/bin/imagicMSAcluster.py", line 323, in start
self.insertClusterStack(numclusters)
File "/opt/myamisnap/bin/imagicMSAcluster.py", line 266, in insertClusterStack
cpartq.insert()
File "/opt/myamisnap/lib/sinedon/data.py", line 390, in insert
db.insert(self, **kwargs)
File "/opt/myamisnap/lib/sinedon/dbdatakeeper.py", line 253, in insert
self._insert(newdata, force=force)
File "/opt/myamisnap/lib/sinedon/dbdatakeeper.py", line 287, in _insert
return self.recursiveInsert(newdata, force=force)
File "/opt/myamisnap/lib/sinedon/dbdatakeeper.py", line 280, in recursiveInsert
dbid = self.flatInsert(newdata, force=force)
File "/opt/myamisnap/lib/sinedon/dbdatakeeper.py", line 315, in flatInsert
newid = myTable.insert([formatedData], force=force)
File "/opt/myamisnap/lib/sinedon/sqldict.py", line 345, in insert
c.execute(q)
File "/usr/lib64/python2.6/site-packages/MySQLdb/cursors.py", line 173, in execute
self.errorhandler(self, exc, value)
File "/usr/lib64/python2.6/site-packages/MySQLdb/connections.py", line 36, in defaulterrorhandler
raise errorclass, errorvalue
_mysql_exceptions.IntegrityError: (1062, "Duplicate entry '16376644' for key 1")
Updated by Sargis Dallakyan over 11 years ago
- Status changed from New to In Test
- Assignee changed from Amber Herold to Melody Campbell
Run the following command to fix 'ap368' database:
[root@cronus4 ap368]# myisamchk --safe-recover * myisamchk: error: 'Ap3dDensityData.frm' is not a MyISAM-table --------- myisamchk: error: 'Ap3dDensityData.MYD' is not a MyISAM-table --------- - recovering (with keycache) MyISAM-table 'Ap3dDensityData.MYI' Data records: 593 --------- myisamchk: error: 'ApAce2ParamsData.frm' is not a MyISAM-table --------- myisamchk: error: 'ApAce2ParamsData.MYD' is not a MyISAM-table ... - recovering (with keycache) MyISAM-table 'ScriptProgramRun.MYI' Data records: 1383 --------- myisamchk: error: 'ScriptUserName.frm' is not a MyISAM-table --------- myisamchk: error: 'ScriptUserName.MYD' is not a MyISAM-table --------- - recovering (with keycache) MyISAM-table 'ScriptUserName.MYI' Data records: 2 [root@cronus4 ap368]# pwd /database/mysql/ap368
Please try again to see if this fixed it.