Project

General

Profile

Actions
Copy link

Bug #3802

open

slow aligned particle insertion caused time out in uploadMaxlikeAlignment.py

Added by Anchi Cheng almost 9 years ago. Updated almost 9 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
Start date:
12/03/2015
Due date:
% Done:

0%

Estimated time:
Affected Version:
Appion/Leginon 2.2.0
Show in known bugs:
Workaround:

Description

Due to overwhelmed databas I/O, 15sep24a/align/maxlike22 uploadMaxlikeAlignment.py inserted only ~3000 particles out of ~28000 before PBS qsub timed-out.

This could not be recovered be rerun the upload script because reinserting alignment run is not allowed and fast insert means repeat particle insertion can cause duplication. In addition, sortFolder function detects existing files in it and raised Fatal error.

I recovered the run by removing the particles belonged to the alignstack and set the alignstackdata to the now-inserted run instead of insertRunIntoDatabase, but we will need a general strategy for this now that we use fast insert.

Any idea ?

Actions
Copy link

Also available in: Atom PDF