Project

General

Profile

Queuing option » History » Version 5

Anchi Cheng, 02/16/2011 10:47 AM

1 1 Amber Herold
h1. Queuing option
2
3
4
5
6
h2. Introduction
7
8
9
10 3 Amber Herold
Queuing option puts in a queue the selected targets on multiple images from the same acquisition node. The queue can then processed as a batch. Therefore, targets from multiple squares can be selected before any hole image image is acquired in any grid square. Alternatively, targets from multiple holes of the same square can be selected before any exposure is taken. Because the event bindings are identical in MSI application. Target processing scheme can be switched between the queuing (breadth-first) mode and the depth-first mode at appropriate point.
11 1 Amber Herold
12
13
!http://emg.nysbc.org/software/leginon/images/images/MSIQtree.png!
14
15
16
17 3 Amber Herold
In queuing mode, the movement of the stage is more complicated as targets in the same subtree are not acquired in close time frame and often need readjustment of targets when it is finally the time to acquire the child image. This is all taken care of by the drift manager by reversing the stage position (including stage z) of the parent image when the first child image is to be acquired after the drift declared event. Users of the queuing mode should know that this frequent interaction with the drift manager makes the time for completing the target list longer but is necessary when targeting accuracy is important.
18 1 Amber Herold
19
20 3 Amber Herold
The other consideration is that if queuing is activated at Hole Targeting node so that a large number of images are acquired in "sq" preset at LM mode in a batch without ever cycling to HM presets, the objective lens may cool down sufficiently that the image alignment is different from during normal acquisition cycle. We recommend that either setting the scope to one of the HM mode, wait for 30 or more minute and recheck the image alignment or processing a smaller batch of "sq" preset each time so that the scope does not operate in LM for extended amount of time. Our experience is that it is better not to activate queuing at Hole Targeting but queue up only at exposure targeting so that the above problem is less likely to occur.
21 1 Amber Herold
22
23 3 Amber Herold
[[Trouble shooting|Trouble shooting]]
24 1 Amber Herold
25
26
27
h2.  Initial Queuing set-up
28
29
30
31 3 Amber Herold
The user should start with [[Initial MSI application preference setup|the preference and configuration]] of the nodes in MSI application in the depth-first mode and follow the [[MSI Quick-start|quick start procedure]]. Once the function of all nodes are confirmed to be normal, then switch to queuing. There are two possible points for queuing, at Hole Targeting or at Exposure Targeting. The two can be used in any combination with the depth-first mode.
32 1 Amber Herold
33 4 Anchi Cheng
h2. Warning: Do not use this option on the targeting node immediately after an acquisition node that moves to targets by iterative Navigator stage movement.
34 1 Amber Herold
35 4 Anchi Cheng
Example:
36
* Do not using queuing in "Exposure Targeting" node if "Hole" is uses Navigator as (modeled) stage position mover, and "Navigation Tolerance" is larger than zero.
37
* Do not using queuing in "Hole Targeting" node if "Square" uses Navigator as (modeled) stage position mover and "Navigation Tolerance" is larger than zero.
38
39
The algorithm for target adjustment can not handle this particular combination.
40 1 Amber Herold
41
h2. Configuration and operation rules for a chosen queuing point
42
43
44
45 3 Amber Herold
Configuration of two nodes are affected by each queuing and they should be set in the following order if the two are currently processing data:
46 1 Amber Herold
47 3 Amber Herold
1.  The option for "Queue up targets" should be selected in the HoleFinder. "Declare drift when queue is submitted" is optional. Use it if accurate targeting is required. The time required to finish target will be longer.
48 1 Amber Herold
49 3 Amber Herold
2.  The acquisition node that acquires the image on which targets will be selected do not need to wait for HoleFinder node to process the image before next acquisition. This option is deselected in /Tool/Setup/. Leave it on if you are willing to wait for HoleFinder before next image acquisition.
50 1 Amber Herold
51
52 3 Amber Herold
In operation, the behavior of the above two nodes plus the acquisition node after the queuing holefinder are affected.
53 1 Amber Herold
54 3 Amber Herold
1.  All targets submitted to the above-mentioned acquisition node will be acquired first(Waiting off) rather than one after each target submission (Waiting on). These targets would be considered "done" by Leginon at restart or target refresh.
55 1 Amber Herold
56 3 Amber Herold
2.  The normal "submit" !http://emg.nysbc.org/software/leginon/images/icons/play.png! in the targetfinder only stores the selected targets in the queue rather than proceeding to target processing.
57 1 Amber Herold
58 3 Amber Herold
3.  Upon "Submit Queue" !http://emg.nysbc.org/software/leginon/images/icons/send_queue_out.png! the queued target list is processed by the next acquisition node in which individual targets can be aborted by the abort button !http://emg.nysbc.org/software/leginon/images/icons/stop.png!, paused as in MSI, and the whole queue list can be aborted using the abort queue button !http://emg.nysbc.org/software/leginon/images/icons/stop_queue.png!.
59 1 Amber Herold
60 3 Amber Herold
4.  The queued target list is in fact a list of lists where targets are grouped by their parent images. At the start of target processing of any unfinished sub-list by an acquisition node, leginon reverts the z stage position to that of the parent and processes rejected targets (i.e., the focus targets) first if the option is on as it is for "Hole" and "Exposure" nodes whether they have been processed previously. The rest of the unfinished acquisition targets are then processed.
61 1 Amber Herold
62 3 Amber Herold
5.  The targets that generate images in the non-waiting acquisition node is considered done once acquired. Therefore, if Leginon is interrupted and restarted, you can not continue the acquisition and process the queued targets by submiting refreshed targets in "Square Targeting" node as in MSI. Instead, you should resubmit the queue in the corresponding holefinder node. Leginon will find out which targets have not been completed and continue the acquisition.
63 2 Amber Herold
64
65
66
67
______
68
69 5 Anchi Cheng
[[Optimize Autofocus|< Optimizing autofocus]] | [[Queuing Example 1 - Exposure Targeting|Queuing Example 1 - Exposure Targeting >]]
70 2 Amber Herold
71
______