Project

General

Profile

Actions

Bug #1710

open

limit nproc passed from apGenericJob.py

Added by Anchi Cheng about 12 years ago. Updated almost 12 years ago.

Status:
Assigned
Priority:
Urgent
Category:
-
Target version:
Start date:
04/11/2012
Due date:
% Done:

0%

Estimated time:
Affected Version:
Appion/Leginon 2.2.0 (trunk)
Show in known bugs:
No
Workaround:

Description

The feature of passing nproc from job submission to AppionScript in r16471 causes the problem of nproc being set to nodes * ppn. This is not desirable in some scripts. Examples are reconUploader, and spider sessions that need large amount of memory. In the latter case it need to reserve all processors in a node but uses few of them in order to reserve all memory to its own use.


Related issues 1 (1 open0 closed)

Blocks Appion - Bug #1482: spider consuming all the resourcesIn Test11/23/2011

Actions
Actions #1

Updated by Anchi Cheng about 12 years ago

  • Assignee changed from Anchi Cheng to Dmitry Lyumkis
  • Affected Version changed from Appion/Leginon 2.1.0 to Appion/Leginon 2.2.0 (trunk)

r16475 puts in the mechanism in appionScript to do this. uploadExternalRefine.py uses this as an example. All AppionScripts that does not have non None maxnproc assigned will accept the nproc passed from job submission side once I revert from r16472 to r16471.

Dmitry, could you check and change other uploadRefinement type of script in appion/bin to impose a proper limit? Assign it to Scott for him to decide what maxnproc should be for the scripts that he ran into problem in bug #1482.

I will not revert to r16471 until I know you both are happy with the restrictions.

Actions #2

Updated by Amber Herold almost 12 years ago

Dmitry,
What is the status on this?

Actions #3

Updated by Dmitry Lyumkis almost 12 years ago

Sorry, I have not had a chance to look at this. Any chance I can ask you or Amber to take care of it? If not, I can get to it after my group meeting.

Actions

Also available in: Atom PDF