You are here

LSF Queues and Policy

Minerva uses LSF (Load Sharing Facility) to schedule jobs. This section gives details of the queues and scheduling policies on Minerva.

Queues

Queue Description Max Walltime Defaults (Mem/core|Walltime)
Jobs whose resources are to be charged against an allocation 144 hrs 2000MB | 5hrs
Jobs requesting high priority. Charged at 150% of alloc rate 144 hrs 2000MB | 5hrs
Jobs using allocation that require less than 2 hours walltime 2 hrs 2000MB | 1hr
Jobs running in scavenger mode 24 hrs 2000MB | 5hrs
Jobs using dedicated resources 144 hrs 2000MB | 5hrs
Any other queues are for testing by the Scientific Computing Group N/A N/A

* The jobs that will run against an allocation should be submitted to the "alloc" queues. These jobs must have an appropriate account name specified with the "-P" flag.
Please see JOB EXECUTION section for example scripts.

* The jobs submitted to the low queue DO require an allocated account name and cannot be used with account name "scavenger" anymore.

* If a job is submitted to an alloc queue without specifying a valid account, the job will be put terminated. A message similar to:


Cannot open your job file: /tmp/98298349374.9849837
TERM_ADMIN: job killed by root or an administrator.
Exited with signal termination: Interrupt.

will appear in the output. You can verify that the termination was because of an invalid account number by executing the command:
bhist -l

Policies

LSF is configured to do “first fit” backfill. Backfilling allows smaller, shorter jobs to use otherwise idle resources.

In certain special cases, the priority of a job may be manually increased upon request. To request priority change you may contact MSSM Scientific Computing Support at hpchelp@hpc.mssm.edu. We will need the job ID and reason to submit the request.

Allocation

To check available allocations in seconds:


[minerva4~]$ mybalance
Balance     Name      
----------- --------- 

7921453013 acc_xxx  


To check available allocations in hours:


[minerva4 ~]$ mybalance -h
Balance     Name      
----------- --------- 

2200403.61 acc_xxx 


To see account description and account users:


[minerva4 ~]$ glsaccount -p acc_xxx
Name     Active Users            Organization 	Description        
-------- ------ ---------------  ------------ 	------------------ 
acc_xxx True   user01,user07  Ogranization_name   Account description


To check allocated funds and available funds per account and percent utilization:


[minerva4 ~]$ gbalance -p acc_xxx
Id Name     Available  Allocated  PercentUsed 
-- -------- ---------- ---------- ----------- 
* acc_xxx  7921453013 8100000000 2.20   


Theme by Danetsoft and Danang Probo Sayekti inspired by Maksimer