User Tools

Site Tools


cluster:134

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
cluster:134 [2014/08/14 18:33]
hmeij [25K+]
cluster:134 [2014/08/14 20:03]
hmeij [High Throughput]
Line 84: Line 84:
  
  
-==== 25K+ ====+==== IO error ====
  
 At around 32K jobs I ran into IO problems. At around 32K jobs I ran into IO problems.
Line 93: Line 93:
  
 </code> </code>
 +
 +Oh, this is OS error from ext3 file system, max files and dirs exceeded.
 +
 +Switching "StateSaveLocation=/sanscratch_sharptail/tmp/slurmctld" to XFS file system.
 +
 +
 +==== High Throughput ====
  
 [[https://computing.llnl.gov/linux/slurm/high_throughput.html]] [[https://computing.llnl.gov/linux/slurm/high_throughput.html]]
Line 98: Line 105:
   * MaxJobCount=100000   * MaxJobCount=100000
   * SlurmctldPort=6820-6825   * SlurmctldPort=6820-6825
-  * SchedulerParameters=max_job_bf=100,interval=30+  * SchedulerParameters=max_job_bf=100,interval=30  (NOTE:  unset these, pages states default values are fine) 
  
 + WARNING: We will use a much slower algorithm with proctrack/pgid, use Proctracktype=proctrack/linuxproc or some other proctrack when using jobacct_gather/linux
  
 +Debug Level is 3. Maybe go to 1.
  
 \\ \\
 **[[cluster:0|Back]]** **[[cluster:0|Back]]**
cluster/134.txt · Last modified: 2014/08/22 13:05 by hmeij