Differences

This shows you the differences between two versions of the page.

--- cluster:134 [2014/08/14 15:11]
hmeij
+++ cluster:134 [2014/08/14 22:34]
hmeij [High Throughput]
@@ Line 34: / Line 34: @@
 echo "$SLURMD_NODENAME JOB_PID=$SLURM_JOB_ID"
-echo DONE
+date
 </code>
@@ Line 84: / Line 84: @@
-==== 25K+ ====
+==== IO error ====
 At around 32K jobs I ran into IO problems.
+<code>
+sbatch: error: Batch job submission failed: I/O error writing script/environment to file
+</code>
+Oh, this is OS error from ext3 file system, max files and dirs exceeded.
+Switching "StateSaveLocation=/sanscratch_sharptail/tmp/slurmctld" to XFS file system.
+==== High Throughput ====
+[[https://computing.llnl.gov/linux/slurm/high_throughput.html]]
+  * MaxJobCount=100000
+  * SlurmctldPort=6820-6825
+  * SchedulerParameters=max_job_bf=100,interval=30  (NOTE:  unset these, pages states default values are fine)
+^NrJobs^N^hh:mm:ss^
+|50,000|8|00:56:30:00|
+ WARNING: We will use a much slower algorithm with proctrack/pgid, use Proctracktype=proctrack/linuxproc or some other proctrack when using jobacct_gather/linux
+Debug Level is 3. Maybe go to 1.
 \\
 **[[cluster:0|Back]]**

DokuWiki