User Tools

Site Tools


cluster:192

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
cluster:192 [2020/02/24 19:21]
hmeij07
cluster:192 [2020/02/26 18:25]
hmeij07 [EXX96]
Line 6: Line 6:
 A page for me on how these 12 nodes were build up after they arrived. To make them "ala n37" which as the test node in redoing our K20 nodes, see [[cluster:172|K20 Redo]] A page for me on how these 12 nodes were build up after they arrived. To make them "ala n37" which as the test node in redoing our K20 nodes, see [[cluster:172|K20 Redo]]
  
-Page best read bottom to top.+Page best followed bottom to top.
  
 +==== Usage ====
 +
 +The new queue ''exx96'' will be comprised of nodes ''n79-n90'' Each node holds 4x RTX2080S gpus, 2x Xeon Silver 4214 2.2 Ghz cpus, 96 GB memory and a 1TB SSD. ''/localscratch'' is around 800 GD.
 +
 +
 +
 +<code>
 +bhosts -l n79
 +             gputest gpu4
 + Total                3
 + Reserved        0.0  0.1
 +
 +lsload -l n79
 +
 +HOST_NAME               status  r15s   r1m  r15m   ut    pg    io  ls    it   tmp   swp   mem    gpu
 +n79                         ok   0.0   0.0   0.0   0%   0.0       0 2e+08  826G   10G   90G    3.0
 +
 +mdout.325288: Master Total CPU time:          982.60 seconds     0.27 hours  1:1
 +mdout.325289: Master Total CPU time:          611.08 seconds     0.17 hours  4:2
 +mdout.326208: Master Total CPU time:          537.97 seconds     0.15 hours 36:4
 +
 +#BSUB -n 4
 +#BSUB -R "rusage[gpu4=2:mem=6288],span[hosts=1]"
 +export CPU_GPU_REQUEST=4:2
 +
 +</code>
 ==== Miscellaneous ==== ==== Miscellaneous ====
  
-Add scheduler, reconfigure, elim. Test it out.+Install scheduler RPM for CentOS7, reconfigure (hosts, queue, static resource), elim. Test it out with old wrapper.
  
 Edit the n37.openmpi.wrapper for n33-n37 and n79-90 and the one on n78 for the new static resource ''gpu4''. Edit the n37.openmpi.wrapper for n33-n37 and n79-90 and the one on n78 for the new static resource ''gpu4''.
  
-Add nodes to ZenOSS hpcmon+Add nodes to ZenOSS hpcmon
 + 
 +Propagate global ''known_hosts'' files in users ~/.ssh/ dirs. 
 + 
 +Look at how accounting ties in with resource request ''gpu4='' versus ''gpu='' ...
  
 <code> <code>
cluster/192.txt · Last modified: 2022/03/08 18:29 by hmeij07