User Tools

Site Tools


cluster:175

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
cluster:175 [2018/09/22 12:48]
hmeij07 [Lammps]
cluster:175 [2018/09/23 12:22]
hmeij07 [Gromacs]
Line 3: Line 3:
 **[[cluster:0|Back]]** **[[cluster:0|Back]]**
  
-==== GTX vs P100 & K20 ====+==== P100 vs GTX & K20 ====
  
-Comparing these GPUs yields the following data. These are not "benchmark suites" so your mileage may vary. It will give us some comparative information for decision making on our 2018 GPU Expansion Project.  The GTX & K20 data comes from this page [[cluster:164|GTX 1080 Ti]]+^    ^  P100  ^  GTX  ^  K20  ^    ^ 
 +|  cores  |  3,584  |  3,584  |  2,496  |  count  | 
 +|  mem  |  12/16  |  11  |  5  |  gb  | 
 +|  ghz  |  2.6  |  1.6  |  0.7  |  speed  | 
 +|  flops  |  4.7/5.3  |  0.355  |  1.15  |  dpfp  | 
 + 
 +Comparing these GPUs yields the following results presented below. These are not "benchmark suites" so your mileage may vary. It will give us some comparative information for decision making on our 2018 GPU Expansion Project.  The GTX & K20 data comes from this page [[cluster:164|GTX 1080 Ti]]
  
 Credits: This work was made possible, in part, through HPC time donated by Microway, Inc. We gratefully acknowledge Microway for providing access to their GPU-accelerated compute cluster. Credits: This work was made possible, in part, through HPC time donated by Microway, Inc. We gratefully acknowledge Microway for providing access to their GPU-accelerated compute cluster.
Line 30: Line 36:
  
 </code> </code>
 +
 +Look at these gpu temperatures, that's Celsius.
  
 ==== Lammps ==== ==== Lammps ====
Line 66: Line 74:
 Gromacs has shown vastly improved performance between versions. v5 delivered about 20 ns/day per K20 server and 350 ns/day on GTX server. v2018 delivered 75 ns/day per K20 server and 900 ns/day on GTX server. A roughly 3x improvement. Gromacs has shown vastly improved performance between versions. v5 delivered about 20 ns/day per K20 server and 350 ns/day on GTX server. v2018 delivered 75 ns/day per K20 server and 900 ns/day on GTX server. A roughly 3x improvement.
  
-On the P100 I could not invoke the multidir option of gromacs (have run it on GTX, weird). The utilization of the gpu drops as more and more gpus are deployed.  The optimum performance was with dual gpus achieving 36 ns/day. Four one gpu jobs would deliver 136 ns/day/server, far short of the 900 ns/day for GTX server (we only have dual P100 nodes quoted).+On the P100 test node, I could not invoke the multidir option of gromacs (have run it on GTX, weird). The utilization of the gpu drops as more and more gpus are deployed.  The optimum performance was with dual gpus achieving 36 ns/day. Four one gpu jobs would deliver 136 ns/day/server, far short of the 900 ns/day for our GTX server(We only have dual P100 nodes quoted).
  
 <code> <code>
Line 75: Line 83:
 localhost,localhost,localhost,localhost,localhost,localhost,\ localhost,localhost,localhost,localhost,localhost,localhost,\
 localhost,localhost,localhost,localhost,localhost,localhost,localhost \ localhost,localhost,localhost,localhost,localhost,localhost,localhost \
-gmx_mpi mdrun -gpu_id 0123 -ntmpi 0 \+gmx_mpi mdrun -gpu_id 0123 -ntmpi 0 -nt 0 \
  -s topol.tpr -ntomp 4 -npme 1 -nsteps 20000 -pin on -nb gpu  -s topol.tpr -ntomp 4 -npme 1 -nsteps 20000 -pin on -nb gpu
  
Line 83: Line 91:
  
                    ns/day       hrs/ns                    ns/day       hrs/ns
-gpu=4 mpi=25 ntomp=4 -npme 1+gpu=4 mpi=25 (ntomp=4 -npme 1)
 Performance:       34.632        0.693 Performance:       34.632        0.693
 gpu=3 (same) gpu=3 (same)
Line 96: Line 104:
  
 </code> </code>
 +
 +==== What to Buy ====
 +
 +  * Amber folks: does not matter
 +  * Lammps folks: P100 nodes please
 +  * Gromacs folks: GTX nodes please
 +
 +Remember that GTX gpus placed in Data Center voids their warranty.
 +
  
 \\ \\
cluster/175.txt · Last modified: 2018/11/29 18:00 by hmeij07