User Tools

Site Tools


cluster:156

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision
Previous revision
Next revision Both sides next revision
cluster:156 [2017/03/27 19:11]
hmeij07 created
cluster:156 [2017/04/04 18:59]
hmeij07 [OpenHPC page 3]
Line 2: Line 2:
 **[[cluster:0|Back]]** **[[cluster:0|Back]]**
  
-page 3+==== OpenHPC page 3 ==== 
 + 
 +** Tools ** 
 + 
 +<code> 
 + 
 +yum -y groupinstall ohpc-autotools 
 +yum -y install valgrind-ohpc 
 +yum -y install EasyBuild-ohpc 
 +yum -y install spack-ohpc 
 +yum -y install R_base-ohpc 
 + 
 +</code> 
 + 
 +  * "Valgrind is an instrumentation framework for building dynamic analysis tools. There are Valgrind tools that can automatically detect many memory management and threading bugs" (memcheck) 
 +    * http://valgrind.org/ 
 +  * "Welcome to the documentation of EasyBuild, a software build and installation framework that allows you to manage (scientific) software on High Performance Computing (HPC) systems in an efficient way." 
 +    * https://easybuild.readthedocs.io/en/latest/ 
 +  * "Spack is a package management tool designed to support multiple versions and configurations of software on a wide variety of platforms and environments." 
 +    * http://spack.readthedocs.io/en/latest/tutorial_sc16.html 
 +    * ''/opt/ohpc/admin/spack/0.8.17/bin/spack'' 
 +  * R_base contains ''R'' and ''Rscript'' 
 + 
 +** Compilers ** 
 + 
 +<code> 
 + 
 +yum install gnu-compilers-ohpc 
 + 
 +/opt/ohpc/pub/compiler/gcc/5.4.0/bin/c++ 
 +/opt/ohpc/pub/compiler/gcc/5.4.0/bin/cpp 
 +/opt/ohpc/pub/compiler/gcc/5.4.0/bin/g++ 
 +/opt/ohpc/pub/compiler/gcc/5.4.0/bin/gcc 
 +/opt/ohpc/pub/compiler/gcc/5.4.0/bin/gcc-ar 
 +/opt/ohpc/pub/compiler/gcc/5.4.0/bin/gcc-nm 
 +/opt/ohpc/pub/compiler/gcc/5.4.0/bin/gcc-ranlib 
 +/opt/ohpc/pub/compiler/gcc/5.4.0/bin/gcov 
 +/opt/ohpc/pub/compiler/gcc/5.4.0/bin/gcov-tool 
 +/opt/ohpc/pub/compiler/gcc/5.4.0/bin/gfortran 
 + 
 +</code> 
 +  
 + 
 +**MPIs** 
 + 
 +  * Both for ethernet and infiniband networks 
 + 
 +<code> 
 + 
 +yum -y install openmpi-gnu-ohpc mvapich2-gnu-ohpc mpich-gnu-ohpc 
 + 
 +/opt/ohpc/pub/mpi/openmpi-gnu/1.10.4/bin/mpicc 
 +/opt/ohpc/pub/mpi/openmpi-gnu/1.10.4/bin/mpirun 
 +/opt/ohpc/pub/mpi/mvapich2-gnu/2.2/bin/mpicc 
 +/opt/ohpc/pub/mpi/mvapich2-gnu/2.2/bin/mpirun 
 +/opt/ohpc/pub/mpi/mpich-gnu-ohpc/3.2/bin/mpicc 
 +/opt/ohpc/pub/mpi/mpich-gnu-ohpc/3.2/bin/mpirun 
 + 
 + 
 +</code> 
 + 
 +** Perf Tools ** 
 + 
 +  * ''yum -y groupinstall ohpc-perf-tools-gnu'' 
 +  * Appendix C 
 + 
 +**3rd Party & Libs Tools** 
 + 
 +  * OpenHPC provides package aliases for these 3rd party libraries and utilities that can 
 +be used to install available libraries for use with the GNU compiler family toolchain. 
 + 
 +<code> 
 + 
 +# Install libs for all available GNU compiler family toolchain 
 +yum -y groupinstall ohpc-serial-libs-gnu 
 +yum -y groupinstall ohpc-io-libs-gnu 
 +yum -y groupinstall ohpc-python-libs-gnu 
 +yum -y groupinstall ohpc-runtimes-gnu 
 +# Install parallel libs for all available MPI toolchains 
 +yum -y groupinstall ohpc-parallel-libs-gnu-mpich 
 +yum -y groupinstall ohpc-parallel-libs-gnu-mvapich2 
 +yum -y groupinstall ohpc-parallel-libs-gnu-openmpi 
 + 
 +# things like 
 +# netcdf, hdf5, numpy and scipy for python, fftw, scalapack 
 + 
 +</code> 
 + 
 +Finish with installing Intel's Parallel Data Studio (icc/ifort). 
 + 
 +{{:cluster:install_guide-centos7.2-slurm-1.2-x86_64.pdf|install_guide-centos7.2-slurm-1.2-x86_64.pdf}} 
 + 
 +As user ''test'' 
 + 
 +<code> 
 + 
 +module avail 
 +module spider 
 +which mpicc 
 +module load gnu/5.4.0 
 +module load openmpi/1.10.4 
 +which gcc 
 +which mpicc 
 +mpicc -O3 /opt/ohpc/pub/examples/mpi/hello.c 
 +cp /opt/ohpc/pub/examples/slurm/job.mpi . 
 +which prun 
 +find /opt/ohpc/pub -name prun 
 +module spider prun 
 +module load prun/1.1 
 +which prun 
 +sbatch job.mpi 
 +squeue 
 + 
 +</code> 
 + 
 +You do need to install the Infiniband section so you can run over ethernet with OpenMPI 
 + 
 +<code> 
 + 
 +  yum  -y groupinstall "Infiniband Support" 
 +  yum -y install infinipath-psm 
 +  systemctl enable rdma 
 +  systemctl start rdma 
 + 
 +# recipe is missing this 
 + 
 +  yum -y --installroot=/data/ohpc/images/centos7.2 install libibverbs opensm-libs 
 + 
 +# remake vnfs 
 +</code> 
  
 \\ \\
 **[[cluster:0|Back]]** **[[cluster:0|Back]]**
cluster/156.txt · Last modified: 2017/04/05 14:42 by hmeij07