Warning: Undefined array key "DOKU_PREFS" in /usr/share/dokuwiki/inc/common.php on line 2082
cluster:88 [DokuWiki]

User Tools

Site Tools


cluster:88

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
cluster:88 [2010/08/11 11:50]
hmeij
cluster:88 [2010/08/11 14:11]
hmeij
Line 264: Line 264:
 ===== Step 6 ===== ===== Step 6 =====
  
-More fun. Parallel jobs can be submitted over ethernet interconnects but will not achieve the performance of Infiniband interconnects ofcourse.  OpenMPI is a nice MPI flavor becuase software compiled with it automatically detects if the host has an HCA card or not and will allocate the appropriate libraries. So in order to compile, or run, some OpenMPI examples we need the following:+More fun. Parallel jobs can be submitted over ethernet interconnects but will not achieve the performance of Infiniband interconnects ofcourse.  OpenMPI is a nice MPI flavor because software compiled with it automatically detects if the host has an HCA card or not and will allocate the appropriate libraries. So in order to compile, or run, some OpenMPI examples we need the following:
  
   * yum install libibverbs; pdsh yum install libibverbs -q -y   * yum install libibverbs; pdsh yum install libibverbs -q -y
Line 280: Line 280:
  
 Ok, so now we need write a script to submit a parallel job.  A parallel job is submitted with command 'mpirun' However that command needs to know which hosts are allocated to the job.  That is done with a wrapper script located in /usr/bin/openmpi-mpirun. Ok, so now we need write a script to submit a parallel job.  A parallel job is submitted with command 'mpirun' However that command needs to know which hosts are allocated to the job.  That is done with a wrapper script located in /usr/bin/openmpi-mpirun.
 +
 +  * irun
  
 <code> <code>
 #!/bin/bash #!/bin/bash
 +
 +rm -f err out 
  
 #BSUB -e err #BSUB -e err
 #BSUB -o out #BSUB -o out
-#BSUB +#BSUB -n 4 
 +#BSUB -q normal 
 +#BSUB -J ptest
  
 export PATH=/opt/openmpi/gnu/bin:$PATH export PATH=/opt/openmpi/gnu/bin:$PATH
Line 294: Line 300:
 which mpirun which mpirun
  
 +/usr/bin/openmpi-mpirun /opt/openmpi/gnu/examples/hello_c
  
 +/usr/bin/openmpi-mpirun /opt/openmpi/gnu/examples/ring_c
  
-<code>+</code> 
 + 
 +  * 'bsub < irun' (submits) 
 +  * 'bjobs' (check status) 
 + 
 +===== Step 7 =====
  
 +Tools. As you add nodes, monitoring tools are added to Ganglia and Cacti.  These are useful to look at.
  
 +But first we must fix firefox.  You can down load a tarball here [[http://lsfdocs.wesleyan.edu/firefox.tar.gz|http://lsfdocs.wesleyan.edu/firefox.tar.gz]], stage in /usr/local/src and untar, then link the firefox executable in /usr/local/bin.
  
 +  * 'startx' to start the gnome gui
 +  * 'firefox' to start browser
 +  * http://localhost/ganglia
 +  * http://localhost/cacti (first login, admin/admin, set a new password ... admin ;), you can let users in via guest/guest)
 +  * http://localhost:3000 (for ntop)
  
 +  * http://localhost/[ cfm | kits | repos ] (the kits one will show all kusu commands available)
 +  * http://lsfdocs.wesleyan.edu ( lsf 6.2 guides, close to lava )
  
 \\ \\
 **[[cluster:0|Back]]** **[[cluster:0|Back]]**
cluster/88.txt · Last modified: 2010/08/17 15:56 by hmeij