This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
cluster:88 [2010/08/11 14:30] hmeij |
cluster:88 [2010/08/11 17:53] hmeij |
||
---|---|---|---|
Line 264: | Line 264: | ||
===== Step 6 ===== | ===== Step 6 ===== | ||
- | More fun. Parallel jobs can be submitted over ethernet interconnects but will not achieve the performance of Infiniband interconnects ofcourse. | + | More fun. Parallel jobs can be submitted over ethernet interconnects but will not achieve the performance of Infiniband interconnects ofcourse. |
- | * yum install libibverbs | + | * yum install libibverbs; pdsh yum install libibverbs -q -y |
- | * yum install gcc-g++ | + | * yum install gcc-c++ |
- | * export PATH=/ | + | |
- | * export LD_LIBRARY_PATH=/ | + | |
- | * cd / | + | |
+ | On our Dell cluster we have static pre-compiled flavors of MPI and OFED. A tarball of 200 MB can be found here [[hhttp:// | ||
+ | * download tarball, stage in / | ||
+ | * cd /opt; tar zxvf / | ||
+ | * examples in / | ||
+ | * export PATH=/ | ||
+ | * export LD_LIBRARY_PATH=/ | ||
+ | * cd / | ||
+ | * ./ring.c; ./hello.c (to test, it'll complain about no HCA card) | ||
+ | Ok, so now we need write a script to submit a parallel job. A parallel job is submitted with command ' | ||
+ | * irun | ||
+ | |||
+ | < | ||
+ | #!/bin/bash | ||
+ | |||
+ | rm -f err out | ||
+ | |||
+ | #BSUB -e err | ||
+ | #BSUB -o out | ||
+ | #BSUB -n 4 | ||
+ | #BSUB -q normal | ||
+ | #BSUB -J ptest | ||
+ | |||
+ | export PATH=/ | ||
+ | export LD_LIBRARY_PATH=/ | ||
+ | |||
+ | echo "make sure we have the right mpirun" | ||
+ | which mpirun | ||
+ | |||
+ | / | ||
+ | |||
+ | / | ||
+ | |||
+ | </ | ||
+ | |||
+ | * 'bsub < irun' (submits) | ||
+ | * ' | ||
+ | |||
+ | ===== Step 7 ===== | ||
+ | |||
+ | Tools. As you add nodes, monitoring tools are added to Ganglia and Cacti. | ||
+ | |||
+ | But first we must fix firefox. | ||
+ | |||
+ | * ' | ||
+ | * ' | ||
+ | * http:// | ||
+ | * http:// | ||
+ | * http:// | ||
\\ | \\ | ||
**[[cluster: | **[[cluster: |