This is an old revision of the document!
ib0
Using Infiniband for MPI traffic involves somewhat more configurations. So from the ground up (v1.3 documentation) we start with installing packages needed on CHROOT. Be sure to follow recipe and install these on SMS too.
# Add IB support and enable yum -y --installroot=$CHROOT groupinstall "InfiniBand Support" yum -y --installroot=$CHROOT install infinipath-psm chroot $CHROOT systemctl enable rdma # User environment yum -y --installroot=$CHROOT install lmod-ohpc
Next we import a template file in which the IPADDR and NETMASK values of the ib0
interface will be replaced with values from the database. Add to your deploy scripts lines like
wwsh file import /opt/ohpc/pub/examples/network/centos/ifcfg-ib0.ww wwsh -y file set ifcfg-ib0.ww --path=/etc/sysconfig/network-scripts/ifcfg-ib0 wwsh node set $node --netdev=ib0 \ --ipaddr=$ipaddri \ --netmask=255.255.0.0 --network=255.255.0.0 -y wwsh provision set $node --fileadd ifcfg-ib0.ww -y
Reassemble the VNFS and reimage nodes. Now you can follow IpoIB instructions Infiniband
LMod
OpenHPC page 1 - OpenHPC page 2 - OpenHPC page 3 - page 4