User Tools

Site Tools



Openlava 3.1.2

Build process, switching to git approach.

Prequisites (for

  • yum install git
  • yum install rpm-build
  • yum install rpmdevtools
  • yum install tcl tcl-devel
  • yum install ncurses ncurses-devel
  • yum install automake libtool
# initialize git
git init
mkdir git-latest
cd git-latest

# pull branch down
git clone git://
cd openlava/

# what's new
git log

# pull Dave's addition of
git checkout 07f740f884d9c71d

# build
./configure --prefix=/opt/openlava-3.1.2

# build packages
find/root/rpmbuild/ -name *.rpm

Next we remove a queue and its compute nodes from the current openlava configuration and restart those services. Then we configure the new openlava config files. Once we have a few nodes up and one claims to be the master we do a manual install until we have enough to build a script. For my memory sake…


cd /share/apps/src/petaltail6/openlava3/

service openlava stop
chkconfig openlava off

# remove and clean, use rpm -ql list too
yum erase openlava -y --disablerepo=*
rm -rf /opt/openlava-2.2*
rm -rf /var/spool/mail/openlava
# not needed # ./openlava-2.2.rmpql
# still there # grep openlava /etc/passwd

foo=`rpm -qa | grep tcl-devel | wc -l`
if [ $foo -eq 1 ]; then
        echo "tcl-devel installed"
        echo "tcl-devel installing"
        yum localinstall --nogpgcheck -y tcl-devel-8.5.7-6.el6.x86_64.rpm

yum localinstall --disablerepo=* --nogpgcheck -y ./rpmbuild6_jan16/RPMS/x86_64/openlava-3.1-1.x86_64.rpm
scp /etc/init.d/openlava /etc/init.d/openlava-orig
scp ./openlava.ulimit /etc/init.d/openlava
scp /share/apps/scripts/elim.gpu /opt/openlava-3.1/sbin/elim

foo=`grep 'ulimit -l' /etc/pam.d/sshd | wc -l`
if [ $foo -eq 1 ]; then
        echo "ulimit code present in /etc/pam.d/sshd"
        echo "ulimit code added to /etc/pam.d/sshd"
        echo -e "# for ulimit -l -hmeij\nsession    required\n" >> /etc/pam.d/sshd

foo=`grep 'libibverbs' /etc/security/limits.conf | wc -l`
if [ $foo -eq 1 ]; then
        echo "ulimit code present in /etc/security/limits.conf"
        echo "ulimit code added to /etc/security/limits.conf"
        echo -e "# added for RLIMIT_MEMLOCK warnings with libibverbs -hmeij\n*                soft    memlock         unlimited\n*                hard    memlock         unlimited\n" >> /etc/security/limits.conf

scp /etc/postfix/ /etc/postfix/
scp ./ /etc/postfix/
chkconfig postfix on

chkconfig openlava --list
chkconfig postfix --list

mv /opt/openlava-3.1/etc /opt/openlava-3.1/etc-orig
scp -r ./etc /opt/openlava-3.1/

#last for usage reporting
ln -s /opt/openlava-3.1 /opt/openlava-2.2
chown -R openlava:openlava /opt/openlava-3.1

echo reboot

and now deploy from command line

for i in `seq 4 32`; do echo n$i; ssh n$i /share/apps/src/petaltail6/openlava3/; done

During the final roll out, copy the /opt/openlava-2.2/work directory to /opt/openlava-3.1 directory. Remove work/logdir/ and all files in work/logdir/info to preserve stats.


cluster/146.txt · Last modified: 2017/08/29 09:36 by hmeij07