User Tools

Site Tools


cluster:139

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision
Previous revision
Next revision Both sides next revision
cluster:139 [2015/04/08 17:42]
hmeij created
cluster:139 [2015/04/10 17:56]
hmeij [Warewulf LBL]
Line 4: Line 4:
 ===== Warewulf LBL ===== ===== Warewulf LBL =====
  
-  * [[http://warewulf.lbl.gov/trac]] Warewulf is a scalable systems management suite originally developed to manage large high-performance Linux clusters.  My Project Kusu replacement since IBM bought up Platform LSF and dished the hpccommunnity.org web site, grrrh.+  * [[http://warewulf.lbl.gov/trac]] Warewulf is a scalable systems management suite originally developed to manage large high-performance Linux clusters.  My Project Kusu replacement since IBM bought up Platform LSF and dished the hpccommunnity.org web site, grrrh. (old info at https://dokuwiki.wesleyan.edu/doku.php?id=cluster:88) 
 + 
 +Get RPMs and install. 
 + 
 +<code> 
 + 
 +[root@petaltail ~]# wget -O /etc/yum.repos.d/warewulf-rhel6.repo http://warewulf.lbl.gov/downloads/repo/warewulf-rhel6.repo 
 +--2015-04-07 08:45:56--  http://warewulf.lbl.gov/downloads/repo/warewulf-rhel6.repo                                         
 +Resolving warewulf.lbl.gov... 128.3.7.27                                                                                    
 +Connecting to warewulf.lbl.gov|128.3.7.27|:80... connected.                                                                 
 +HTTP request sent, awaiting response... 200 OK                                                                              
 +Length: 126 [text/plain]                                                                                                    
 +Saving to: â/etc/yum.repos.d/warewulf-rhel6.repoâ                                                                          
 + 
 +100%[======================================================================================>] 126         --.-K/  in 0s       
 + 
 +2015-04-07 08:45:56 (22.9 MB/s) - â/etc/yum.repos.d/warewulf-rhel6.repoâsaved [126/126] 
 + 
 +[root@petaltail ~]# yum install warewulf-common warewulf-cluster warewulf-provision  
 + 
 +Installed: 
 +  warewulf-cluster.x86_64 0:3.6-1.el6          warewulf-common.noarch 0:3.6-1.el6        warewulf-icr.x86_64 0:3.6-1.el6 
 +  warewulf-provision.x86_64 0:3.6-1.el6 
 + 
 +Dependency Installed: 
 +  dhcp.x86_64 12:4.1.1-43.P1.el6.centos.1    tftp-server.x86_64 0:0.49-7.el6    warewulf-provision-server.x86_64 0:3.6-1.el6 
 +  warewulf-vnfs.noarch 0:3.6-1.el6 
 + 
 +Complete! 
 + 
 +</code> 
 + 
 +Get and install MySQL and set mysql user root's password. 
 + 
 +<code> 
 +                                               
 +[root@petaltail warewulf]# vi /etc/warewulf/database-root.conf  
 +[root@petaltail warewulf]# service mysqld status 
 + 
 +mysql> set password for 'root'@'localhost' = PASSWORD('some_string'); 
 +Query OK, 0 rows affected (0.00 sec)                                 
 + 
 +[root@petaltail warewulf]# chmod o-r /etc/warewulf/database-root.conf                                   
 +      
 +</code> 
 + 
 +In the provision config file I turned dynamic_hosts, hostfile and localdomain off (I'll manage those manually) and my private network is run over eth0 (192.168.0.0/255.255.0.0). 
 + 
 +<code> 
 + 
 +[root@petaltail warewulf]# vi /etc/warewulf/provision.conf  
 +[root@petaltail warewulf]# vi /etc/warewulf/provision.conf  
 + 
 +</code> 
 + 
 +Next comes a piece of mystery. When executing  ''wwinit ALL'' I ran into a lether, no less, error. After much digging found the answer here and surprisingly found little in the documentation on this. 
 + 
 +  * Lethal error thrown by module: /usr/libexec/warewulf/wwinit/91-vnfs.init 
 +  * answer is here https://groups.google.com/a/lbl.gov/forum/#!topic/warewulf/5OhfZCf_eqE 
 + 
 +So we start by making the chroot directories, first we'll build a generic centos-6. Then we initialize the warewulf environment. 
 + 
 +<code> 
 + 
 +[root@petaltail ~]# wwmkchroot centos-6 /var/chroots/centos-6 
 + 
 +[root@petaltail ~]# CHROOTDIR=/var/chroots/centos-6  wwinit ALL 
 +database:     Checking /etc/rc.d/init.d/mysqld is installed                  OK 
 +database:     Confirming mysqld is configured to start at boot: 
 +database:      + chkconfig mysqld on                                         OK 
 +database:     Checking to see if MySQL needs to be started: 
 +database:      + service mysqld start                                        OK 
 +wwsh:         Confirming that wwsh accepts some basic commands 
 +wwsh:          + wwsh quit                                                   OK 
 +wwsh:          + wwsh help                                                   OK 
 +wwsh:          + wwsh node new testnode0000                                  OK 
 +wwsh:          + wwsh node list                                              OK 
 +wwsh:          + wwsh node delete testnode0000                               OK 
 +domain:       Setting default node domain to: "cluster"                      OK 
 +authfiles:    Checking to see if /etc/passwd is in the WW Datastore          OK 
 +authfiles:    Checking if /etc/passwd is part of default node configuration 
 +authfiles:    Checking to see if /etc/group is in the WW Datastore           OK 
 +authfiles:    Checking if /etc/group is part of default node configuration 
 +nfsd:         Setting domain "cluster" for IDMAPD/NFSv4                      OK 
 +nfsd:          + chkconfig nfs on                                            OK 
 +nfsd:          + service nfs restart                                         OK 
 +nfsd:          + exportfs -a                                                 OK 
 +ntpd:         Configured NTP services 
 +ntpd:          + chkconfig ntpd on                                           OK 
 +ntpd:          + service ntpd restart                                        OK 
 +ssh_keys:     Checking ssh keys for root                                     OK 
 +ssh_keys:     Checking root's ssh config                                     OK 
 +ssh_keys:     Checking for default RSA1 host key for nodes                   OK 
 +ssh_keys:     Checking for default RSA host key for nodes                    OK 
 +ssh_keys:     Checking for default DSA host key for nodes                    OK 
 +tftp:          + /sbin/chkconfig xinetd on                                   OK 
 +tftp:          + /sbin/chkconfig tftp on                                     OK 
 +tftp:          + /sbin/service xinetd restart                                OK 
 +bootstrap:    Creating bootstrap for 2.6.32-504.8.1.el6.x86_64: 
 +bootstrap:     + wwbootstrap 2.6.32-504.8.1.el6.x86_64                       OK 
 +vnfs:         Building the VNFS image and importing into Warewulf: 
 +vnfs:          + wwvnfs -y --hybridpath=/var/chroots/centos-6 --chroot /var/ OK 
 + 
 + 
 +</code> 
 + 
 +Next restart MySQL, httpd and xinetd. Open your firewall on the private network. 
 + 
 +  * edit /etc/sysconfig/iptables and restart iptables 
 + 
 +<code> 
 + 
 +# local allow 
 +-A INPUT -i eth0 -d 192.168.0.0/16 -p tcp --dport 0:65535 -j ACCEPT 
 +-A INPUT -i eth0 -d 192.168.0.0/16 -p udp --dport 0:65535 -j ACCEPT 
 + 
 +</code> 
 + 
 +Next restart some warewulf services. I had to edit the /etc/warewulf/dhcpd-template.conf several times and hardcoded the values in for network, netmask and ipaddr becuase I realized this server is my virtualization KVM host and eth0 is bridged to br0 and warewulf is looking at the first ethernet and picks up eth1. 
 + 
 +<code> 
 + 
 +[root@petaltail ~]# wwsh dhcp update 
 +Rebuilding the DHCP configuration 
 +Done. 
 + 
 +[root@petaltail ~]# wwsh pxe update 
 +No nodes found 
 + 
 +[root@petaltail ~]# wwsh 
 +Warewulf> node new b51 --netdev=eth0 --hwaddr=00:00:00:00:00:00 --ipaddr=192.168.1.5 --groups=wwnodes 
 +Warewulf> provision set --lookup groups wwnodes --vnfs=centos-6 --bootstrap=2.6.32-504.8.1.el6.x86_64 
 +Are you sure you want to make the following changes to 1 node(s): 
 + 
 +     SET: BOOTSTRAP            = 2.6.32-504.8.1.el6.x86_64 
 +     SET: VNFS                 = centos-6 
 + 
 +Yes/No> y 
 +Warewulf> quit 
 + 
 +</code> 
 + 
 +Booting the node we observe the eth0 MAC address being picked up by DHCPd followed by the tftpboot process.  The node boots, et voila, CentOS 6.6 //stateless// compute node. 
 + 
 +Useful links 
 + 
 +  * [[http://www.admin-magazine.com/HPC/Articles/Warewulf-Cluster-Manager-Master-and-Compute-Nodes]] 
 +  * [[http://www.admin-magazine.com/HPC/Articles/warewulf_cluster_manager_completing_the_environment]] 
 +  * http://warewulf.lbl.gov/trac/wiki/Documentation
  
 \\ \\
 **[[cluster:0|Back]]** **[[cluster:0|Back]]**
cluster/139.txt · Last modified: 2018/08/16 12:58 by hmeij07