This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
cluster:171 [2018/08/20 12:53] hmeij07 [Step 3] |
cluster:171 [2018/08/20 13:31] hmeij07 [Step 5] |
||
---|---|---|---|
Line 114: | Line 114: | ||
... | ... | ||
- | --exclude=/ | ||
--exclude=/ | --exclude=/ | ||
--exclude=/ | --exclude=/ | ||
Line 122: | Line 121: | ||
</ | </ | ||
- | Make sure you can login passwordless ssh from SMS_server to your node '' | + | Make sure you can login passwordless |
< | < | ||
- | SOURCEADDR=n37 wwmkchroot golden-system / | + | SOURCEADDR=n37 wwmkchroot golden-system / |
- | [root@ohpc0-test ~]# du -hs / | + | [root@ohpc0-test ~]# du -hs / |
- | 1.6G / | + | 1.6G / |
</ | </ | ||
Line 136: | Line 135: | ||
==== Step 4 ==== | ==== Step 4 ==== | ||
- | Copy the deploy.[sh|txt] files from centos7.chroot to vanilla6.chroot, see [[cluster: | + | Create files deploy.[sh|txt] files (attached at bottom of page, I keep them in CHROOT/ |
+ | |||
+ | Ran into UEFI boot loader problems. More on that later. | ||
< | < | ||
# final touches in CHROOT | # final touches in CHROOT | ||
- | cp / | ||
- | |||
# edit deploy.sh (check filesystems, | # edit deploy.sh (check filesystems, | ||
+ | |||
+ | # copy your user and group base in passwd/ | ||
+ | # copy or edit bashrc and fstab in CHROOT/etc, add your NFS mounts | ||
# version | # version | ||
echo " | echo " | ||
- | / | + | / |
# make bootstrap, takes couple of mins | # make bootstrap, takes couple of mins | ||
- | wwbootstrap --chroot=/ | + | wwbootstrap --chroot=/ |
# make vnfs, patience, most of the time is spend in " | # make vnfs, patience, most of the time is spend in " | ||
- | wwvnfs --chroot=/ | + | wwvnfs --chroot=/ |
VNFS NAME SIZE (M) CHROOT LOCATION | VNFS NAME SIZE (M) CHROOT LOCATION | ||
- | vanilla6.chroot | + | vanilla.chroot |
- | + | # configure node, deploy | |
- | # configure node, done on WW 3.6.99 | + | |
# assumes node pxe boots first | # assumes node pxe boots first | ||
- | cd / | ||
- | ./deploy.sh `grep ^n37 deploy.txt` | ||
+ | cd / | ||
+ | ./deploy.sh `grep ^n37 deploy.txt` | ||
ssh n37 reboot | ssh n37 reboot | ||
+ | # once the deploy is on it's way, imaging might take 5 mins or so | ||
+ | # for next node boot to be from local disk, on SMS_server issue | ||
- | # once the deploy is on it's way, imaging might take 5 mins or so | ||
- | # on SMS_server issue | ||
wwsh provision set --bootlocal=EXIT n37 -y | wwsh provision set --bootlocal=EXIT n37 -y | ||
- | |||
- | # test a reboot of node n37 from local disk | ||
</ | </ | ||
Line 178: | Line 177: | ||
==== Step 5 ===== | ==== Step 5 ===== | ||
- | So after imaging and reboot, what do we have? Definitely an imaged node, the partitions have shuffled. And our VERSION file came from the vnfs made from CHROOT. We also have eth0, eth1 and ib0. | + | So after imaging and reboot, what do we have? Definitely an imaged node, the partitions have shuffled |
< | < | ||
Line 194: | Line 193: | ||
/ | / | ||
- | [root@n37 | + | [root@n37 |
Infiniband hardware address can be incorrect! Please read BUGS section in ifconfig(8). | Infiniband hardware address can be incorrect! Please read BUGS section in ifconfig(8). | ||
+ | eth0: flags=4163< | ||
inet 192.168.102.47 | inet 192.168.102.47 | ||
+ | eth1: flags=4163< | ||
inet 10.10.102.47 | inet 10.10.102.47 | ||
+ | ib0: flags=4163< | ||
inet 10.11.103.47 | inet 10.11.103.47 | ||
+ | lo: flags=73< | ||
inet 127.0.0.1 | inet 127.0.0.1 | ||
+ | |||
</ | </ | ||
- | Before the reboot we grabbed passwd/ | + | Then all that is left to do is: |
< | < | ||
Line 226: | Line 230: | ||
# reboot from local disk, do not make a golden image of this, stay on 7.2 till 7.5 | # reboot from local disk, do not make a golden image of this, stay on 7.2 till 7.5 | ||
- | # is fixed, only add non-kernel packages to vanilla6.chroot if needed and reimage | + | # is fixed, only add non-kernel packages to vanilla.chroot if needed and re-image |
</ | </ | ||
Line 293: | Line 297: | ||
# centos 7.2 cdrom | # centos 7.2 cdrom | ||
- | wwsh provision set $node --vnfs=vanilla6.chroot -y | + | wwsh provision set $node --vnfs=vanilla.chroot -y |
wwsh provision set $node --bootstrap=3.10.0-327.el7.x86_64 | wwsh provision set $node --bootstrap=3.10.0-327.el7.x86_64 | ||
Line 315: | Line 319: | ||
</ | </ | ||
+ | |||
+ | ==== deploy.txt ==== | ||
+ | |||
+ | File deploy.txt | ||
+ | |||
+ | < | ||
+ | |||
+ | # n33.chroot type nodes, ASUS type servers with 4x K20 gpus | ||
+ | n37 50: | ||
+ | # more servers ... | ||
+ | </ | ||
\\ | \\ | ||
**[[cluster: | **[[cluster: |