User Tools

Site Tools


cluster:194

This is an old revision of the document!


Table of Contents


Back

TrueNAS/ZFS

Notes. Mainly for me but might be useful/of interest to users.

Consoles

port 5, 11, web site (with shell)

HA

High Availability. Two controllers hpcstore1 (also known as A) and hpcstore2 (also known as B). Virtual IP hpcstore.wesleyan.edu floats back and forth seamlessly (tested, some protocols will loose connectivity). In a split brain situation (no response, both controllers think they are it), disconnect one controller from power then reboot. Then reconnect and wait a few minutes for HA icon to turn green when controller comes online.

SSH

Allowed for large content transfers using scp or sftp or just checking things out. Home directories are located in /mnt/tank/zfshomes. When users get cut over their locatrion will be updated in the /etc/passwd file and $HOME becomes /zfshomes/username. SO we can keep track that. Followed by an rsync process that will from TrueNAS/ZFS appliance to sharptail:/home. TODO: write script. TODO: add disks enlarge and merge LVMs.

# create user, add primary secondary groups, set permissions
# then move all dot fil;es into ~/._nas
# copy content over from sharptail

# SSH keys in place so should be passwordless
ssh username@hpcstore.wesleyan.edu

# go to $HOME
cd /mnt/tank/zfshomes/username

# this will be mounted HPC wide at
/zfshomes/username

ZFS

# set quota

# list quota

# others

SMB

SMB/CIFS (Samba) shares are also created once the homedir is up.

# windows, map network drive
\\hpcstore.wesleyan.edu\username

# credentials, one or all of these work
WORKGROUP\username
localhost\username
username

Snapshots

  • Daily snapshots, one per day, kept for a year (for now)
    • Recursive
  • Request a clone to be made from a snapshot (specify date)
    • check permissions on cloned volume, not windows!
    • NOTE: once had mnt/tank/zfshomes also reset windows, nasty, permissions denied errors
    • when cloning grant access to 192.168.0.0/16 and 10.10.0.0/16
    • NFS mount, read only
    • maproot root:wheel
  • Clone mounted on say cottontail2:/mnt/clone“date”
  • Restore actions by user
  • Delete clone when done

<code>

# mountpoints (maproot=root:wheel) drwxr-xr-x 2 root root 4096 Mar 10 14:08 /mnt/clone0310 drwxr-xr-x 2 root root 4096 Mar 6 14:01 /zfshomes

# /etc/fstab examples (either private network) #192.168.102.245:/mnt/tank/zfshomes \ /zfshomes nfs rw,tcp,soft,intr,bg,vers=3 #10.10.102.245:/mnt/tank/zfshomes \ /zfshomes nfs rw,tcp,soft,intr,bg,vers=3

#192.168.102.245:/mnt/tank/zfshomes-auto-20200310.1348-1y-clone \ /mnt/clone0310 nfs ro,tcp,soft,intr,bg,vers=3 10.10.102.245:/mnt/tank/zfshomes-auto-20200310.1348-1y-clone \ /mnt/clone0310 nfs ro,tcp,soft,intr,bg,vers=3

<\code>


Back

cluster/194.1584019132.txt.gz · Last modified: 2020/03/12 13:18 by hmeij07