Warning: Undefined array key "DOKU_PREFS" in /usr/share/dokuwiki/inc/common.php on line 2082
cluster:151 [DokuWiki]

User Tools

Site Tools


cluster:151

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
cluster:151 [2016/11/29 14:35]
hmeij07 [beeGFS cluster idea]
cluster:151 [2016/12/01 14:02]
hmeij07 [Mirror Meta]
Line 31: Line 31:
     * cottontail (on UPS, on Infiniband)     * cottontail (on UPS, on Infiniband)
  
-  * Backups (rsnapshot.org via rsync daemons [[cluster:150|The Problem (Rsync)]])+  * Backups (rsnapshot.org via rsync daemons [[cluster:150|Rsync Daemon/Rsnapshot]])
     * sharptail:/home --> cottontail     * sharptail:/home --> cottontail
     * serverA:/mnt/beegfs/home1 --> serverB (8TB max)     * serverA:/mnt/beegfs/home1 --> serverB (8TB max)
Line 43: Line 43:
  
   * ''cottontail:/usr/local/bin/beegfs-admin-gui''   * ''cottontail:/usr/local/bin/beegfs-admin-gui''
 +
 +==== upgrade ====
 +
 +  * [[http://www.beegfs.com/content/updating-upgrading-and-versioning/|External Link]]
 +  * New feature - High Availability for Metadata Servers (self-healing, transparent failover)
 +
 +A bit complicated. 
 +
 +  * Repo base URL baseurl=http://www.beegfs.com/release/beegfs_6/dists/rhel6 via http shows only 6.1-el6
 +    * [   ] beegfs-mgmtd-6.1-el6.x86_64.rpm          2016-11-16 16:27  660K 
 +  * '' yum --disablerepo "*" --enablerepo beegfs repolist'' shows
 +    * beegfs-mgmtd.x86_64                            2015.03.r22-el6            beegfs
 +  * ''yum install --disablerepo "*" --enablerepo beegfs --downloadonly --downloaddir=/sanscratch/tmp/beegfs/beegfs_6/ *x86_64* -y''
 +   * http://www.beegfs.com/release/beegfs_6/dists/rhel6/x86_64/beegfs-mgmtd-2015.03.r22-el6.x86_64.rpm: [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404 Not Found" <-- wrong package version
 +
 +
 +So the wget/rpm approach (list all packages present on a particular node else you will get a dependencies failure!)
 +
 +<code>
 +
 +# get them all
 +wget http://www.beegfs.com/release/beegfs_6/dists/rhel6/x86_64/beegfs-mgmtd-6.1-el6.x86_64.rpm
 +
 +# client and meta node
 +rpm -Uvh ./beegfs-common-6.1-el6.noarch.rpm ./beegfs-utils-6.1-el6.x86_64.rpm ./beegfs-opentk-lib-6.1-el6.x86_64.rpm ./beegfs-helperd-6.1-el6.x86_64.rpm ./beegfs-client-6.1-el6.noarch.rpm ./beegfs-meta-6.1-el6.x86_64.rpm
 +
 +# updated?
 +[root@cottontail2 beegfs_6]# beegfs-ctl | head -2
 +BeeGFS Command-Line Control Tool (http://www.beegfs.com)
 +Version: 6.1
 +
 +#Sheeesh
 +</code>
 +
  
 ==== Resync Data #2 ==== ==== Resync Data #2 ====
Line 74: Line 108:
  
 # define mirrrogroups # define mirrrogroups
-[root@cottontail2 ~]# beegfs-ctl --addmirrorgroup --primary=21701 --secondary=13601 --groupid=1 +[root@cottontail2 ~]# beegfs-ctl --addmirrorgroup [--nodetype=storage] --primary=21701 --secondary=13601 --groupid=1 
-[root@cottontail2 ~]# beegfs-ctl --addmirrorgroup --primary=13602 --secondary=21702 --groupid=2+[root@cottontail2 ~]# beegfs-ctl --addmirrorgroup [--nodetype=storage] --primary=13602 --secondary=21702 --groupid=2
  
 [root@cottontail2 ~]# beegfs-ctl --listmirrorgroups [root@cottontail2 ~]# beegfs-ctl --listmirrorgroups
Line 346: Line 380:
 Content mirroring will require more disk space. Perhaps snapshots to another node is more useful, also solves backup issue. Content mirroring will require more disk space. Perhaps snapshots to another node is more useful, also solves backup issue.
  
- +V6 does buddymirror meta mirroring [[http://www.beegfs.com/wiki/MDMirror|External Link]]
 <code> <code>
  
-# enable meta mirroring, directory based+2015.03 enable meta mirroring, directory based
 # change to 11/04/2016: used --createdir to make this home. # change to 11/04/2016: used --createdir to make this home.
 [root@n7 ~]# beegfs-ctl --mirrormd /mnt/beegfs/home [root@n7 ~]# beegfs-ctl --mirrormd /mnt/beegfs/home
Line 355: Line 389:
 Mount: '/mnt/beegfs'; Path: '/hmeij-mirror' Mount: '/mnt/beegfs'; Path: '/hmeij-mirror'
 Operation succeeded. Operation succeeded.
 +
 +# V6.1 does it a root level not from a path
 +beegfs-ctl --addmirrorgroup --nodetype=meta --primary=38 --secondary=39 --groupid=1 
 +beegfs-ctl --addmirrorgroup --nodetype=meta --primary=250 --secondary=37 --groupid=2 
 +beegfs-ctl --mirrromd
  
 # put some new content in  # put some new content in 
Line 488: Line 527:
   * made easy [[http://www.beegfs.com/wiki/ManualInstallWalkThrough|External Link]]   * made easy [[http://www.beegfs.com/wiki/ManualInstallWalkThrough|External Link]]
   * rpms pulled from repository via petaltail in ''greentail:/sanscratch/tmp/beegfs''   * rpms pulled from repository via petaltail in ''greentail:/sanscratch/tmp/beegfs''
 +    * ''yum --disablerepo "*" --enablerepo beegfs list available''
 +    * use ''yumdownloader''
  
 <code> <code>
cluster/151.txt · Last modified: 2016/12/06 15:14 by hmeij07