User Tools

Site Tools


cluster:151

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
cluster:151 [2016/11/10 19:39]
hmeij07 [Resync Data]
cluster:151 [2016/11/10 20:37]
hmeij07 [Tuning]
Line 28: Line 28:
  
 [[http://www.beegfs.com/wiki/StorageSynchronization|StorageSynchronization Link]] [[http://www.beegfs.com/wiki/StorageSynchronization|StorageSynchronization Link]]
 +
 +//If the primary storage target of a buddy group is unreachable, it will get marked as offline and a failover to the secondary target will be issued. In this case, the former secondary target will become the new primary target.//
  
 Testing out fail over and deletion of data on secondary then a full resync process: Testing out fail over and deletion of data on secondary then a full resync process:
Line 131: Line 133:
 [root@petaltail chroots]# ls -lh /var/chroots/data/beegfs_storage/buddymir/u2018/5817/9/60-58179513-30/178-581797C8-30 [root@petaltail chroots]# ls -lh /var/chroots/data/beegfs_storage/buddymir/u2018/5817/9/60-58179513-30/178-581797C8-30
 -rw-rw-rw- 1 root root 4.9G Apr  7  2014 /var/chroots/data/beegfs_storage/buddymir/u2018/5817/9/60-58179513-30/178-581797C8-30 -rw-rw-rw- 1 root root 4.9G Apr  7  2014 /var/chroots/data/beegfs_storage/buddymir/u2018/5817/9/60-58179513-30/178-581797C8-30
 +                                                                          ^^^^^^^^
  
 # copy on secondary # copy on secondary
Line 137: Line 140:
 [root@swallowtail ~]# ls -lh /data/beegfs_storage/buddymir/u2018/5817/9/60-58179513-30/178-581797C8-30 [root@swallowtail ~]# ls -lh /data/beegfs_storage/buddymir/u2018/5817/9/60-58179513-30/178-581797C8-30
 -rw-rw-rw- 1 root root 4.9G Apr  7  2014 /data/beegfs_storage/buddymir/u2018/5817/9/60-58179513-30/178-581797C8-30 -rw-rw-rw- 1 root root 4.9G Apr  7  2014 /data/beegfs_storage/buddymir/u2018/5817/9/60-58179513-30/178-581797C8-30
 +                                                              ^^^^^^^^
  
 # seems to work, notice the ''buddymir'' directory on primary/secondary # seems to work, notice the ''buddymir'' directory on primary/secondary
Line 176: Line 180:
   * do BEFORE populating XFS file systems   * do BEFORE populating XFS file systems
  
 +==== Meta Backup/Restore =====
 +
 +[[http://www.fhgfs.com/wiki/wikka.php?wakka=FAQ#ea_backup|External Link]]
 +
 +<code>
 +
 +# latest tar
 +rpm -Uvh /sanscratch/tmp/beegfs/tar-1.23-15.el6_8.x86_64.rpm
 +
 +# backup
 +cd /data; tar czvf /sanscratch/tmp/beegfs/meta-backup/n38-meta.tar.gz beegfs_meta/ --xattrs
 +
 +# restore
 +cd /data;  tar xvf /sanscratch/tmp/beegfs/meta-backup/n38-meta.tar.gz --xattrs
 +
 +# test
 +cd /data; diff -r beegfs_meta beegfs_meta.orig
 +# no results
 +
 +</code>
 +
 +
 +
 +==== Resync Meta ====
 +
 +[[http://www.beegfs.com/wiki/AboutMirroring2012#hn_59ca4f8bbb_4|External Link]]
 +
 +  * older versions
 +  * new future version will work like storage mirror with HA and self-healing
 ==== Mirror Meta ==== ==== Mirror Meta ====
 +
 +//Metadata mirroring can currently not be disabled after it has been enabled for a certain directory//
  
 Definitely want Meta content mirrored, that way I can use the n38-n45 nodes with local 15K disk, plus maybe cottontail2 (raid 1 with hot and cold spare). Definitely want Meta content mirrored, that way I can use the n38-n45 nodes with local 15K disk, plus maybe cottontail2 (raid 1 with hot and cold spare).
Line 204: Line 239:
 [root@sharptail ~]# ssh n38 find /data/beegfs_meta -name 3-581392E1-31 [root@sharptail ~]# ssh n38 find /data/beegfs_meta -name 3-581392E1-31
 /data/beegfs_meta/mirror/49.dentries/54/6C/0-581392F0-30/#fSiDs#/3-581392E1-31 /data/beegfs_meta/mirror/49.dentries/54/6C/0-581392F0-30/#fSiDs#/3-581392E1-31
-                  ^^^^^^+                  ^^^^^^ ^^
 # and find # and find
 [root@sharptail ~]# ssh n39 find /data/beegfs_meta -name 3-581392E1-31 [root@sharptail ~]# ssh n39 find /data/beegfs_meta -name 3-581392E1-31
Line 281: Line 316:
     * set in /etc/beegfs-[storage|client|meta|admon|mgmtd].conf and restart services     * set in /etc/beegfs-[storage|client|meta|admon|mgmtd].conf and restart services
  
-  * backup beeGFS EA metadata, see faq +  * backup/restore/mirror 
-    * attempt a restore +    * see more towards top this page
-    * or just snapshot+
  
   * storage server tuning   * storage server tuning
cluster/151.txt · Last modified: 2016/12/06 20:14 by hmeij07