User Tools

Site Tools


cluster:136

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
cluster:136 [2015/08/14 14:19]
hmeij [Moving Content]
cluster:136 [2020/07/28 13:21] (current)
hmeij07
Line 1: Line 1:
 \\ \\
 **[[cluster:​0|Back]]** **[[cluster:​0|Back]]**
 +
 +''/​home''​ is defunct but remains for compatibility. It has been moved from sharptail to whitetail. New home directories are at ''/​zfshomes''​. Although quotas are in place (starting at 1T for new accounts) users typically get what they need.  Static content should eventually be migrated to our Rstore platform.
 +
 + --- //​[[hmeij@wesleyan.edu|Henk]] 2020/07/28 13:18//
  
 ==== HomeDir & Storage Options ==== ==== HomeDir & Storage Options ====
Line 63: Line 67:
   * throttle the rate of traffic generated, make your sysadmin happy, use <5000   * throttle the rate of traffic generated, make your sysadmin happy, use <5000
       * ''​rsync --bwlimit=2500''​       * ''​rsync --bwlimit=2500''​
 +  * do not look inside files
 +      * ''​rsync --whole-files''​
   * use a remote shell from host to host (crossing those vertical boundaries above)   * use a remote shell from host to host (crossing those vertical boundaries above)
       * ''​rsync ​ -vac /​home/​my/​stuff/ ​ user@somehost.wesleyan.edu:/​home/​my/​stuff/''​       * ''​rsync ​ -vac /​home/​my/​stuff/ ​ user@somehost.wesleyan.edu:/​home/​my/​stuff/''​
Line 75: Line 81:
 # (first log in to remote location) # (first log in to remote location)
  
-rsync -vac --bwlimit=2500 /​home/​user/​stuff user@sharptail.wesleyan.edu:/​home/​user/​tmp/​+rsync -vac --bwlimit=2500 ​--whole-files ​/​home/​user/​stuff user@sharptail.wesleyan.edu:/​home/​user/​tmp/​
  
 # sync my HPCC dir stuff folder into /archives locally on sharptail, then clean up # sync my HPCC dir stuff folder into /archives locally on sharptail, then clean up
Line 84: Line 90:
  
 # generate a copy of content on Rstore disk array outside of HPCC but within wesleyan.edu # generate a copy of content on Rstore disk array outside of HPCC but within wesleyan.edu
-# (get paths and share names from faculty member)+# (get paths and share names from faculty member, on sharptail do)
  
 rsync -vac --bwlimit=2500 /​home/​user/​stuff ​ user@rstoresrv0.wesleyan.edu:/​data/​2/​labcontent/​projects/​ rsync -vac --bwlimit=2500 /​home/​user/​stuff ​ user@rstoresrv0.wesleyan.edu:/​data/​2/​labcontent/​projects/​
cluster/136.1439576369.txt.gz ยท Last modified: 2015/08/14 14:19 (external edit)