This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
cluster:136 [2015/06/17 17:39] hmeij |
cluster:136 [2015/08/14 18:10] hmeij [Moving Content] |
||
---|---|---|---|
Line 28: | Line 28: | ||
* details can be found at [[cluster: | * details can be found at [[cluster: | ||
- | ==== How do I ..? ==== | + | ==== Moving Content |
- | Well, move stuff around? | + | Our file server |
- | With rsync you can: | + | |
+ | Do not use any type of copy tool with a GUI or cp/scp or s/ftp. Especially the GUI (drag& | ||
+ | |||
+ | **Check it out:** | ||
+ | |||
+ | * '' | ||
+ | * is the server busy ('' | ||
+ | * is there memory available ('' | ||
+ | * is anybody else using rsync ('' | ||
+ | * is the server busy writing ('' | ||
+ | |||
+ | Three scenarios are depicted below. When crossing the vertical boundaries you are not dealing with local content anymore, thus the content needs to flow over the network. '' | ||
+ | |||
+ | < | ||
+ | |||
+ | | / | ||
+ | some lab location | ||
+ | < | ||
+ | some other college | ||
+ | | / | ||
+ | |||
+ | </ | ||
+ | |||
+ | **Some feature examples** | ||
* preserve permissions, | * preserve permissions, | ||
* '' | * '' | ||
- | * delete files on destination not present on source | + | * delete files on destination not present on source |
* '' | * '' | ||
* throttle the rate of traffic generated, make your sysadmin happy, use | * throttle the rate of traffic generated, make your sysadmin happy, use | ||
* '' | * '' | ||
- | * and much more ... | + | * use a remote shell form host to host (crossing those vertical boundaries above) |
+ | * '' | ||
+ | * Once contents have been migrated '' | ||
+ | |||
+ | Note the use of trailing slashes, it means update everything inside source '' | ||
+ | |||
+ | ** Examples ** | ||
+ | |||
+ | < | ||
+ | |||
+ | # copy from dir stuff lab or remote college to my home on HPCC in tmp area | ||
+ | |||
+ | rsync -vac --bwlimit=2500 / | ||
- | So to put it all together, for example move my directory in my home directory named stuff elsewhere | + | # sync my stuff folder into /archives inside our HPCC, then clean up |
- | '' | + | rsync -vac --bwlimit=2500 /home/user/stuff/ /archives/user/stuff/ |
+ | rm -rf / | ||
- | Is output ok? Then run again the '' | + | # generate a copy of content on Rstore disk array outside of HPCC but within wesleyan.edu |
- | Note the lack of source trailing slash but present destination trailing slash; meaning put source inside destination location. If both had a trailing slash it would mean; update source and target at these locations. Beware. '' | + | rsync -vac--bwlimit=2500 / |
- | Once contents have been migrated '' | + | </code> |