Warning: Undefined array key "DOKU_PREFS" in /usr/share/dokuwiki/inc/common.php on line 2082
cluster:149 [DokuWiki]

DokuWiki

User Tools

Site Tools

Trace:
cluster:149

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
Next revision Both sides next revision
cluster:149 [2016/08/31 11:05]
hmeij07 [Supermicro] 		cluster:149 [2016/10/27 14:49]
hmeij07
Line 6: Line 6:
  
  
-==== The problem ==== +==== The Storage Problem ==== 
  
 In a commodity HPC setup deploying plain NFS, bottle necks can develop.  Then the compute nodes hang and a cold reboot of the entire HPCC is needed. NFS clients on a compute node may contact NFS daemons on our file server sharptail and ask for say a file. The NFS daemon assigned the task then locates the content via metadata (location, inodes, access, etc) on the local disk array.  The NFS daemon  collects the content and hands it off to the NFS client on compute node. So the data passes thru the entire NFS layer. In a commodity HPC setup deploying plain NFS, bottle necks can develop.  Then the compute nodes hang and a cold reboot of the entire HPCC is needed. NFS clients on a compute node may contact NFS daemons on our file server sharptail and ask for say a file. The NFS daemon assigned the task then locates the content via metadata (location, inodes, access, etc) on the local disk array.  The NFS daemon  collects the content and hands it off to the NFS client on compute node. So the data passes thru the entire NFS layer.
Line 104: Line 104:
   * Grab the 32x2T flexstorage hard drives and insert into cottontail's empty disk array   * Grab the 32x2T flexstorage hard drives and insert into cottontail's empty disk array
       * Makes for a 60T raw raid 6 storage place (2 hot spares)       * Makes for a 60T raw raid 6 storage place (2 hot spares)
-      * move the greentail /home backup to it (ready to serve out if needed) +      * move the sharptail /snapshots to it (remove that traffic from file server)
-      * move the sharptail /snashots to it (remove that traffic from file server)+
   * Dedicate greentail's disk array to /sanscratch   * Dedicate greentail's disk array to /sanscratch
       * Remove /home_backup 10T       * Remove /home_backup 10T
Line 113: Line 112:
       * Remove 15T /snapshots       * Remove 15T /snapshots
       * Extend /home for 10T to 25T       * Extend /home for 10T to 25T
-      * Raise default quota to 512G +      * Keep 7T /archives until those users graduate, move to Rstore 
-      * Keep 7T /archives until those users graduate, move to Rstore (add to old /sanscratch?)+
  
 **Long term plan** **Long term plan**
cluster/149.txt · Last modified: 2016/12/06 15:13 by hmeij07

Page Tools

Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
CC Attribution-Share Alike 4.0 International Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki