Warning: Undefined array key "DOKU_PREFS" in /usr/share/dokuwiki/inc/common.php on line 2082
cluster:149 [DokuWiki]

User Tools

Site Tools


cluster:149

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision Both sides next revision
cluster:149 [2016/09/16 10:01]
hmeij07
cluster:149 [2016/10/27 14:49]
hmeij07
Line 6: Line 6:
  
  
-==== The problem ==== +==== The Storage Problem ==== 
  
 In a commodity HPC setup deploying plain NFS, bottle necks can develop.  Then the compute nodes hang and a cold reboot of the entire HPCC is needed. NFS clients on a compute node may contact NFS daemons on our file server sharptail and ask for say a file. The NFS daemon assigned the task then locates the content via metadata (location, inodes, access, etc) on the local disk array.  The NFS daemon  collects the content and hands it off to the NFS client on compute node. So the data passes thru the entire NFS layer. In a commodity HPC setup deploying plain NFS, bottle necks can develop.  Then the compute nodes hang and a cold reboot of the entire HPCC is needed. NFS clients on a compute node may contact NFS daemons on our file server sharptail and ask for say a file. The NFS daemon assigned the task then locates the content via metadata (location, inodes, access, etc) on the local disk array.  The NFS daemon  collects the content and hands it off to the NFS client on compute node. So the data passes thru the entire NFS layer.
cluster/149.txt ยท Last modified: 2016/12/06 15:13 by hmeij07