| Both sides previous revision
Previous revision
Next revision
|
Previous revision
Next revision
Both sides next revision
|
cluster:189 [2020/01/12 15:51]
hmeij07 |
cluster:189 [2020/01/13 13:01]
hmeij07 [General] |
| A gpu hour of usage is 3x the cpu hourly rate.\\ | A gpu hour of usage is 3x the cpu hourly rate.\\ |
| |
| We currently have about 1,450 physical cpu cores (all Xeon), 60 gpus (K20, GTX2018Ti, RTX2080S), 520 gb of gpu memory and 8,560 gb of cpu memory. Provided by about 120 compute nodes and login nodes. Scratch spaces are provided local to compute nodes (2-5 tb) or over the network via NFS (55 tb), consult [[cluster:142|Scratch Spaces]]. Home directories are under quota (10 tb) but these will disappear in the future with the TrueNAS/ZFS appliance (190 tb, 475 tb effective assuming a compression rate of 2.5x, consult [[cluster:186|Home Dir Server]]). A HPCC guide can be found here [[cluster:126|Brief Guide to HPCC]] and the (endless!) software list is located here [[cluster:73|Software Page]] | We currently have about 1,450 physical cpu cores (all Xeon), 72 gpus (20x K20, 4x GTX2018Ti, 48x RTX2080S), 520 gb of gpu memory and 8,560 gb of cpu memory. Provided by about 120 compute nodes and login nodes. Scratch spaces are provided local to compute nodes (2-5 tb) or over the network via NFS (55 tb), consult [[cluster:142|Scratch Spaces]]. Home directories are under quota (10 tb) but these will disappear in the future with the TrueNAS/ZFS appliance (190 tb, 475 tb effective assuming a compression rate of 2.5x, consult [[cluster:186|Home Dir Server]]). A HPCC guide can be found here [[cluster:126|Brief Guide to HPCC]] and the (endless!) software list is located here [[cluster:73|Software Page]]. We run CentOS 6.10 or 7.6 flavors of OS. |
| |
| |
| ==== General ==== | ==== General ==== |
| |
| There are 557 lines in ''/etc/passwd'' at this writing. Assume 25 are system accounts, 25 collaboration accounts (hpc01-hpc25, can VPN, for non Wesleyan faculty/PI, AD accounts), 100 temporary/recyclable class accounts (hpc100-hpc200, can not VPN, AD accounts) which then leaves a lifetime user base of roughly 400 user accounts. Of those, which come and go, 2 to 2 dozen users may be logged in at any time. | There are 557 lines in ''/etc/passwd'' at this writing. Assume 25 are system accounts, 25 collaboration accounts (hpc01-hpc25, can VPN, for non Wesleyan faculty/PI, AD accounts), 100 temporary/recyclable class accounts (hpc100-hpc200, can not VPN, local accounts) which then leaves a lifetime user base of roughly 400 user accounts. Of those, which come and go, 2 to 2 dozen users may be logged in at any time. |
| |
| Rstore is a platform for storing research static data. The hope is to move static data off the HPCC and mount it read-only back onto the HPCC login nodes. 440 tb, fully replicated, is provided for this purpose (Supermicro storage boxes using Rsync as replication engine) for HPCC users and other Wesleyan groups. | Rstore is a platform for storing research static data. The hope is to move static data off the HPCC and mount it read-only back onto the HPCC login nodes. 440 tb, fully replicated, is provided for this purpose (Supermicro storage boxes using Rsync as replication engine). For HPCC users and other Wesleyan groups. |
| |
| The Data Center has recently been renovated so the HPCC has no more cooling power problems (It used to be in the event of a cooling tower failure, within 3 hours the HPCC would push temps above 85F). No more. We have sufficient rack space (5) and power for expansion. For details on that "live renovation" process visit [[cluster:178|Data Center Renovation]]. It turned out the HPCC was consuming 1/3rd of all electric and cooling capacities. Go HPCC. | The Data Center has recently been renovated so the HPCC has no more cooling problems (It used to be in the event of a cooling tower failure, within 3 hours the HPCC would push temps above 85F). No more. We have sufficient rack space (5) and power for expansion. For details on that "live renovation" process visit [[cluster:178|Data Center Renovation]]. It turned out the HPCC was consuming 1/3rd of all electric and cooling capacities. Go HPCC. |
| |
| |
