This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
cluster:176 [2018/11/20 15:37] hmeij07 [Rack Power] |
cluster:176 [2018/11/28 14:16] hmeij07 |
||
---|---|---|---|
Line 3: | Line 3: | ||
**[[cluster: | **[[cluster: | ||
- | ==== Rack Power ==== | + | ==== HPC Power ==== |
+ | |||
+ | As part of our reevaluation of our data center cooling capacity and overhaul, we need to get a handle on non-emergency power consumption in data center. This will be done by a third party consultant by clamping power cables in the penthouse of Excley. So I bought myself a metered PDU and have been busy plugging entire racks into it one at a time. I then measure " | ||
+ | |||
+ | * " | ||
+ | * " | ||
+ | * Metered Amps * 208V = Watts | ||
+ | * Watts * (24 * 365)/1000 = KwH/Y | ||
+ | * kwH/Y * $0.125 = $/Y (mix cogen and utility, 2013 assumption by Pete of PP) | ||
+ | * Double the $/Y to include cooling costs (Pete of PP assumption) | ||
+ | |||
+ | ^ HPC ^^ Idle ^ Peak ^ Idle ^ Peak ^ Idle ^ Peak ^ Idle ^ Peak ^ ^ | ||
+ | ^ Rack ^ L6-30P | ||
+ | | R4R04 | 3 | 22 | 37 | 4,576 | 7,696 | 40, | ||
+ | | R4R05 | 4 | 17 | 34 | 3,536 | 7,072 | | ||
+ | | R4R06 | 2 | 6 | | 1,204 | | 8,970 | | 1,121 | | empty | | ||
+ | | R4R07 | 2 | 14 | 34 | 2,912 | 7,072 | 25, | ||
+ | | R4R08 | 2 | 4 | | 832 | | 7,288 | | 911 | | mostly empty | | ||
+ | | Total | 13 | 63 | 105 | 13, | ||
+ | |||
+ | In 2013 we found for our Dell Racks purchased in 2006 (full of PE1950 and PE2950 servers) [[cluster: | ||
+ | |||
+ | * 115,000 KwH/Y per rack for power | ||
+ | * 14,375 $/Y per rack for power | ||
+ | |||
+ | So a great improvement in energy efficiency. We probably grew from near 5 teraflops to near 60 teraflops in this time period (double precision, floating point, theoretical). | ||
+ | |||
- | ^ Rack ^ L6-30P | ||
- | | R4R04 | 3 | 22 | 37 | 4,576 | 7,696 | | ||
- | | R4R05 | 4 | 17 | 34 | 3,536 | 7,072 | | ||
- | | R4R06 | 2 | 6 | | 1,204 | | | ||
- | | R4R07 | 2 | 14 | 34 | 2,912 | 7,072 | | ||
- | | R4R08 | 2 | 4 | | 832 | | | ||
==== Metered ==== | ==== Metered ==== | ||
Line 56: | Line 77: | ||
* mw128 10 nodes, idle = 4 amps, for all nodes 8 amps | * mw128 10 nodes, idle = 4 amps, for all nodes 8 amps | ||
* mw128 10 nodes, peak = 8 amps, for all nodes 16 amps | * mw128 10 nodes, peak = 8 amps, for all nodes 16 amps | ||
+ | * 11/28/2018 17 amps observed (with 7 node load 36) | ||
* two switches = 2 amps | * two switches = 2 amps | ||
* tinymem 7 nodes, idle = 2 amps, for all nodes 4 amps | * tinymem 7 nodes, idle = 2 amps, for all nodes 4 amps |