cluster:176
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
cluster:176 [2018/11/20 16:06] hmeij07 [Rack Power] |
cluster:176 [2019/03/06 19:29] (current) hmeij07 [Metered] |
||
|---|---|---|---|
| Line 3: | Line 3: | ||
| **[[cluster: | **[[cluster: | ||
| - | ==== Rack Power ==== | + | ==== HPC Power ==== |
| - | | + | As part of our reevaluation of our data center cooling capacity and overhaul, we need to get a handle on non-emergency power consumption in data center. This will be done by a third party consultant by clamping power cables in the penthouse of Excley. So I bought myself a metered PDU and have been busy plugging entire racks into it one at a time. I then measure " |
| + | |||
| + | | ||
| * " | * " | ||
| - | * Ammps * 208V = Watts | + | * Metered Amps * 208V = Watts |
| * Watts * (24 * 365)/1000 = KwH/Y | * Watts * (24 * 365)/1000 = KwH/Y | ||
| - | * kwH/Y * $0.12 = $/Y | + | * kwH/Y * $0.125 = $/Y (mix cogen and utility, 2013 assumption by Pete of PP) |
| - | * Double the $/Y to include cooling costs (P Staye assumption) | + | * Double the $/Y to include cooling costs (Pete of PP assumption) |
| + | |||
| + | ^ HPC ^^ Idle ^ Peak ^ Idle ^ Peak ^ Idle ^ Peak ^ Idle ^ Peak ^ ^ | ||
| + | ^ Rack ^ L6-30P | ||
| + | | R4R04 | 3 | 22 | 37 | 4,576 | 7,696 | 40, | ||
| + | | R4R05 | 4 | 17 | 34 | 3,536 | 7,072 | | ||
| + | | R4R06 | 2 | 6 | | 1,204 | | 8,970 | | 1,121 | | empty | | ||
| + | | R4R07 | 2 | 14 | 34 | 2,912 | 7,072 | 25, | ||
| + | | R4R08 | 2 | 4 | | 832 | | 7,288 | | 911 | | mostly empty | | ||
| + | | Total | 13 | 63 | 105 | 13, | ||
| + | |||
| + | In 2013 we found for our Dell Racks purchased in 2006 (full of PE1950 and PE2950 servers) [[cluster: | ||
| + | |||
| + | * 115,000 KwH/Y per rack for power | ||
| + | * 14,375 $/Y per rack for power | ||
| - | ^ ^^ Idle ^ Peak ^ Idle ^ Peak ^ Idle ^ Peak ^ Idle ^ Peak ^ | + | So a great improvement in energy efficiency. We probably grew from near 5 teraflops to near 60 teraflops in this time period (double precision, floating point, theoretical). |
| - | ^ Rack ^ L6-30P | + | |
| - | | R4R04 | 3 | 22 | 37 | 4,576 | 7,696 | 40, | + | |
| - | | R4R05 | 4 | 17 | 34 | 3,536 | 7,072 | | + | |
| - | | R4R06 | 2 | 6 | | 1,204 | | 8,970 | | 1,121 | | | + | |
| - | | R4R07 | 2 | 14 | 34 | 2,912 | 7,072 | 25, | + | |
| - | | R4R08 | 2 | 4 | | 832 | | 7,288 | | 911 | | | + | |
| - | | Total | 13 | 63 | 105 | 13, | + | |
| - | * in 2013 we found for Dell Racks: | ||
| Line 69: | Line 77: | ||
| * mw128 10 nodes, idle = 4 amps, for all nodes 8 amps | * mw128 10 nodes, idle = 4 amps, for all nodes 8 amps | ||
| * mw128 10 nodes, peak = 8 amps, for all nodes 16 amps | * mw128 10 nodes, peak = 8 amps, for all nodes 16 amps | ||
| + | * 11/28/2018 17 amps observed (with 6/18 nodes at load 36) | ||
| + | * 03/05/2019 23 amps observed (...wengang jobs, mw128 nodes only! 23+16=39of60 possible) | ||
| * two switches = 2 amps | * two switches = 2 amps | ||
| * tinymem 7 nodes, idle = 2 amps, for all nodes 4 amps | * tinymem 7 nodes, idle = 2 amps, for all nodes 4 amps | ||
cluster/176.1542729961.txt.gz · Last modified: 2018/11/20 16:06 by hmeij07
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
