This shows you the differences between two versions of the page.
Next revision | Previous revision Next revision Both sides next revision | ||
cluster:123 [2013/10/10 13:08] hmeij created |
cluster:123 [2013/10/10 15:21] hmeij |
||
---|---|---|---|
Line 4: | Line 4: | ||
==== Replace Dell Racks ==== | ==== Replace Dell Racks ==== | ||
- | A Novella: Replace the Dell Racks with new hardware | + | **A Novella: Replace the Dell Racks with new hardware**\\ |
- | Subtitle: A win-win solution by Physical | + | Subtitle: A win-win solution |
- | Once upon a time, back in 2013, two Dell racks full of compute nodes, sat noisily chewing away energy. | + | Once upon a time, back in 2013, two Dell racks full of compute nodes, sat noisily chewing away energy |
+ | The Dell racks contain 30 compute nodes, two UPS units, two disks arrays and two switches. We have measured 19 nodes power consumption (pulling one the dual power units out) with a Kill-A-Watt meter for over 775+ hours. The mean power consumption rate is 418.4 watts. That totals to 109,956 KwH/year in power consumption ((watts/ | ||
+ | |||
+ | Next we need to convert to a dollar value. | ||
+ | |||
+ | Based on 12.5 cents per Kwh (all costs included) the Dell compuet nodes consumed $13,744.50 per year in power. Best guess is cooling costs are at least that (another possible low water mark) so the total cost for both power and colling consumption is $27,489 per year. | ||
+ | |||
+ | |||
+ | Next step was to collect quotes for a target budget of $82K, 3 years of Dell energy consumption, | ||
+ | |||
+ | Old hardware: | ||
+ | 30 nodes, 2.66 ghz, 4 mb L-cache (for cpu), 240 cores (job slots), | ||
+ | 80 gb local drive, 340 gb total ram, 12,555 watts (power no cooling), 670 gigaflops (actual measure) | ||
+ | |||
+ | New hardware: | ||
+ | 14 nodes, 2.60 ghz, 20 mb L-cache (for cpu), 224 cores (job slots), | ||
+ | 1TB local drive, 1,792 gb total ram, 5,400 watts (power no cooling), 4,659 gigaflops (theoretical) | ||
+ | |||
+ | In the representative example total energy consumption would be 10,800 watts. | ||
+ | |||
+ | The total cost of running the new hardware would be $5,913. That would imply a savings rate of $21,576 per year. The job slot count would be 112 but with hyperthreading technology that can be doubled. We'd still want the 1,792 memory footprint (8 gb/core) and the gigaflops still far exceeds Dell's performance. | ||
+ | |||
+ | Within two years, the new hardware (about $41K) will have paid for itself based on the low water mark (Dell' | ||
+ | |||
+ | * there is enough Infiniband ports available to put all new nodes on such a switch (add cards and cables cost) | ||
+ | * the internal disks need to be of higher speed (10K or better) of a larger size (300 GB or larger) mimicking the Dell disk arrays (add costs) | ||
+ | |||
+ | But it is all very doable within budget of $45-$55K | ||
The end. | The end. |