Differences

This shows you the differences between two versions of the page.

--- cluster:112 [2013/05/13 14:34]
hmeij [Dell April-2013]
+++ cluster:112 [2013/10/08 19:04] (current)
hmeij [Quotes Oct-2013]
@@ Line 21: / Line 21: @@
 |  $1,000/Tflop|  |  69.8|  28.6|  1.3|  6.5|  ((for Wesleyan/vendors data))using 2009 data|
+  * 2009 Dell measurements put power consumption at 100,740 KwH per year (how?)
+  * 2013 Dell measurements (see bottom table) put power consumption at 109,956 KwH per year (for 30 servers)
 ====== Details ======
@@ Line 126: / Line 129: @@
 Kill-A-Watt Meter Stats; pulled one power supply ... mean/1000 * 24 * 365 * 30!
-^  Node^  jobs^  kwh^  time hh:mm^  mean^  comment^  annual kwh^ power annual^ +cooling annual (x2)^^
+^  Node^  jobs^  kwh^  time hh:mm^  mean^  comment^  annual kwh^ power annual^ +cooling annual (x2)^  ^
 |  c04|  8|  2.29|  06:30|  352|  idle, no jobs|   92,509|  $21,393|  $42,786|  wow|
 |  c32|  8|  6.94|  19:35|  356|  jobs finished|   93,556|  $21,610|  $43,220|  |
@@ Line 135: / Line 138: @@
 |  c04|  8| 12.02|  28:08|  429|  still running|  112,741|  $25,585|  $51,170| *|
 |  c09|  8| 10.36|  24:00|  432|  still running|  113,530|  $25,748|  $51,496| *|
-|  c10|  8| 10.21|  23:55|  425|  still running|  111,690|  $25,367|  $50,734| * mean|
+|  c10|  8| 10.21|  23:55|  425|  still running|  111,690|  $25,367|  $50,734| *|
-|  c11|  4|  |  |  |  still running|  |  |  | *|
-|  c13|  3|  |  |  |  still running|  |  |  | *|
 |  c17|  8| 27.07|  71:00|  381|  still running|  |  |  | *|
 |  c18|  8| 11.23|  24:41|  455|  still running|  |  |  | *|
@@ Line 149: / Line 150: @@
 |  c35|  8| 13.69|  28:53|  474|  still running|  |  |  | *|
+  * Average for "still running" nodes is 418.4 watts or 109,956 KwH/year
+  * (watts/1000 Kw per hour) * 24 hours * 365 days * 30 servers
+  * In 2009 dollars that is $25,000 in power (plus that in cooling) or $50,000 per year
+  * What is that in 2013 dollars (with cogen online in Pine Street)?
+We have measured 19 nodes power consumption (pulling one unit out) with a Kill-A-Watt meter over 775+ hours to arrive at a mean consumption rate of 418.4 watts. That totals to 109,956 KwH/year in power consumption ((watts/1000 Kw per hour) * 24 hours * 365 days * 30 servers), which is a low water mark as the racks in question also contain switches, two UPS units, and a disk array. (Note: Peter did a side calculation using  the 4 watt measurement on panel directly and came up with 126,000 KwH/year which can be considered the high water mark estimate).
+Based on 12.5 cents per Kwh (this is an all inclusive cost including natural gas cost, heat recoup costs, distribution, maintenance etc) the hardware burns away $13,744.50 per year. Best guess is cooling costs are at least that (another possible low water mark) so the total cost for all power consumption is $27,489 per year. If we run the hardware for another 3 years that total cost is $82,467.
+If we could replace, or approximate, the 30 compute nodes' computational power (0.6 teraflops) and job slots (240 cores) with new hardware that consumes 50% less in power, our ROI is 6 years based on the low water mark numbers. When using the high water mark the ROI is 5 years.
+====== Quotes Oct-2013 ======
+For $82K one could get CPU-HPC wise ...
+  *[[http://download.intel.com/support/processors/xeon/sb/xeon_E5-2600.pdf|Intel Xeon Metrics]]
+    * E5-2650v2 "ivy" 128 gflops
+    * E5-2680v2 172.8 gflops
+^vendor^Tnodes^chip^ghz^cache^cores^Tcores^disk^ram^ram/core^Tram^pdu^eswitch^warr^watt^cost^gflops^
+|dell|30|X5355|2.66|4mb|8|240|80gb|4-16gb|0.5-2gb|340|Y|Y|N|12,552|na|670|
+|micro|14|2650v2|2.60|20mb|16|224|1tb|128gb|8gb|1,792gb|Y|Y|2|5,400|$77K|4,659|
+|advcl|10|2680v2|2.80|25mb|20|200|60gb|256gb|12.8gb|2,560gb|Y|Y|3|4,597|$84K|4,480|
+|exxct|12|2660v2|2.20|25mb|20|240|1tb|128gb|6.4gb|1,536gb|N|N|?|4,860|$60K|4,224|
+|hp| | | | | | | | | | | | | | | |

DokuWiki

User Tools

Site Tools

Differences

Page Tools