User Tools

Site Tools


cluster:112

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
cluster:112 [2013/05/14 14:30]
hmeij [Overview]
cluster:112 [2013/10/08 19:04] (current)
hmeij [Quotes Oct-2013]
Line 22: Line 22:
  
  
-  * 2013 Dell measurements (see bottom table) put power consumption at 109,+  * 2009 Dell measurements put power consumption at 100,740 KwH per year (how?) 
 +  * 2013 Dell measurements (see bottom table) put power consumption at 109,956 KwH per year (for 30 servers) 
 ====== Details ====== ====== Details ======
  
Line 148: Line 150:
 |  c35|  8| 13.69|  28:53|  474|  still running|  |  |  | *| |  c35|  8| 13.69|  28:53|  474|  still running|  |  |  | *|
  
-  * Average for "still running" nodes is 418.4 watts or 109,956 KwH/year (watts/1000)*24*365*30 servers+  * Average for "still running" nodes is 418.4 watts or 109,956 KwH/year  
 +  * (watts/1000 Kw per hour) * 24 hours * 365 days * 30 servers
   * In 2009 dollars that is $25,000 in power (plus that in cooling) or $50,000 per year   * In 2009 dollars that is $25,000 in power (plus that in cooling) or $50,000 per year
   * What is that in 2013 dollars (with cogen online in Pine Street)?   * What is that in 2013 dollars (with cogen online in Pine Street)?
-  *  
  
 +We have measured 19 nodes power consumption (pulling one unit out) with a Kill-A-Watt meter over 775+ hours to arrive at a mean consumption rate of 418.4 watts. That totals to 109,956 KwH/year in power consumption ((watts/1000 Kw per hour) * 24 hours * 365 days * 30 servers), which is a low water mark as the racks in question also contain switches, two UPS units, and a disk array. (Note: Peter did a side calculation using  the 4 watt measurement on panel directly and came up with 126,000 KwH/year which can be considered the high water mark estimate). 
 +
 +
 +
 +Based on 12.5 cents per Kwh (this is an all inclusive cost including natural gas cost, heat recoup costs, distribution, maintenance etc) the hardware burns away $13,744.50 per year. Best guess is cooling costs are at least that (another possible low water mark) so the total cost for all power consumption is $27,489 per year. If we run the hardware for another 3 years that total cost is $82,467. 
 +
 +
 +
 +If we could replace, or approximate, the 30 compute nodes' computational power (0.6 teraflops) and job slots (240 cores) with new hardware that consumes 50% less in power, our ROI is 6 years based on the low water mark numbers. When using the high water mark the ROI is 5 years.
 +
 +====== Quotes Oct-2013 ======
 +
 +For $82K one could get CPU-HPC wise ...
  
 +  *[[http://download.intel.com/support/processors/xeon/sb/xeon_E5-2600.pdf|Intel Xeon Metrics]]
 +    * E5-2650v2 "ivy" 128 gflops
 +    * E5-2680v2 172.8 gflops
  
 +^vendor^Tnodes^chip^ghz^cache^cores^Tcores^disk^ram^ram/core^Tram^pdu^eswitch^warr^watt^cost^gflops^
 +|dell|30|X5355|2.66|4mb|8|240|80gb|4-16gb|0.5-2gb|340|Y|Y|N|12,552|na|670|
 +|micro|14|2650v2|2.60|20mb|16|224|1tb|128gb|8gb|1,792gb|Y|Y|2|5,400|$77K|4,659|
 +|advcl|10|2680v2|2.80|25mb|20|200|60gb|256gb|12.8gb|2,560gb|Y|Y|3|4,597|$84K|4,480|
 +|exxct|12|2660v2|2.20|25mb|20|240|1tb|128gb|6.4gb|1,536gb|N|N|?|4,860|$60K|4,224|
 +|hp| | | | | | | | | | | | | | | |
  
  
cluster/112.1368541836.txt.gz · Last modified: 2013/05/14 14:30 by hmeij