User Tools

Site Tools


cluster:112

Warning: Undefined array key -1 in /usr/share/dokuwiki/inc/html.php on line 1458

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
cluster:112 [2013/05/14 10:24]
hmeij [Dell April-2013]
cluster:112 [2013/10/08 15:04] (current)
hmeij [Quotes Oct-2013]
Line 21: Line 21:
 |  $1,000/Tflop|  |  69.8|  28.6|  1.3|  6.5|  ((for Wesleyan/vendors data))using 2009 data| |  $1,000/Tflop|  |  69.8|  28.6|  1.3|  6.5|  ((for Wesleyan/vendors data))using 2009 data|
  
 +
 +  * 2009 Dell measurements put power consumption at 100,740 KwH per year (how?)
 +  * 2013 Dell measurements (see bottom table) put power consumption at 109,956 KwH per year (for 30 servers)
  
 ====== Details ====== ====== Details ======
Line 147: Line 150:
 |  c35|  8| 13.69|  28:53|  474|  still running|  |  |  | *| |  c35|  8| 13.69|  28:53|  474|  still running|  |  |  | *|
  
-  * Average for "still running" nodes is 418.4 watts or 109,956 KwH/year (watts/1000)*24*365*30 servers +  * Average for "still running" nodes is 418.4 watts or 109,956 KwH/year  
-  * In 2009 dollars that is $25,000 in power (plsu that in cooling) or $50,000 per year+  * (watts/1000 Kw per hour) * 24 hours * 365 days * 30 servers 
 +  * In 2009 dollars that is $25,000 in power (plus that in cooling) or $50,000 per year
   * What is that in 2013 dollars (with cogen online in Pine Street)?   * What is that in 2013 dollars (with cogen online in Pine Street)?
-  *  
  
 +We have measured 19 nodes power consumption (pulling one unit out) with a Kill-A-Watt meter over 775+ hours to arrive at a mean consumption rate of 418.4 watts. That totals to 109,956 KwH/year in power consumption ((watts/1000 Kw per hour) * 24 hours * 365 days * 30 servers), which is a low water mark as the racks in question also contain switches, two UPS units, and a disk array. (Note: Peter did a side calculation using  the 4 watt measurement on panel directly and came up with 126,000 KwH/year which can be considered the high water mark estimate). 
 +
 +
 +
 +Based on 12.5 cents per Kwh (this is an all inclusive cost including natural gas cost, heat recoup costs, distribution, maintenance etc) the hardware burns away $13,744.50 per year. Best guess is cooling costs are at least that (another possible low water mark) so the total cost for all power consumption is $27,489 per year. If we run the hardware for another 3 years that total cost is $82,467. 
 +
 +
 +
 +If we could replace, or approximate, the 30 compute nodes' computational power (0.6 teraflops) and job slots (240 cores) with new hardware that consumes 50% less in power, our ROI is 6 years based on the low water mark numbers. When using the high water mark the ROI is 5 years.
 +
 +====== Quotes Oct-2013 ======
 +
 +For $82K one could get CPU-HPC wise ...
  
 +  *[[http://download.intel.com/support/processors/xeon/sb/xeon_E5-2600.pdf|Intel Xeon Metrics]]
 +    * E5-2650v2 "ivy" 128 gflops
 +    * E5-2680v2 172.8 gflops
  
 +^vendor^Tnodes^chip^ghz^cache^cores^Tcores^disk^ram^ram/core^Tram^pdu^eswitch^warr^watt^cost^gflops^
 +|dell|30|X5355|2.66|4mb|8|240|80gb|4-16gb|0.5-2gb|340|Y|Y|N|12,552|na|670|
 +|micro|14|2650v2|2.60|20mb|16|224|1tb|128gb|8gb|1,792gb|Y|Y|2|5,400|$77K|4,659|
 +|advcl|10|2680v2|2.80|25mb|20|200|60gb|256gb|12.8gb|2,560gb|Y|Y|3|4,597|$84K|4,480|
 +|exxct|12|2660v2|2.20|25mb|20|240|1tb|128gb|6.4gb|1,536gb|N|N|?|4,860|$60K|4,224|
 +|hp| | | | | | | | | | | | | | | |
  
  
cluster/112.1368541457.txt.gz · Last modified: 2013/05/14 10:24 by hmeij