Warning: Undefined array key "DOKU_PREFS" in /usr/share/dokuwiki/inc/common.php on line 2082
cluster:115 [DokuWiki]

User Tools

Site Tools


cluster:115

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Last revision Both sides next revision
cluster:115 [2013/09/04 14:20]
hmeij [Perl Hadoop::Streaming]
cluster:115 [2013/09/10 15:00]
hmeij [Use Hadoop (test) Cluster]
Line 2: Line 2:
 **[[cluster:0|Back]]** **[[cluster:0|Back]]**
  
-===== Use Hadoop (test) Cluster =====+===== Use Hadoop Cluster =====
  
 [[cluster:114|Build Hadoop Cluster]] [[cluster:114|Build Hadoop Cluster]]
Line 356: Line 356:
 pkg-config --cflags thrift pkg-config --cflags thrift
 cp -p /usr/local/lib/libthrift-0.9.0.so /usr/lib/ cp -p /usr/local/lib/libthrift-0.9.0.so /usr/lib/
 +
 +HBASE_ROOT/bin/hbase thrift start &
 +lsof -i:9090 that is server, port 9095 is monitor
 +
 </code> </code>
  
 Configure for distributed environment: [[http://hbase.apache.org/book/standalone_dist.html#standalone]] Configure for distributed environment: [[http://hbase.apache.org/book/standalone_dist.html#standalone]]
 +
 +  * used 3 zookeepers with quorum, see config example online
 +  * start with rolling_restart, the start & stop have a timing issue
 +  * /hbase owened by root:root
 +  * permissions reset on /hdfs, not sure why
 +  * also use /sanscratch/zookeepers
 +  * 
  
  
Line 552: Line 563:
 ==== Perl Hadoop::Streaming ==== ==== Perl Hadoop::Streaming ====
  
-  * Isstalled on whitetail only+  * All nodes
  
  
cluster/115.txt ยท Last modified: 2013/09/10 15:04 by hmeij