Differences

This shows you the differences between two versions of the page.

--- cluster:115 [2013/06/03 09:10]
hmeij [Rhadoop]
+++ cluster:115 [2013/09/10 15:00]
hmeij [Use Hadoop (test) Cluster]
@@ Line 2: / Line 2: @@
 **[[cluster:0|Back]]**
-===== Use Hadoop (test) Cluster =====
+===== Use Hadoop Cluster =====
 [[cluster:114|Build Hadoop Cluster]]
@@ Line 342: / Line 342: @@
 <code>
 yum install openssl098e
-yum install openssl098e-devel
 </code>
@@ Line 348: / Line 347: @@
 <code>
+yum install byacc -y
+yum install automake libtool flex bison pkgconfig gcc-c++ boost-devel libevent-devel zlib-devel python-devel ruby-devel
 ./configure
-make                                                                                                 make install
+make
+make install
 export PKG_CONFIG_PATH=$PKG_CONFIG_PATH:/usr/local/lib/pkgconfig/
 pkg-config --cflags thrift
 cp -p /usr/local/lib/libthrift-0.9.0.so /usr/lib/
+HBASE_ROOT/bin/hbase thrift start &
+lsof -i:9090 that is server, port 9095 is monitor
 </code>
-Configure for distributed environment: [[hbase.apache.org/book/standalone_dist.html]]
+Configure for distributed environment: [[http://hbase.apache.org/book/standalone_dist.html#standalone]]
+  * used 3 zookeepers with quorum, see config example online
+  * start with rolling_restart, the start & stop have a timing issue
+  * /hbase owened by root:root
+  * permissions reset on /hdfs, not sure why
+  * also use /sanscratch/zookeepers
+  *
@@ Line 548: / Line 562: @@
 ==== Perl Hadoop::Streaming ====
+  * All nodes
   * [[http://search.cpan.org/~spazm/Hadoop-Streaming-0.122420/lib/Hadoop/Streaming.pm]]

DokuWiki

User Tools

Site Tools

Differences

Page Tools