This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Last revision Both sides next revision | ||
cluster:115 [2013/06/03 09:11] hmeij [Rhadoop] |
cluster:115 [2013/09/10 15:00] hmeij [Use Hadoop (test) Cluster] |
||
---|---|---|---|
Line 2: | Line 2: | ||
**[[cluster: | **[[cluster: | ||
- | ===== Use Hadoop | + | ===== Use Hadoop Cluster ===== |
[[cluster: | [[cluster: | ||
Line 342: | Line 342: | ||
< | < | ||
yum install openssl098e | yum install openssl098e | ||
- | yum install openssl098e-devel | ||
</ | </ | ||
Line 348: | Line 347: | ||
< | < | ||
+ | yum install byacc -y | ||
+ | yum install automake libtool flex bison pkgconfig gcc-c++ boost-devel libevent-devel zlib-devel python-devel ruby-devel | ||
+ | |||
./configure | ./configure | ||
- | make | + | make |
+ | make install | ||
export PKG_CONFIG_PATH=$PKG_CONFIG_PATH:/ | export PKG_CONFIG_PATH=$PKG_CONFIG_PATH:/ | ||
pkg-config --cflags thrift | pkg-config --cflags thrift | ||
cp -p / | cp -p / | ||
+ | |||
+ | HBASE_ROOT/ | ||
+ | lsof -i:9090 that is server, port 9095 is monitor | ||
+ | |||
</ | </ | ||
Configure for distributed environment: | Configure for distributed environment: | ||
+ | |||
+ | * used 3 zookeepers with quorum, see config example online | ||
+ | * start with rolling_restart, | ||
+ | * /hbase owened by root:root | ||
+ | * permissions reset on /hdfs, not sure why | ||
+ | * also use / | ||
+ | * | ||
Line 548: | Line 562: | ||
==== Perl Hadoop:: | ==== Perl Hadoop:: | ||
+ | |||
+ | * All nodes | ||
+ | |||
* [[http:// | * [[http:// |