User Tools

Site Tools


cluster:115

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
cluster:115 [2013/06/03 13:10]
hmeij [Rhadoop]
cluster:115 [2013/09/09 18:01]
hmeij [Rhadoop]
Line 342: Line 342:
 <code> <code>
 yum install openssl098e yum install openssl098e
-yum install openssl098e-devel 
 </code> </code>
  
Line 348: Line 347:
  
 <code> <code>
 +yum install byacc -y
 +yum install automake libtool flex bison pkgconfig gcc-c++ boost-devel libevent-devel zlib-devel python-devel ruby-devel
 +
 ./configure ./configure
-make                                                                                                 make install+make 
 +make install
 export PKG_CONFIG_PATH=$PKG_CONFIG_PATH:/usr/local/lib/pkgconfig/ export PKG_CONFIG_PATH=$PKG_CONFIG_PATH:/usr/local/lib/pkgconfig/
 pkg-config --cflags thrift pkg-config --cflags thrift
Line 355: Line 358:
 </code> </code>
  
-Configure for distributed environment: [[hbase.apache.org/book/standalone_dist.html]]+Configure for distributed environment: [[http://hbase.apache.org/book/standalone_dist.html#standalone]] 
 + 
 +  * used 3 zookeepers with quorum, see config example online 
 +  * start with rolling_restart, the start & stop have a timing issue 
 +  * /hbase owened by root:root 
 +  * permissions reset on /hdfs, not sure why 
 +  * also use /sanscratch/zookeepers 
 +  * 
  
  
Line 548: Line 558:
  
 ==== Perl Hadoop::Streaming ==== ==== Perl Hadoop::Streaming ====
 +
 +  * Installed on whitetail only
 +
  
   * [[http://search.cpan.org/~spazm/Hadoop-Streaming-0.122420/lib/Hadoop/Streaming.pm]]   * [[http://search.cpan.org/~spazm/Hadoop-Streaming-0.122420/lib/Hadoop/Streaming.pm]]
cluster/115.txt · Last modified: 2013/09/10 19:04 by hmeij