This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
cluster:115 [2013/05/28 13:54] hmeij [Rhadoop] |
cluster:115 [2013/09/04 18:20] hmeij [Perl Hadoop::Streaming] |
||
---|---|---|---|
Line 275: | Line 275: | ||
R CMD INSTALL rmr-2.2.0.tar.gz | R CMD INSTALL rmr-2.2.0.tar.gz | ||
R CMD INSTALL rhdfs_1.0.5.tar.gz | R CMD INSTALL rhdfs_1.0.5.tar.gz | ||
+ | </ | ||
+ | |||
+ | Verify | ||
+ | |||
+ | < | ||
+ | Type ' | ||
+ | |||
+ | > library(rmr2) | ||
+ | Loading required package: Rcpp | ||
+ | Loading required package: RJSONIO | ||
+ | Loading required package: digest | ||
+ | Loading required package: functional | ||
+ | Loading required package: stringr | ||
+ | Loading required package: plyr | ||
+ | Loading required package: reshape2 | ||
+ | > library(rhdfs) | ||
+ | Loading required package: rJava | ||
+ | |||
+ | HADOOP_CMD=/ | ||
+ | |||
+ | Be sure to run hdfs.init() | ||
+ | > sessionInfo() | ||
+ | R version 3.0.0 (2013-04-03) | ||
+ | Platform: x86_64-redhat-linux-gnu (64-bit) | ||
+ | |||
+ | locale: | ||
+ | [1] LC_CTYPE=en_US.UTF-8 | ||
+ | [3] LC_TIME=en_US.UTF-8 | ||
+ | [5] LC_MONETARY=en_US.UTF-8 | ||
+ | [7] LC_PAPER=C | ||
+ | [9] LC_ADDRESS=C | ||
+ | [11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C | ||
+ | |||
+ | attached base packages: | ||
+ | [1] stats | ||
+ | |||
+ | other attached packages: | ||
+ | [1] rhdfs_1.0.5 | ||
+ | [6] stringr_0.6.2 | ||
+ | |||
</ | </ | ||
Line 294: | Line 334: | ||
</ | </ | ||
+ | Then Hbase for Rhbase: | ||
+ | |||
+ | [[http:// | ||
+ | |||
+ | But first Trift, the language interface to the database Hbase: | ||
+ | |||
+ | < | ||
+ | yum install openssl098e | ||
+ | </ | ||
+ | |||
+ | Download Trift: [[http:// | ||
+ | |||
+ | < | ||
+ | yum install byacc -y | ||
+ | yum install automake libtool flex bison pkgconfig gcc-c++ boost-devel libevent-devel zlib-devel python-devel ruby-devel | ||
+ | |||
+ | ./configure | ||
+ | make | ||
+ | make install | ||
+ | export PKG_CONFIG_PATH=$PKG_CONFIG_PATH:/ | ||
+ | pkg-config --cflags thrift | ||
+ | cp -p / | ||
+ | </ | ||
+ | Configure for distributed environment: | ||
Line 487: | Line 551: | ||
==== Perl Hadoop:: | ==== Perl Hadoop:: | ||
+ | |||
+ | * Installed on whitetail only | ||
+ | |||
* [[http:// | * [[http:// |