cluster:121
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
cluster:121 [2013/09/16 14:37] hmeij |
cluster:121 [2013/09/16 15:09] (current) hmeij |
||
|---|---|---|---|
| Line 4: | Line 4: | ||
| ==== Hadoop Summary ==== | ==== Hadoop Summary ==== | ||
| - | Our production Hadoop Cluster is based on [[http:// | + | Our production Hadoop Cluster is based on [[http:// |
| * namenode (that is login node): whitetail.wesleyan.edu | * namenode (that is login node): whitetail.wesleyan.edu | ||
| Line 16: | Line 16: | ||
| * HDFS is not backed up! | * HDFS is not backed up! | ||
| * You must request a writable work area / | * You must request a writable work area / | ||
| - | * Be sure to down load your results to / | + | * Be sure to down load your results to / |
| * Data to be shared (dictionaries, | * Data to be shared (dictionaries, | ||
| Line 25: | Line 25: | ||
| * python | * python | ||
| * perl (Hadoop:: | * perl (Hadoop:: | ||
| + | * java (both Oracle in /usr/java and openJDK) | ||
| * R+RHadoop (rmr2, rhdfs, rhbase) | * R+RHadoop (rmr2, rhdfs, rhbase) | ||
| * Hbase (noSQL database) | * Hbase (noSQL database) | ||
| Line 30: | Line 31: | ||
| * [[http:// | * [[http:// | ||
| * MySQL | * MySQL | ||
| - | * request a database to be set up | + | * request a database to be set up for you (limited space) |
| - | Note: the permissions are bit weird in HDFS but I think it is sorted out. | + | * Note: the permissions are bit weird in HDFS but I think it is sorted out. |
| - | * If this turns into a problem we'll let everybody run as user hdfs ... | + | * If this turns into a problem we'll let everybody run as user hdfs ... |
| + | * Note: some http links will not work because they point to the private network | ||
| + | * If you wish to view them launch firefox from whitetail | ||
| Other useful pages | Other useful pages | ||
| Line 40: | Line 43: | ||
| * [[cluster: | * [[cluster: | ||
| + | \\ | ||
| + | **[[cluster: | ||
cluster/121.1379342237.txt.gz · Last modified: 2013/09/16 14:37 by hmeij
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
