This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
cluster:121 [2013/09/11 19:43] hmeij [Hadoop Summary] |
cluster:121 [2013/09/16 13:57] hmeij |
||
---|---|---|---|
Line 4: | Line 4: | ||
==== Hadoop Summary ==== | ==== Hadoop Summary ==== | ||
- | Our production Hadoop Cluster is based on [[http:// | + | Our production Hadoop Cluster is based on [[http:// |
- | * namenode (that is login node) is whitetail.wesleyan.edu | + | * namenode (that is login node): whitetail.wesleyan.edu |
- | * whitetail also runs the Hadoop | + | * whitetail also runs the Hadoop |
+ | * [[http:// | ||
+ | * [[http:// | ||
* ssh to it directly or from any of our other tails | * ssh to it directly or from any of our other tails | ||
* resources: access to 600 GB of memory and 1.75 TB of Hadoop' | * resources: access to 600 GB of memory and 1.75 TB of Hadoop' | ||
* could be doubled in near future if needed | * could be doubled in near future if needed | ||
- | | + | |
- | * Health Status | + | |
- | * Job Tracker | + | * You must request a writable work area / |
+ | * Be sure to down load your results to / | ||
+ | |||
+ | * Data to be shared (dictionaries, | ||
+ | * request such items to be posted there | ||
+ | |||
+ | * Basic tools (request other tools to be installed) | ||
+ | * shell scripting | ||
+ | * python | ||
+ | * perl (Hadoop:: | ||
+ | * R+RHadoop (rmr2, rhdfs, rhbase) | ||
+ | * Hbase (noSQL database) | ||
+ | * [[http:// | ||
+ | * [[http:// | ||
+ | * MySQL | ||
+ | * request a database to be set up | ||