cluster:121
Differences
This shows you the differences between two versions of the page.
| Next revision | Previous revision Next revision Both sides next revision | ||
|
cluster:121 [2013/09/10 18:59] hmeij created |
cluster:121 [2013/09/16 13:46] hmeij |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| \\ | \\ | ||
| **[[cluster: | **[[cluster: | ||
| + | |||
| + | ==== Hadoop Summary ==== | ||
| + | |||
| + | Our production Hadoop Cluster is based on [[http:// | ||
| + | |||
| + | * namenode (that is login node): whitetail.wesleyan.edu | ||
| + | * whitetail also runs the Hadoop Scheduler and Health Monitor | ||
| + | * [[http:// | ||
| + | * [[http:// | ||
| + | * ssh to it directly or from any of our other tails | ||
| + | * resources: access to 600 GB of memory and 1.75 TB of Hadoop' | ||
| + | * could be doubled in near future if needed | ||
| + | |||
| + | * HDFS is not backed up! | ||
| + | * You must request a writable work area / | ||
| + | * Be sure to down load your results to / | ||
| + | |||
| + | * Data to be shared (dictionaries, | ||
| + | * request such items to be posted there | ||
| + | |||
| + | * Basic tools (request other tools to be installed) | ||
| + | * shell scripting | ||
| + | * python | ||
| + | * perl (Hadoop:: | ||
| + | * R+RHadoop (rmr2, rhdfs, rhbase) | ||
| + | * Hbase (noSQL database) | ||
| + | * [[http:// | ||
| + | * [[http:// | ||
| + | * MySQL | ||
| + | * request a database to be set up | ||
| + | |||
| + | |||
| + | |||
| Other useful pages | Other useful pages | ||
| Line 7: | Line 40: | ||
| * [[cluster: | * [[cluster: | ||
| - | ==== Hadoop Summary ==== | + | |
cluster/121.txt ยท Last modified: 2013/09/16 15:09 by hmeij
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
