Differences

This shows you the differences between two versions of the page.

--- cluster:92 [2010/12/20 20:37] – hmeij
+++ cluster:92 [2011/03/30 15:59] (current) – hmeij
@@ Line 3: / Line 3: @@
 a "bottom's up" page of tasks performed while inching towards deployment.
+Closing this page.
+===== Update (03/28/2011) =====
+greentail's home directories are now served up on petaltail/swallowtail cluster ... this means your home directory is the same across the Dell and HP clusters (minus one host, will work on that tomorrow as well as cluster sharptail).
+Weekly refresh of your old home dirs to your new home dirs will continue for another week from now to catch any files created.  If you manually need to retrieve files from your old home dir you can do so on host greentail at /oldhomes.
+Backup to TSM/Tivoli has been stopped.  All backup and restores now rely on the snapshot repository on host greentail at /snapshots/repository ...
+-Henk
+===== Update (07/02/2011) =====
+Hi All,
+Matlab and Stata (and queues) have been moved to new greentail cluster. My last "todo", buying new Intel compilers for cluster greentail, is within sight.  The usage of the new HP cluster has been, well, rather low.  Not sure why.  I am thus proposing a meeting for Q&As about our entire HPC environment detailed at [[https://dokuwiki.wesleyan.edu/doku.php?id=cluster:95|https://dokuwiki.wesleyan.edu/doku.php?id=cluster:95]]
+The following next steps we can also discuss at the meeting:
+- virtual tape backups of the old home dirs on petaltail will be halted at some time
+- hence we will rely on disk2disk backups on greentail (new home dirs with weekly refresh from petaltail)
+- nodes may disappear on petaltail/sharptail as I experiment with ingestion into greentail
+If you can all email me directly with potentially good meeting times, i'll try to maximize attendance.
+-Henk
 ===== HP Towards Deployment =====
+  * buy new intel compilers and cmkl?
+    * in progress 02/24/2011
   * job 100,000 mile stone (and 1,000,000 on swallowtail)
+    * almost 02/24/2011!
-  * setup scripts to log usage, gather stats
+  * wait for monthly snapshots to start rotating before disabling 5 TB tivoli
+    * in progress, doing monthlies after sunday weeklies until populated 02/24/2011
-  * migrate commercial software to greentail?  matlab, stata
+  * 07/02/2011 Done, no changes for matlab, stata users.
-  * buy new intel compilers and cmkl?
+  * 15/01/2011 Done: setup scripts to log usage, gather stats
-  * run some test jobs via scheduler, some benchmarks
+  * 14/01/2011 Done: benchmark some applications, test mpi flavors
-  * install Lava (no SGE installed, so lets do this first)
+  * 10/01/2011 Done: run some test jobs via scheduler, some benchmarks
-  * rsync over rest of home directories over break (started 20dec10)
+  * 07/01/2010 install Lava (no SGE installed, so lets do this first)
+    * lava is up on greentail and n1
+    * need to propagate golden image, done
+  * 05/01/2011 rsync over rest of home directories over break (started 20dec10)
     * without the '--delete' and '--delete-exclude' flags
     * added '--stats' flag
+    * added -the -k and -l flags for rsync when using /home/? where ? is a through z
+    *  07/01/2011 almost there, /home to /snapshots is working
+    * need to figure out mounts for user access at /snapshots/repository, done
+    * set up weekply pulling from /oldhome to /home, in progress
   * 12/18/2010 set up rsnapshot
     * exercising hourly, daily, weekly, monthly
-    * monitor how long this takes
   * 12/15/2010 copy /share/apps across, see below