User Tools

Site Tools


cluster:92

Warning: Undefined array key -1 in /usr/share/dokuwiki/inc/html.php on line 1458

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
cluster:92 [2010/12/15 11:49]
hmeij
cluster:92 [2011/03/30 11:59] (current)
hmeij
Line 3: Line 3:
  
 a "bottom's up" page of tasks performed while inching towards deployment. a "bottom's up" page of tasks performed while inching towards deployment.
 +
 +
 +Closing this page.
 +
 +===== Update (03/28/2011) =====
 +
 +greentail's home directories are now served up on petaltail/swallowtail cluster ... this means your home directory is the same across the Dell and HP clusters (minus one host, will work on that tomorrow as well as cluster sharptail).
 + 
 +Weekly refresh of your old home dirs to your new home dirs will continue for another week from now to catch any files created.  If you manually need to retrieve files from your old home dir you can do so on host greentail at /oldhomes.
 + 
 +Backup to TSM/Tivoli has been stopped.  All backup and restores now rely on the snapshot repository on host greentail at /snapshots/repository ...
 + 
 +-Henk
 +
 +
 +
 +===== Update (07/02/2011) =====
 +
 +Hi All,
 +
 +Matlab and Stata (and queues) have been moved to new greentail cluster. My last "todo", buying new Intel compilers for cluster greentail, is within sight.  The usage of the new HP cluster has been, well, rather low.  Not sure why.  I am thus proposing a meeting for Q&As about our entire HPC environment detailed at [[https://dokuwiki.wesleyan.edu/doku.php?id=cluster:95|https://dokuwiki.wesleyan.edu/doku.php?id=cluster:95]]
 +
 +The following next steps we can also discuss at the meeting:
 +
 +- virtual tape backups of the old home dirs on petaltail will be halted at some time
 +- hence we will rely on disk2disk backups on greentail (new home dirs with weekly refresh from petaltail)
 +- nodes may disappear on petaltail/sharptail as I experiment with ingestion into greentail
 +
 +If you can all email me directly with potentially good meeting times, i'll try to maximize attendance.
 +
 +-Henk
  
 ===== HP Towards Deployment ===== ===== HP Towards Deployment =====
 +
 +  * buy new intel compilers and cmkl?
 +    * in progress 02/24/2011 
  
   * job 100,000 mile stone (and 1,000,000 on swallowtail)   * job 100,000 mile stone (and 1,000,000 on swallowtail)
 +    * almost 02/24/2011!
  
-  * setup scripts to log usagegather stats+  * wait for monthly snapshots to start rotating before disabling 5 TB tivoli 
 +    * in progressdoing monthlies after sunday weeklies until populated 02/24/2011
  
-  * migrate commercial software to greentail?  matlab, stata+  * 07/02/2011 Done, no changes for matlab, stata users.
  
-  * buy new intel compilers and cmkl?+  * 15/01/2011 Done: setup scripts to log usage, gather stats 
 + 
 +  * 14/01/2011 Done: benchmark some applications, test mpi flavors 
 + 
 +  * 10/01/2011 Done: run some test jobs via scheduler, some benchmarks 
 + 
 +  * 07/01/2010 install Lava (no SGE installed, so lets do this first) 
 +    * lava is up on greentail and n1 
 +    * need to propagate golden image, done
  
-  * set a users meeting 
  
-  * set up rsnapshot+  * 05/01/2011 rsync over rest of home directories over break (started 20dec10) 
 +    * without the '--delete' and '--delete-exclude' flags 
 +    * added '--stats' flag 
 +    * added -the -k and -l flags for rsync when using /home/? where ? is a through z 
 +    *  07/01/2011 almost there, /home to /snapshots is working 
 +    * need to figure out mounts for user access at /snapshots/repository, done 
 +    * set up weekply pulling from /oldhome to /home, in progress
  
-  * run some test jobs via schedulersome benchmarks+  * 12/18/2010 set up rsnapshot 
 +    * exercising hourlydaily, weekly, monthly
  
-  * install Lava (no SGE installed, so lets do this first) 
  
-  * copy /share/apps across+  * 12/15/2010 copy /share/apps across, see below 
 +    * will have to rsync petaltail:/share/apps/src into /share/backups/petaltail (to pull into greentail:/share/apps/src)
  
-  * connect filer3's home directories on /mnt, get a plan together +  * 12/15/20101 connect filer3's home directories on /mnt 
-    * anticipated a deadline for moving off netapp filer3+    * rsync -vac -k /oldhome/username /home (does the tricknote no trailing slashes) 
 +    * i will rsync everything over on date X and redo on date X+Y, overwrite 
 +    * anticipate a deadline for moving off netapp filer3 permanently (dell cluster reconfig dependent)
     * make sure understand the lack of TSM filesystem backups     * make sure understand the lack of TSM filesystem backups
-    *  
  
-  * CMU license expired, turns out to be a demo license.+  * 12/15/2010 CMU license expired, turns out to be a demo license.
     * chasing around hp support for a resolution.     * chasing around hp support for a resolution.
  
cluster/92.1292431768.txt.gz · Last modified: 2010/12/15 11:49 by hmeij