Warning: Undefined array key "DOKU_PREFS" in /usr/share/dokuwiki/inc/common.php on line 2082
cluster:39 [DokuWiki]

User Tools

Site Tools


cluster:39

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Last revision Both sides next revision
cluster:39 [2009/07/02 09:18]
hmeij
cluster:39 [2010/04/27 14:52]
hmeij
Line 3: Line 3:
  
  
-<hi #ffff00> 
-Update:  in the new version of Matlab DC, the integration with LSF is complete, so **always** point to 'lsf' as the scheduler.  Also of note is that you should point to the queue matlab, which spans all hosts.</hi>. So: 
  
-  * In the line //sched = findResource('scheduler', 'type', 'generic'); // replace 'generic' with 'lsf' 
- 
-  * Comment out the line that contains //set = (sched, 'SubmitFcn', @lsfSimpleSubmitFcn');// 
- 
-  * And point to the queue //set(sched, 'SubmitArguments', '-q matlab');// 
- 
- --- //[[hmeij@wesleyan.edu|Meij, Henk]] 2009/07/02 09:14// 
- 
- 
-Hints on running Matlab jobs using version 2008a. When we ran version 2007a, under scheduler Lava, this page was written up.  We were then using generic integration scripts connecting Matlab to scheduler. We have since upgrade to scheduler LSF.  We will still be using the generic integration for distributed jobs.  However, for parallel jobs, we will be using the lsf integration scripts provide by MathWorks.  So everything in this page still applies but with these changes: 
- 
-  * Distributed and Parallel Jobs 
- 
-=> change the location were the matlab is installed  
- 
-<code> 
-set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2008a') 
-</code> 
- 
-  * Parallel Jobs 
- 
-=> comment out or delete the lines referring to the generic functions 
- 
-<code> 
-%2007a sched = findResource('scheduler', 'configuration', 'generic') 
-%2007a set(sched, 'Configuration', 'generic') 
-... 
-%2007a set(sched, 'ParallelSubmitFcn', @lsfParallelSubmitFcn) 
-</code> 
- 
-=> point to the LSF scheduler and add following 'bsub' type like parms 
- 
-<code> 
-sched = findResource('scheduler','type','LSF') 
-set(sched, 'SubmitArguments', '-R type==LINUX64') 
-set(sched, 'SubmitArguments', '-q matlab') 
-</code> 
  
  
Line 99: Line 60:
 sched = findResource('scheduler', 'type', 'generic'); sched = findResource('scheduler', 'type', 'generic');
 set(sched, 'HasSharedFilesystem', true); set(sched, 'HasSharedFilesystem', true);
-set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2007a')+set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2008a')
 set(sched, 'SubmitFcn', @lsfSimpleSubmitFcn)    set(sched, 'SubmitFcn', @lsfSimpleSubmitFcn)   
  
Line 140: Line 101:
 sched = findResource('scheduler', 'type', 'generic'); sched = findResource('scheduler', 'type', 'generic');
 set(sched, 'HasSharedFilesystem', true); set(sched, 'HasSharedFilesystem', true);
-set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2007a')+set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2008a')
 set(sched, 'SubmitFcn', @lsfSimpleSubmitFcn)    set(sched, 'SubmitFcn', @lsfSimpleSubmitFcn)   
  
Line 314: Line 275:
  
  
-==== Parallel Computing batch ====+==== Parallel Computing Batch ====
  
 +  * If you need to submit more arguments to the scheduler, for example direct a worker to a specific machine for memory requirements rather than a random pick, you can do via these commands described at this [[http://www.mathworks.com/access/helpdesk/help/toolbox/distcomp/submitarguments.html|External Link]]
  
   * Ok, submitting in a more batch oriented mode looks like this.    * Ok, submitting in a more batch oriented mode looks like this. 
Line 409: Line 371:
 </code> </code>
  
 +
 +WE ARE CURRENTLY NOT RUNNING 2009A ... IT APPEARS THAT THE 2009A DC VERSION OF MATLAB STILL HAS 2008A UNDER THE HOOD WITH DC v3.3, SO WE FELL BACK TO 2008A.  THE INSTRUCTIONS BELOW ARE FOR WHEN WE UPGRADE IN THE FUTURE.
 +
 +
 +<hi #ffff00>
 +In the new version of Matlab DC 2009, the integration with LSF is complete, so **always** point to 'lsf' as the scheduler.  Also of note is that you should point to the queue matlab, which spans all hosts.</hi>. So:
 +
 +  * In the line //sched = findResource('scheduler', 'type', 'generic'); // replace 'generic' with 'lsf'
 +
 +  * Comment out the line that contains //set = (sched, 'SubmitFcn', @lsfSimpleSubmitFcn');//
 +
 +  * And point to the queue //set(sched, 'SubmitArguments', '-q matlab');//
 +
 +
 +
 +
 +Hints on running Matlab jobs using version 2008a. When we ran version 2007a, under scheduler Lava, this page was written up.  We were then using generic integration scripts connecting Matlab to scheduler. We have since upgrade to scheduler LSF.  We will still be using the generic integration for distributed jobs.  However, for parallel jobs, we will be using the lsf integration scripts provide by MathWorks.  So everything in this page still applies but with these changes:
 +
 +  * Distributed and Parallel Jobs
 +
 +=> change the location were the matlab is installed 
 +
 +<code>
 +set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2008a')
 +</code>
 +
 +  * Parallel Jobs
 +
 +=> comment out or delete the lines referring to the generic functions
 +
 +<code>
 +%2007a sched = findResource('scheduler', 'configuration', 'generic')
 +%2007a set(sched, 'Configuration', 'generic')
 +...
 +%2007a set(sched, 'ParallelSubmitFcn', @lsfParallelSubmitFcn)
 +</code>
 +
 +=> point to the LSF scheduler and add following 'bsub' type like parms
 +
 +<code>
 +sched = findResource('scheduler','type','LSF')
 +set(sched, 'SubmitArguments', '-R type==LINUX64')
 +set(sched, 'SubmitArguments', '-q matlab')
 +</code>
  
 \\ \\
 **[[cluster:0|Back]]** **[[cluster:0|Back]]**
cluster/39.txt ยท Last modified: 2017/09/29 09:19 by hmeij07