User Tools

Site Tools


cluster:39

Warning: Undefined array key -1 in /usr/share/dokuwiki/inc/html.php on line 1458

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
cluster:39 [2009/07/01 11:03]
hmeij
cluster:39 [2017/09/29 09:19] (current)
hmeij07
Line 1: Line 1:
 \\ \\
 **[[cluster:0|Back]]** **[[cluster:0|Back]]**
-<hi #ffff00> 
-Update:  in the new version of Matlab the integration with LSF is complete, so **always** point to 'lsf' as the scheduler.  Also of note is that you should point to the queue matlab, which spans all hosts.</hi> 
  
- --- //[[hmeij@wesleyan.edu|Meij, Henk]] 2009/07/01 11:01//+===== Matlab Update =====
  
 +Summer 2017 we converted our Wesleyan Matlab license to a campus wide ''Total Academic Headcount'' license. This implies no more license restrictions, so you can run as many Matlab jobs as you wish using the **matlab2017b** binary. At this time I see no need to license the Distributed Computation Engine in R2017b.
  
-Hints on running Matlab jobs using version 2008a. When we ran version 2007a, under scheduler Lava, this page was written up.  We were then using generic integration scripts connecting Matlab to scheduler. We have since upgrade to scheduler LSF.  We will still be using the generic integration for distributed jobs.  However, for parallel jobs, we will be using the lsf integration scripts provide by MathWorks.  So everything in this page still applies but with these changes: +We will leave the default **matlab** binary pointing to **matlab2015a** which contains the 16 workers limit of the Distributed Computation Engine.
- +
-  Distributed and Parallel Jobs +
- +
-=> change the location were the matlab is installed  +
- +
-<code> +
-set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2008a'+
-</code> +
- +
-  Parallel Jobs +
- +
-=> comment out or delete the lines referring to the generic functions +
- +
-<code> +
-%2007a sched = findResource('scheduler', 'configuration', 'generic'+
-%2007a set(sched, 'Configuration', 'generic'+
-... +
-%2007a set(sched, 'ParallelSubmitFcn', @lsfParallelSubmitFcn) +
-</code> +
- +
-=> point to the LSF scheduler and add following 'bsub' type like parms +
- +
-<code> +
-sched = findResource('scheduler','type','LSF'+
-set(sched, 'SubmitArguments', '-R type==LINUX64'+
-set(sched, 'SubmitArguments', '-q matlab'+
-</code>+
  
  
 + --- //[[hmeij@wesleyan.edu|Henk]] 2017/09/29 09:14//
  
  
Line 91: Line 64:
 sched = findResource('scheduler', 'type', 'generic'); sched = findResource('scheduler', 'type', 'generic');
 set(sched, 'HasSharedFilesystem', true); set(sched, 'HasSharedFilesystem', true);
-set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2007a')+set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2008a')
 set(sched, 'SubmitFcn', @lsfSimpleSubmitFcn)    set(sched, 'SubmitFcn', @lsfSimpleSubmitFcn)   
  
Line 132: Line 105:
 sched = findResource('scheduler', 'type', 'generic'); sched = findResource('scheduler', 'type', 'generic');
 set(sched, 'HasSharedFilesystem', true); set(sched, 'HasSharedFilesystem', true);
-set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2007a')+set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2008a')
 set(sched, 'SubmitFcn', @lsfSimpleSubmitFcn)    set(sched, 'SubmitFcn', @lsfSimpleSubmitFcn)   
  
Line 306: Line 279:
  
  
-==== Parallel Computing batch ====+==== Parallel Computing Batch ====
  
 +  * If you need to submit more arguments to the scheduler, for example direct a worker to a specific machine for memory requirements rather than a random pick, you can do via these commands described at this [[http://www.mathworks.com/access/helpdesk/help/toolbox/distcomp/submitarguments.html|External Link]]
  
   * Ok, submitting in a more batch oriented mode looks like this.    * Ok, submitting in a more batch oriented mode looks like this. 
Line 401: Line 375:
 </code> </code>
  
 +
 +WE ARE CURRENTLY NOT RUNNING 2009A ... IT APPEARS THAT THE 2009A DC VERSION OF MATLAB STILL HAS 2008A UNDER THE HOOD WITH DC v3.3, SO WE FELL BACK TO 2008A.  THE INSTRUCTIONS BELOW ARE FOR WHEN WE UPGRADE IN THE FUTURE.
 +
 +
 +<hi #ffff00>
 +In the new version of Matlab DC 2009, the integration with LSF is complete, so **always** point to 'lsf' as the scheduler.  Also of note is that you should point to the queue matlab, which spans all hosts.</hi>. So:
 +
 +  * In the line //sched = findResource('scheduler', 'type', 'generic'); // replace 'generic' with 'lsf'
 +
 +  * Comment out the line that contains //set = (sched, 'SubmitFcn', @lsfSimpleSubmitFcn');//
 +
 +  * And point to the queue //set(sched, 'SubmitArguments', '-q matlab');//
 +
 +
 +
 +
 +Hints on running Matlab jobs using version 2008a. When we ran version 2007a, under scheduler Lava, this page was written up.  We were then using generic integration scripts connecting Matlab to scheduler. We have since upgrade to scheduler LSF.  We will still be using the generic integration for distributed jobs.  However, for parallel jobs, we will be using the lsf integration scripts provide by MathWorks.  So everything in this page still applies but with these changes:
 +
 +  * Distributed and Parallel Jobs
 +
 +=> change the location were the matlab is installed 
 +
 +<code>
 +set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2008a')
 +</code>
 +
 +  * Parallel Jobs
 +
 +=> comment out or delete the lines referring to the generic functions
 +
 +<code>
 +%2007a sched = findResource('scheduler', 'configuration', 'generic')
 +%2007a set(sched, 'Configuration', 'generic')
 +...
 +%2007a set(sched, 'ParallelSubmitFcn', @lsfParallelSubmitFcn)
 +</code>
 +
 +=> point to the LSF scheduler and add following 'bsub' type like parms
 +
 +<code>
 +sched = findResource('scheduler','type','LSF')
 +set(sched, 'SubmitArguments', '-R type==LINUX64')
 +set(sched, 'SubmitArguments', '-q matlab')
 +</code>
  
 \\ \\
 **[[cluster:0|Back]]** **[[cluster:0|Back]]**
cluster/39.1246460631.txt.gz · Last modified: 2009/07/01 11:03 by hmeij