DokuWiki

User Tools

Site Tools

Trace:
cluster:39

Warning: Undefined array key 7 in /usr/share/dokuwiki/inc/html.php on line 1453

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision 		Previous revision
cluster:39 [2008/04/23 16:33]
127.0.0.1 external edit 		cluster:39 [2017/09/29 09:19] (current)
hmeij07
Line 2: Line 2:
 **[[cluster:0|Back]]** **[[cluster:0|Back]]**
  
 +===== Matlab Update =====
  
-Hints on running Matlab jobs using version 2008a. When we ran version 2007a, under scheduler Lava, this page was written up.  We were then using generic integration scripts connecting Matlab to scheduler. We have since upgrade to scheduler LSF.  We will still be using the generic integration for distributed jobs.  However, for parallel jobs, we will be using the lsf integration scripts provide by MathWorks.  So everything in this page still applies but with these changes:+Summer 2017 we converted our Wesleyan Matlab license to a campus wide ''Total Academic Headcount'' license. This implies no more license restrictions, so you can run as many Matlab jobs as you wish using the **matlab2017b** binary. At this time I see no need to license the Distributed Computation Engine in R2017b.
  
-  * Distributed and Parallel Jobs +We will leave the default **matlab** binary pointing to **matlab2015a** which contains the 16 workers limit of the Distributed Computation Engine.
- +
-=> change the location were the matlab is installed  +
- +
-<code> +
-set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2008a') +
-</code> +
- +
-  * Parallel Jobs +
- +
-=> comment out or delete the lines referring to the generic functions +
- +
-<code> +
-%2007a sched = findResource('scheduler', 'configuration', 'generic') +
-%2007a set(sched, 'Configuration', 'generic') +
-... +
-%2007a set(sched, 'ParallelSubmitFcn', @lsfParallelSubmitFcn) +
-</code> +
- +
-=> point to the LSF scheduler and add following 'bsub' type like parms +
- +
-<code> +
-sched = findResource('scheduler','type','LSF') +
-set(sched, 'SubmitArguments', '-R type==LINUX64') +
-set(sched, 'SubmitArguments', '-q matlab') +
-</code>+
  
  
 + --- //[[hmeij@wesleyan.edu|Henk]] 2017/09/29 09:14//
  
  
Line 87: Line 64:
 sched = findResource('scheduler', 'type', 'generic'); sched = findResource('scheduler', 'type', 'generic');
 set(sched, 'HasSharedFilesystem', true); set(sched, 'HasSharedFilesystem', true);
-set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2007a')+set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2008a')
 set(sched, 'SubmitFcn', @lsfSimpleSubmitFcn)    set(sched, 'SubmitFcn', @lsfSimpleSubmitFcn)   
  
Line 128: Line 105:
 sched = findResource('scheduler', 'type', 'generic'); sched = findResource('scheduler', 'type', 'generic');
 set(sched, 'HasSharedFilesystem', true); set(sched, 'HasSharedFilesystem', true);
-set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2007a')+set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2008a')
 set(sched, 'SubmitFcn', @lsfSimpleSubmitFcn)    set(sched, 'SubmitFcn', @lsfSimpleSubmitFcn)   
  
Line 302: Line 279:
  
  
-==== Parallel Computing batch ====+==== Parallel Computing Batch ====
  
 +  * If you need to submit more arguments to the scheduler, for example direct a worker to a specific machine for memory requirements rather than a random pick, you can do via these commands described at this [[http://www.mathworks.com/access/helpdesk/help/toolbox/distcomp/submitarguments.html|External Link]]
  
   * Ok, submitting in a more batch oriented mode looks like this.    * Ok, submitting in a more batch oriented mode looks like this. 
Line 397: Line 375:
 </code> </code>
  
 +
 +WE ARE CURRENTLY NOT RUNNING 2009A ... IT APPEARS THAT THE 2009A DC VERSION OF MATLAB STILL HAS 2008A UNDER THE HOOD WITH DC v3.3, SO WE FELL BACK TO 2008A.  THE INSTRUCTIONS BELOW ARE FOR WHEN WE UPGRADE IN THE FUTURE.
 +
 +
 +<hi #ffff00>
 +In the new version of Matlab DC 2009, the integration with LSF is complete, so **always** point to 'lsf' as the scheduler.  Also of note is that you should point to the queue matlab, which spans all hosts.</hi>. So:
 +
 +  * In the line //sched = findResource('scheduler', 'type', 'generic'); // replace 'generic' with 'lsf'
 +
 +  * Comment out the line that contains //set = (sched, 'SubmitFcn', @lsfSimpleSubmitFcn');//
 +
 +  * And point to the queue //set(sched, 'SubmitArguments', '-q matlab');//
 +
 +
 +
 +
 +Hints on running Matlab jobs using version 2008a. When we ran version 2007a, under scheduler Lava, this page was written up.  We were then using generic integration scripts connecting Matlab to scheduler. We have since upgrade to scheduler LSF.  We will still be using the generic integration for distributed jobs.  However, for parallel jobs, we will be using the lsf integration scripts provide by MathWorks.  So everything in this page still applies but with these changes:
 +
 +  * Distributed and Parallel Jobs
 +
 +=> change the location were the matlab is installed 
 +
 +<code>
 +set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2008a')
 +</code>
 +
 +  * Parallel Jobs
 +
 +=> comment out or delete the lines referring to the generic functions
 +
 +<code>
 +%2007a sched = findResource('scheduler', 'configuration', 'generic')
 +%2007a set(sched, 'Configuration', 'generic')
 +...
 +%2007a set(sched, 'ParallelSubmitFcn', @lsfParallelSubmitFcn)
 +</code>
 +
 +=> point to the LSF scheduler and add following 'bsub' type like parms
 +
 +<code>
 +sched = findResource('scheduler','type','LSF')
 +set(sched, 'SubmitArguments', '-R type==LINUX64')
 +set(sched, 'SubmitArguments', '-q matlab')
 +</code>
  
 \\ \\
 **[[cluster:0|Back]]** **[[cluster:0|Back]]**
cluster/39.1208982833.txt.gz · Last modified: 2009/07/01 11:03 (external edit)

Page Tools

Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
CC Attribution-Share Alike 4.0 International Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki