Differences

This shows you the differences between two versions of the page.

--- cluster:96 [2011/02/09 14:55]
hmeij
+++ cluster:96 [2011/02/24 16:05]
hmeij
@@ Line 11: / Line 11: @@
   * [[http://www.mathworks.com/help/toolbox/distcomp/bqxceii-1.html|Part2]]
-In the examples below the code waits for the results.  Don't do that when submitting jobs, it is just for debug purposes. Change the last 3 lines with this 'get(sched)' and then you exit Matlab interactive session.
+===== Serial 1 =====
+In the example below, the code waits for the results.  Don't do that when submitting jobs, it is just for debugging purposes.
 This old way still works for distributed jobs:
 <code>
 % distributed matlab jobs
-% start 'matlab -nodisplay', issue the command 'newSimple'
+% start 'matlab -nodisplay', issue the command 'Simple'
 % set up the scheduler and matlab worker environment
@@ Line 23: / Line 26: @@
 set(sched, 'HasSharedFilesystem', true);
 set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2010b')
-set(sched, 'SubmitFcn', @distributedSubmitFcn)
+set(sched, 'SubmitFcn', @lsfSimpleSubmitFcn)
 % specify location for worker output
@@ Line 34: / Line 37: @@
 % submit job, wait for jobs to finish, fetch output
 submit(j)
 % WARNING: this may hang if the workers are busy!
 waitForState(j)
 results = getAllOutputArguments(j);
 results{1:5}
+% better to do it like Simple2.m
 </code>
-This old way for parallel jobs does not, not sure why:
+===== Serial 2 =====
+After you submit the job, you can exit matlab.
 <code>
-% start 'matlab -nodisplay', issue the command 'myPJob'
-% set up the scheduler and matlab worker environment
+% distributed matlab jobs
-%2007a sched = findResource('scheduler', 'configuration', 'generic')
+% start 'matlab -nodisplay', issue the command 'Simple2'
-%2007a set(sched, 'Configuration', 'generic')
-sched = findResource('scheduler','type','LSF')
-set(sched, 'SubmitArguments', '-R type==LINUX64')
-set(sched, 'SubmitArguments', '-q matlab')
+% set up the scheduler and matlab worker environment
+sched = findResource('scheduler', 'type', 'generic');
 set(sched, 'HasSharedFilesystem', true);
 set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2010b')
-set(sched, 'SubmitFcn', @lsfParallelSubmitFcn)
+set(sched, 'SubmitFcn', @lsfSimpleSubmitFcn)
 % specify location for worker output
@@ Line 60: / Line 66: @@
 % create job and assign tasks to be done
+j = createJob(sched);
+T = createTask(j, @rand, 1, {{3,3} {3,3} {3,3} {3,3} {3,3}});
-set(pj, 'MaximumNumberOfWorkers', 4)
+% submit job, then exit matlab interactive session
-set(pj, 'MinimumNumberOfWorkers', 4)
+submit(j)
+get(sched)
-% create job and assign tasks to be done
+</code>
-pj = createParallelJob(sched);
-T = createTask(pj, @rand, 1, {{3,3} {3,3} {3,3} {3,3} {3,3}});
+===== Parallel =====
+Slightly different syntax.  Adjust your number of workers values based on some benchmarking, not always do the most workers finish a job in the shortest amount of time.
+<code>
+% parallel matlab jobs
+% start 'matlab -nodisplay', issue the command 'Simplep'
+% set up the scheduler and matlab worker environment
+sched = findResource('scheduler', 'type', 'generic')
+set(sched, 'HasSharedFilesystem', true);
+set(sched, 'ClusterMatlabRoot', '/share/apps/matlab/2010b')
+set(sched, 'ParallelSubmitFcn', @lsfParallelSubmitFcn)
+% specify location for worker output
+set(sched, 'DataLocation', '/home/hmeij/hp/matlab')
+pj = createParallelJob(sched);
+set(pj, 'MaximumNumberOfWorkers', 8)
+set(pj, 'MinimumNumberOfWorkers', 8)
+T = createTask(pj, @rand, 1, {{300,300}});
 % submit job, wait to finish, get status jobs, gather results
 submit(pj)
 get(sched)
 % you can now exit matlab
 % at system prompt type 'bjobs'
 </code>
 \\
 **[[cluster:0|Home]]**

DokuWiki

User Tools

Site Tools

Differences

Page Tools