Since this is about learning parallel programming, I'll avoid the suggestion of how to run this serially, as this example will run slower in parallel than serial. Since you're learning about spmd, I'll avoid the parfor solution (which is faster than spmd).
Your spmd issue is that index is not always an integer. I'm going to show three different ways you might try, but they may not all work. Additionally, some might run faster than others. Lastly, I test this with arraySize set to a small prime (say 97) so it's easiest to test (and so that you can ensure it doesn't benefit from an easily divisable number), but you'll see the performance difference when you set it back to 1e7. One other note, you have a typo in your tAray assignment, it should be tArray.
% Original (slightly modified)
tArray = 1:arraySize;
tic;
spmd
startIndex = (labindex -1)/numlabs*arraySize+1;
endIndex = startIndex + arraySize/numlabs-1;
for index = startIndex:endIndex
if tArray(index) > 50
tArray(index) = 50;
end
end
end
toc
The issue here is that the size of the array may not be a multiple of the number of workers (labs). This'll give you the error you see. Second, tArray is first a double, but then becomes a composite array. If the number of workers evenly divided arraySize, you might see something like this
>> whos tArray
Name Size Bytes Class Attributes
tArray 1x4 489 Composite
Where each element of tArray is 1xN and only tArray{3} and tArray{4} are modified (since they represent > 50), but this won't work as is. You'd need to marry all of these together. Messy.
The trick to using for-loops in spmd that needs to automagically divide evenly is to use drange.
% drange with Composite
tArray2 = 1:arraySize;
tic;
spmd
for index = drange(1:arraySize)
if tArray2(index) > 50
tArray2(index) = 50;
end
end
end
toc
Now MATLAB will automatically divide arraySize amongst the workers for you. However, you still have the issue where each tArray2 element is a local variant.
The solution I would look at is using drange and distributed arrays.
% drange with distributed
tArray3 = 1:arraySize;
d_tArray3 = distributed(tArray3);
tic;
spmd
for index = drange(1:arraySize)
if d_tArray3(index) > 50
d_tArray3(index) = 50;
end
end
end
toc
Given a distributed array, you'll see
>> whos d_tArray3
Name Size Bytes Class Attributes
d_tArray3 1x97 525 distributed
This should give you what you want. The issue is speed -- this is quite slow. But then again, I don't think you're trying to find the fastest solution, you're trying to learn about for-loops and spmd.
