Running two functions in parallel of which one would like to use parfor

2 visualizaciones (últimos 30 días)
Challenge: I repetitively read external data needing 250ms per data set. Then I process the data which takes 300ms on 20 phyical cores.
Now, it would of course be good to read data, and while the processing is in action, already read the next set. But, since I already use "parfor" in data processing, I cannot put both functions (reading and processing) in an smpd environment.
Ok, I think I know the long answer to this question: Put everything in smpd, send one of the workers in the data reading function and 20 of them to data processing and "rebuild" parfor functionality (means distribute loop indices and accumulate results on a master worker).
Maybe there is a shortcut I don't know? This problem should not be so unusual that there is no chance for an easy solution
Thanks,
Michael

Respuesta aceptada

Mohammad Abouali
Mohammad Abouali el 23 de Dic. de 2015
Use non-blocking parfeval().

Más respuestas (0)

Categorías

Más información sobre Parallel for-Loops (parfor) en Help Center y File Exchange.

Etiquetas

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by