Problem with parallel computation on cluster

1 visualización (últimos 30 días)
Tristan Potter
Tristan Potter el 4 de Dic. de 2019
Hi everyone,
I'm running a parallelized minimization routine in MATLAB on a cluster and continue to encounter a problem that I don't understand: Seemingly randomly, MATLAB fails to engage all of the (8) cores that I request.
In the successful cases, MATLAB reports at the beginning of execution: "Starting parallel pool (parpool) using the 'local' profile ...connected to 8 workers."
In the unsuccessful cases, MATLAB reports: "Starting parallel pool (parpool) using the 'local' profile ..." but there is no report of 8 workers being connected. And in these cases, the resource usage reports and runtime suggest that MATLAB is only utilizing a single core.
Sometimes, this problem is alleviated by preceding submission of the job by the command: rm -rf ~/.matlab/local_cluster_jobs
Recently, however, that has failed to work, and I am perplexed. Any help understanding the problem would be great. Thanks!

Respuestas (0)

Categorías

Más información sobre Clusters and Clouds en Help Center y File Exchange.

Etiquetas

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by