I understand that you are trying to pause the training to check the performance and then resume it once the progress seems satisfactory.
One way is to get a live script of the training process using “Generate code” option after using “nnstart” command at the command line in the latest version of MATLAB (R2022a) so that one can pause the simulation in-between the training which pauses the training.
But even then, when the training is paused, the performance plots does not show up unless the training is finished.
To get the flexibility like increasing/decreasing the number of hidden layers, or set the number of epochs, etc please go through the 'Deep Learning Onramp' which can help you to get started with deep neural networks in MATLAB.
- “Define Network Architecture”
- “Specify training options”
- “Train Network”
which provides the flexibility along with the following GUI while training.