Internal problem happened during training DDPGagent

I use the TruckSim2016 S function as the environment of my DDPG agent. Everything is ok in episode1. However, it seems that some errors occurred between episode1 and episode2. After Episode 1, matlab crash reporter showed and shut down. I wonder that the problem is caused by restart or reset. Besides, my Environment Reset Function is empty, that is, I don't reset anything after an episode. Can anyone help me, please

[Rik]

(removed from spam filter)

Answer 1

[Drew Davis]

By default the Simulink environment leverages Simulink fast-restart feature. Some work needs to be done to ensure that the S-functions will work properly in fast-restart. See this doc page for more info.

Assuming you can't (or don't want to modify the S-function :) ), set the UseFastRestart property to off in the environment object

env.UseFastRestart = "off";

Please comment if this does not resolve your issue.

Drew

[Drew Davis]

Another useful link for model operating point compliance with s-functions to support fast restart

[Sam Chen]

It works! Thank you very much.