In SImulink, during DDPG training to regulate the CO2 concentration the environment is not simulating. I can see only the variables specified in function is updating.

When ever I am training the DDPG RL agent, I can see that only reference value andd number of occupants is being updated. As its been defined in coding. Apart from that the environemnt (Vehicle HVAC system and Cabin) is not simulating. I can see that temperature, pressure, and other parameters remains constant.

Answer 1

[Emmanouil Tzorakoleftherakis]

Hello,

I would start by taking a look at the output of the agent. If the agent output does not make sense, the environment will not transition to a new state etc.

[Konguvel Rajeswari Subramaniam]

Hi,

Thank you for your reply.

I can see that agent is not generating any output. I will attach the screen shot of the agent outcome.