Mix action channels are not supported in DDPG

5 visualizaciones (últimos 30 días)
Sania Gul
Sania Gul el 18 de Sept. de 2024
Comentada: Sania Gul el 18 de Sept. de 2024
My action space is mixed. Except one, all variables are continuous. So, I have defined the action apace as shown in the code below for a DDPG agent. But I get the error as shown in the attached image.
actInfoCont = rlNumericSpec([255 1],"UpperLimit",1,"LowerLimit",0); % (0 to 1 probabilistic mask)
actInfoDIsc = rlFiniteSetSpec([0 3.141592654]);
actInfo = [actInfoCont actInfoDIsc];

Respuesta aceptada

Ayush Aniket
Ayush Aniket el 18 de Sept. de 2024
Editada: Ayush Aniket el 18 de Sept. de 2024
Hi Sania,
Currently, Reinforcement Learning Toolbox does not support mixed action spaces. As an alternative you could consider training two agents, one for the continuous action and another for the discrete. Refer to the following MATLAB Answer: https://www.mathworks.com/matlabcentral/answers/2015776-reinforcement-learning-agent-for-mixed-action-space

Más respuestas (0)

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by