@alexis-jacq I am coming a bit late in the discussion and actually I would like to know why do you need to detach the state from the graph when you take directly Q as a loss?
DDPG is a bit complicated to understand regarding the gradient update of the actor.