albanD:

But from what I remember, the gist is that the reward should be the expected reward by following the probs that you computed.


Well, logically, if you think about it. The neural network outputs data, I take the maximum value. But if I use action = m.sample (), then I get the action is not clear by what distribution.