Hi,
In all the code torch.log has softmax layer previous to it.
So I am assuming it will have valid inputs.
Also the value function should range between -10 and 20.therefore loss function should also not explode.
But let me try to confirm whether loss is exploding.
Besides I am unable to get why convolution output is nan for valid inputs.Does it have weighs that are updated?
Also is it ok the way how I am sampling action?
Sometimes it is giving error that it has been asked to sample from negative probability? But I am using softmax to calculate probs. Let me try to reproduce the error and check what are the probability values.