F.mse_loss with log probabilities as the model output seems a bit unusual.
What kind of use case are you working on and which values to the targets have?
F.log_softmax is often used with nn.NLLLoss for a multi-class classification use case.