I’m not familiar with your approach, but could you explain, how the log probabilities were calculated during training?
I would assume you are using e.g. F.log_softmax to calculate them or are they generated by any other method?