Also since the cross-entropy loss is a combo of logsoftmax with Negative logarithmic likelyhood, it won’t really make much sense to add a logit kinda activation for probability score.
So just don’t add any kinda activation at all let’s see how it goes.
Looking forward to here ur feedback