I managed to solve the problem. It’s the last year softmax causing instability… Got to check gradients… gradients at the last layer becomes really small due to the softmax, switching it off works.
Pushing the latest notebook in a few minutes.