Hi, Are setting a seed somewhere in your code? I’m able to reproduce your issue by adding torch.random.manual_seed(1) at the top of your code and using a learning rate that is too high. The problem during training maybe due to vanishing gradients or an optimizer that is not well initialized.