Were you able to get the correct results out of the model? Because as it seems that the targets are always modified with simple forward pass. Check this . 12 If possible can you tell me am I doing something wrong or is it a bug? You can comment on that post. Please excuse me for any mistakes. I am new to this.