hi, thank you for your explanation.
I have checked the logic of the model and I am sure that it is fine. Now that the forward pass works well, I can not figure out why there is something wrong with the backward pass.
The error occurs in the file reducer.cpp. I have no idea how to debug the C++ file when I was running a Python program.
Could you give me some advice on how to debug and checking the param/grad device for loss.backward() during the training loop?
Thank you very much!