Hi there, I’m trying to reimplement SCAN 2.
My code is here 1.
The loss didn’t change after each iteration. When I called backward to calculate the gradients, it happened to be NaN.
158368423_148142287084217_1092993663152853717_n744×249 13.6 KB
Do you guys have any suggestions?