Hello!
I have a strange case where my model can do a forward() pass properly, but fails on backward(), with a “Runtime Error: invalid argument 1: the number of sizes provided must be greater or equal to the number of dimensions in the tensor”. I’ve searched and seen that there are many different things that can cause this error, as alluded to in this issue: https://github.com/pytorch/pytorch/issues/3560 44
Generally it seems that this sort of error is “sizes not being correct”, but how can a model run properly in the forwards pass if the sizes aren’t correct? I am at a bit of a loss on how to go about debugging this, does anyone have any tips?