The only thing I can imagine is you passed something different from a tensor or a nn.module when u instantiated that the 1st time but then you did so when u tried to load.
Can you make a reproducible script?