Hi @ProGamerGov, sorry to bring this up. I ran into the same RuntimeError: hook has changed the size which makes me confused about the grad_input tuples. Correct me if I am wrong, the tuple should be (act_grad, weight_grad, bias_grad) right?
So what was wrong with your previous code? Did you solve it? Thank you very much.