Hi,
Just to ask a quick question. So, the problem with using register_backward_hook is that it doesn’t always return the correct number of gradients? And, in order to fix this (so that register_backward_hook works as intended) is to explicitly write out the forward and backward pass within a custom torch.autograd.function for all layers and matmul within my code so that the correct number of gradients are returned?
Thank you!