Hi,
Thanks for the reply.
I just tried out register_full_backward_hook(), and it looks like only the pre and post activation gradients are accessed. Thanks for your answer  :
On a side note:
I assume, for the gradients of model parameters, there is no need to access it mid-backprop? I guess these could be accessed by iterating over model.named_parameters() after the full backward pass.