you can use backward hooks for:

getting access to the gradient of each of params
checking time taken for computing each layer

http://pytorch.org/docs/master/nn.html?highlight=hook#torch.nn.Module.register_backward_hook 703
http://pytorch.org/docs/master/autograd.html?highlight=hook#torch.autograd.Variable.register_hook 338