In that case, you can store them in the parent scope to access them later.
Or use a hook on the Tensors directly as t.register_hook() to have a function that is called once the gradient for that Tensor is computed.