I’m not sure to understand your question completely.
Generally, if you store some forward activation without detaching them from the computation graph (by calling .detach()), you will be able to use these activations in further operations and call .backward on them.
If you just want to inspect some intermediate activations, you should store them as their detached version.