For a quick experiment, I would register a foward hook to this particular layer, store the output activation and reuse them in another model outside of this FasterRCNN model.
However, if you want to properly change the workflow, I would recommend to derive a custom model and adapt the forward methods as you want them to be.