Hi,
If you pass it as a tensor that do not require gradients to the forward and, it with ctx.save_for_backward and get it back with ctx.saved_tensors in the backward, then it should just keep a reference to it, not duplicate it.
Could you share the code of a minimal Function that would reproduce this behavior?