Interesting… Maybe I’m wrong then   You don’t need to do that.
I am pretty sure though that the first op in your model is an inplace one no?
Can you share the beginning of the forward function for net ?