I’m not sure to understand your question here.
Keep in mind that not all inplace operations are forbidden, it depends if the tensor is actually needed. For example, you can change inplace the output of a batchnorm layer, but you cannot change inplace the output of a conv layer.
Note as well  that indexing a tensor, concatenating it or splitting it counts as autograd ops, and so may prevent you from changing the tensor inplace (depending on which operation you use).
Whatever happens, the autograd engine will give you the correct gradients for the parameters of your net if it does not raise an error.