In this http://pytorch.org/docs/master/notes/autograd.html#in-place-operations-on-variables 1.0k document, in place operation is not encouraged. But why did most official example in torchvision (e.g. Resnet) use nn.ReLU(inplace=True).
Also, does
x = self.conv1(x)
x = self.conv2(x)
be considered as in place operation (as they use the same variable name) or not?