The PyTorch docs say that in-place operations are less efficient in most cases here: http://pytorch.org/docs/master/autograd.html?highlight=no_grad#in-place-operations-on-tensors 7
So is this more efficient:
self.var.div_(input.nelement())

Than this?
self.var = self.var.div(input.nelement())

What in-place operations are more efficient than their non in-place counterparts?