The operations with an underscore are inplace operations, i.e. they are working directly on the tensor.
Have a look at the following example:
a = torch.ones(10)
a.mul_(2)
print(a)
b = a.mul(2)
print(a)
print(b)