I have some question about normalization technique.
I encounter very weird phonomena doing normalization.
x = torch.rand(10, 10)
print((x - x.mean(dim=1, keepdim=True)).mean(dim=1, keepdim=True))

It doesn’t give zero tensor! The result is very small but it is not zero.
What is going on???