torch.Tensor won’t initialize all values with 0s, but will use uninitialized memory, so you should manually initialize it.
To set all values to a constant value, you could use several approaches:
t = torch.empty(64, 3, 28, 28).fill_(32.)
t = torch.ones(64, 3, 28, 28) * 32.