I might be understanding something wrong but I also want to see how the weights and bias of Batchnorm are initialised. When looking at the source code I see the following in the __init__ for the default parameters:
            self.weight = Parameter(torch.Tensor(num_features))
            self.bias = Parameter(torch.Tensor(num_features))

However when I run torch.Tensor(num_features) on my computer I get some numbers <0 and  >1. Even some nan for num_features. Am I doing something wrong or missing something?
Thanks!