You can call .reset_parameters() directly:
bn = nn.BatchNorm2d(3)
bn(torch.randn(10, 3, 24, 24))
print(bn.running_mean)
print(bn.running_var)
bn.reset_parameters()
print(bn.running_mean)
print(bn.running_var)