Solved by Vasiliy_Kuznetsov in post #8 
              
              
                Here is a high level of the differences: 
# fp32
# torchvision.models.inception_v3(pretrained=False, aux_logits=False)
# state_dict keys of Conv2d_1a_3x3
# conv
Conv2d_1a_3x3.conv.weight           
# bn
Conv2d_1a_3x3.bn.weight             
Conv2d_1a_3x3.bn.bias               
Conv2d_1a_3x3.bn.runnin…