I tried some experiments and discovered that
All models in pytorch works will with same data and training steps and any configurations except resnet model either my implementation or the pytorch implementation
I tried to remove normalizing transformation, freezing batch norm layer,used sgd or adam optimizer, and use lower leaning rate 0.0000001
Nothing work
Is pytorch has problem with resnet architecture