Blockquote
Is pytorch has problem with resnet architecture

Nope there are plenty of examples of resnet implemented correctly in PyTorch.
Are you passing network outputs through a softmax before computing the loss with nn.CrossEntropyLoss()? If you read the documentation you’ll notice that CrossEntropyLoss() actually takes logits as input.