Thank you for your reply.
I have also supervised my CPU usage by top, which never exceed 15%.
I suppose it’s not the main reason, or there is default limit concerning CPU usage in python?
By the way, in my simple example code, I just create random tensors and feed them into ResNet50. Every component is by default pytorch. I can’t imagine it’s due to CPU capacity.