Exactly same performance with pin_memory=False In fact, I have the same problem with the model we are building at work, which is a massive variational autoencoder with image resolution of 1024x1024. The setup on that machine is Threadripper 2950X and 2x TRX2080Ti.