Both the GPU’s are different in architectures. However, RTX 30 series are latest and performs better than Tesla in terms of TFLOPS. But, i would suggest you to Change the variables in dataloader namely pin_memory = True, num_workers = (vary according to your system specifications). For instance if you have 20 threads processor do not use all the processors to load your data to GPU. Try to find that sweet spot of num_workers according to your system specifications.