Solved by ptrblck in post #2 
              
              
                If each epoch takes 30 minutes, it seems the GPU might not be used. 
Could you run this dummy code snippet and report the time for each epoch you are seeing: 
model = models.vgg16().to('cuda')
dataset = datasets.CIFAR10(
    root=ROOT,
    transform=transforms.Compose([
        transforms.ToTensor()…