Solved by ptrblck in post #2 
              
              
                You are using classify_img, which uses TRANSFORM_IMG, which uses random transformations: 
TRANSFORM_IMG = transforms.Compose([
                                    transforms.RandomResizedCrop(size=256, scale=(0.8, 1.0)),
                                    transforms.RandomRotation(degrees=15),
    …