The user case is different, as each image contains two labels! But I agree that a good starting point would be checking out the insides of ImageFolder 
@rjrohit996 how are the labels specified? Generally the labels are built from the folder structure, but in your case you have two labels. Where do they come from?