Write a custom Dataset (http://pytorch.org/docs/0.2.0/data.html#torch.utils.data.Dataset 387) and use DataLoader to load it. 
Actually, this may also just work (and is simpler) http://pytorch.org/docs/0.2.0/torchvision/datasets.html#torchvision.datasets.ImageFolder 364