The test Images is far from enough, if you don’t have enough images for training, I would suggest you using pretrained model from torchvision and finetune.
http://pytorch.org/docs/master/torchvision/models.html