You could add some regularization like Dropout or weight decay. Did data augmentation help at all?
What kind of images do you have?
Did you make sure to preprocess the training and validation images in the same way (normalizing, etc.)?