Your dataset is very small and makes it quite easy to overfit. Maybe the suggested advice to use data augmentation would help in your case?
Also it seems as if you’re defining  nn.Dropout(p=0.5) but not using it during forward?