I’m still stuck with a validation accuracy around 50%. I have tried approaching people who have done this problem before (using the babi dataset) but none of them have responded. I would like to keep this thread open and try to get some more feedback from the pytorch community. Does anyone have any ideas why my model would evaluate at 50% during validation and 99-100% during training? I have made changes to the pytorch models. I have increased my dropout to 0.5 in many of my submodules. I have tried weight decay. A link to my most recent code is here: https://github.com/radiodee1/awesome-chatbot/blob/master/model/babi_iv.py 2 . Thanks.
EDIT: I found this paper and it helps alot: https://arxiv.org/abs/1603.01417 2