Thanks Chris,
The task I am training is given the context I am training the middle word (missing word). This I am doing on the summaries I scraped for a manga series. The end goal is to visualise the embeddings and look up a character and find similar words used for the character. I was using accuracy as a proxy of how good the model is in terms of generating the embeddings. The other way is to measure loss.
After training for 100 epochs I find that the loss is stagnating.
Also I generated embeddings and tried to visualise the words and find smilar words for few characters in the series. The results I found was suboptimal. I thought I am missing something in my model.