Deep Learning, Artificial Intelligence, Neural Networks, Word Prediction, Language Model.
Brown corpus dataset is used. The Brown corpus consists of 1,181,041 words from various American English documents. The corpus was divided in train (800,000 words), validation (200,000 words), and test (the remaining 180,000 words) sets. The vocabulary was truncated by mapping all “rare” words