Machine Learning, Deep Learning, Data Science.
the last layer activation function which converts it to a one hot encoded vector representing a word in the vocabulary. A basic RNN. Source: Fastai deep learning course V3 by Jeremy Howard. This allows the network to predict a word at the end of a sequence of any arbitrary length. Retaining the