Machine Learning, Deep Learning, Naturallanguageprocessing.
context (“long-range dependencies”). Sebastian Ruder’s multi-task learning blog post from 2017 is still one of the best. Then there’s also Andrew Ng’s Multi-Task Learning video as part of deeplearning.ai Positional embeddings: as BERT is not a recurrent neural network (it reviews things in