Machine Learning, Deep Learning, Naturallanguageprocessing.
creates code alongside the paper to reproduce the ideas presented. Transformers are included in Google’s Tensor2Tensor library (see below). Fine tuning & transfer learning: taking a base model and customising it for a specific task with a comparatively small amount of data (hundreds of examples vs