Transformers, Pytorch, Machine Learning, Deep Dives, Data Science.
of ChatGPT stands for Transformer. The architecture was first coined in 2017 by Google researchers in the “Attention is All you need” paper. It is quite revolutionary as previous models used to do sequence-to-sequence learning (machine translation, speech-to-text, etc…) relied on RNNs which were