Machine Learning, AI, NLP, Programming, Deep Dives.
a bit blurry but it’s useful to understand that different transformer models were originally built for different tasks. A decoder model takes in a smaller input and outputs a larger text. GPT, which introduced impressive text generation back when, is a decoder model. While larger language models