Gpt, Transformer, Pytorch, Multi Head Attention, Decoder.
Encoder-Decoder model is a neural network architecture that is widely used in NLP tasks such as language translation and text summarization . This is the original transformer. The architecture consists of two main components: an encoder and a decoder. The encoder processes the input sequence and