Gpt, Transformer, Pytorch, Multi Head Attention, Decoder.
architecture on which the LLM Models are developed and some are developing on it. Encoder-Only Transformers: Encoder-only transformers are a specialized variant of the transformer architecture that focuses solely on the task of understanding and encoding input sequences. They are neural networks