What architecture does GPT use?
GPT uses the transformer architecture which is a neural network architecture based on the attention mechanism to find global dependencies between the input and the output. To be more specific, GPT belongs to a sub type in the transformer family that is called decoder-only transformer.
<START_INST>What architecture does GPT use?<END_INST><START_CTX><END_CTX><START_A>GPT uses the transformer architecture which is a neural network architecture based on the attention mechanism to find global dependencies between the input and the output. To be more specific, GPT belongs to a sub type in the transformer family that is called decoder-only transformer.<END_A>