Gpt, Transformer, Pytorch, Multi Head Attention, Decoder.
plt.title("Output Distribution over Vocabulary") plt.show() You can see your model. MultiLayerTransformerDecoder( (embedding): Embedding(10000, 2048) (pos_encoder): PositionalEncoding( (dropout): Dropout(p=0.1, inplace=False) ) (transformer_blocks): ModuleList( (0-19): 20 x DecoderBlock(