How to get the matrix that is used to combine output from multiple number of attention heads?
Hello,

if I am understanding transformers correctly, right before the feedforward layer, output of individual attention head are concatenated and multiplied by a matrix **H**, so that the outputs from the multiple number of heads will be combined into one output which will then be an input to the subsequent feedforward block within the same layer.

Is there any way that I can retrieve the matrix **H** from the Hugging Face GPT2 model?

Thank you,
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
