gpt-2 model doesn't output hidden states of all layers.
Using GPT2Model , it seems like it outputs the hidden states of only 1 layer. However, according to code and documentation it is expected to output hidden states features for each layer.

Am I making a mistake?

Thanks for the advise,
Currently not indeed. This option will be in the coming release.<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
