How to get the output in other layers from Bert?
## ❓ Questions & Help
I want to analyze the information that every bert layers contains.  But i found the BertModel only output the sentence embbeding and the CLS embbeding.
<!-- A clear and concise description of the question. -->

Have a look at the [documentation](https://huggingface.co/transformers/model_doc/bert.html#bertmodel), particularly at the point about 'outputs'.  You'll see that when you use `output_hidden_states=True`, you'll get _all_ outputs back, like so:

```python
model = BertModel.from_pretrained('bert-base-uncased', output_hidden_states=True)
```<|||||>> Have a look at the [documentation](https://huggingface.co/transformers/model_doc/bert.html#bertmodel), particularly at the point about 'outputs'. You'll see that when you use `output_hidden_states=True`, you'll get _all_ outputs back, like so:
> 
> ```python
> model = BertModel.from_pretrained('bert-base-uncased', output_hidden_states=True)
> ```

Thank you! 