Why do I get 13 hidden layers?
## ❓ Questions & Help

<!-- A clear and concise description of the question. -->
Hi,

When I try to type
```
model = TFRobertaForSequenceClassification.from_pretrained('roberta-base', output_hidden_states=True)
hidden_layers = model([input])

```

The length of hidden_layers is 13. But base model should have 12 layers, right?
And if I want to get the last hidden layer, should I use "hidden_layers[-1]"?

Thanks in advance!
The first element is the embedding output.

Yes, use `hidden_layers[-1]`.