Bert, NLP.
hidden_states has four dimensions, in the following order: The layer number (13 layers) : 13 because the first element is the input embeddings, the rest is the outputs of each of BERT’s 12 layers. The batch number (1 sentence) The word / token number (22 tokens in our sentence) The hidden unit /