Bert, NLP.
len(hidden_states[layer_i][batch_i])) token_i = 0 print ("Number of hidden units:", len(hidden_states[layer_i][batch_i][token_i])) Number of layers: 13 (initial embeddings + 12 BERT layers) Number of batches: 1 Number of tokens: 22 Number of hidden units: 768 Creating word and sentence vectors[aka