Bert, NLP.
an alternative method, let’s try creating the word vectors by summing together the last four layers. # Stores the token vectors, with shape [22 x 768] token_vecs_sum = [] # `token_embeddings` is a [22 x 12 x 768] tensor. # For each token in the sentence... for token in token_embeddings: # `token`