Bert, NLP.
combine some of the layer vectors…but which layer or combination of layers provides the best representation? Let’s create word vectors two ways. First, let’s concatenate the last four layers, giving us a single word vector per token. Each vector will have length 4 x 768 = 3,072. # Stores the token