Bert, NLP.
layer vector is 768 values, so `cat_vec` is length 3,072. cat_vec = torch.cat((token[-1], token[-2], token[-3], token[-4]), dim=0) # Use `cat_vec` to represent `token`. token_vecs_cat.append(cat_vec) print ('Shape is: %d x %d' % (len(token_vecs_cat), len(token_vecs_cat[0]))) Shape is: 22 x 3072 As