Solved by lewtun in post #2 
              
              
                Hi @carlosaguayo thanks for your question and I’m glad you’re enjoying the book  
In general, we need a way to represent the sequence of embeddings as as single vector and there are several “pooling” techniques that people use in the literature: 

[CLS] pooling: just take the embedding of the [CLS] …