Hi, I am new and learning about transformers.
In alot of BERT tutorials i see the input is just the token id of the words. But surely we need to convert this token ID to a vector representation (it can be one hot encoding, or any initial vector representation for each token ID) so that it can be used by the model?
My question is where can I find this initial vector representation for each token? It seems like theres no guide on this hence why I am asking