Thanks! So it seems like the input is literally the token ID and its just like an ordinal encoding scheme where you just represent words as id. Was confused because of this because other methods use things like bag of words, one hot encoding e.t.c. do you know of any benefits of representing words as ids? if not, thanks again!