Embedding is similar to a lookup table, so I would assume the more input indices you are passing, the longer it’ll take.


I don’t understand the question. Would you like to load chunks of input indices or the embedding weight matrix in the DataLoader?