Hey I said 15. You should at least state that in case of 512-dimensional embedding, it will take 40g.



 Xiaoyun_Wu:

this along is already 40g of memory.


Just arbitrarily changing numbers without being saying anything about it is not going to help you better communicate your question and get it solved.
Store it somewhere else, and build the embedding for each sentence. It’s not that hard.