If you want to update the embedding layer, the gradients would need to be stored and would thus use memory.
It depends on your use case, if you need/want to fine tune these embeddings or use the pretrained ones.