Thank you again Thomas.
Just to confirm I haven’t misunderstood, your PartiallyFixedEmbedding solution relies on the word to id mapping being done in such a way that the out of vocab words are the higher id values? This is also the case for my proposed solution…unfortunately it’s not clear to me how to efficiently do this without digging into the underlying tokenization i.e. as we map a word to an id (usually based on count) we need to check if it has an embedding or not then modify this. I have a few thoughts about how to do this and will revert back if I get a solution.
I do find it a little puzzling that there is no facility to only partially train an embedding matrix (which is generally huge)…it’s basically all or nothing.
Thanks,
Mark