ALBERT how to obtain the embedding matrix?
## ❓ Questions & Help

Hi, I'm trying to use ALBERT for word embedding with this library.
ALBERT's doc mentioned an embedding size of 128 independently of the model version (base, large, ...) while the hidden_size changes.
I would like to obtain the 128 word (or subword) vectors but the model gives me only the output of the last hidden state (so for xxlarge a 4096 tensor for each token).

What am I doing wrong?
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
