How to reduce embedding size from 768?
I am using simple_lm_finetuning.py to fine tune BERT. However I want to get smaller embeddings. Where can I change this?
You need to retrain it with your embeddings replacing `BertModel.embeddings.word_embeddings` and the model size being your embeddings size.<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
