Seems like a wonderful idea @vinid!
Would be great to benchmark it against the multilingual version produced by the SentenceBERT team (demo notebook here 6, docs here 3) since they were obtaining impressive performances using their multilingual distillation process!