Hi @MoritzLaurer
Happy to hear that.
I think the issue can be that the max length is not defined for these models. Then, the text is not truncated to 512 word pieces.
Is it possible to set in the trainer the max_length for the input text?
Currently adding these models to the performance metrics. Yes, the flax-sentence-embeddings/all_datasets_v3 (or_v4) work the best.
Also added them here:
  

      huggingface.co
  

  
    

sentence-transformers/all-MiniLM-L12-v1 · Hugging Face 8