Use is_matryoshka to denote whether a model is compatible with Matryoshka Representation Learning (MRL).

I come from the vllm community, and recently vllm has added support for Matryoshka Representation Learning (MRL).

Not all embeddings models support MRL. Changing the output dimension for models that do not support MRL will lead to poor results.

We hope that the open source community will adopt the terms “is_matryoshka ” or “matryoshka_dimensions ” to denote whether a model is compatible with Matryoshka Representation Learning (MRL).

config.json

@@ -31,5 +31,6 @@
   "type_vocab_size": 1,
   "unpad_inputs": "true",
   "use_memory_efficient_attention": "true",
+  "is_matryoshka": true,
   "vocab_size": 250048
 }