noooop0000 commited on
Commit
ef5ae09
·
verified ·
1 Parent(s): 8e4eaca

Use is_matryoshka to denote whether a model is compatible with Matryoshka Representation Learning (MRL).

Browse files

I come from the vllm community, and recently vllm has added [support for Matryoshka Representation Learning (MRL)](https://github.com/vllm-project/vllm/pull/16331).

Not all embeddings models support MRL. Changing the output dimension for models that do not support MRL will lead to poor results.

We hope that the open source community will adopt the terms “is_matryoshka ” or “matryoshka_dimensions ” to denote whether a model is compatible with Matryoshka Representation Learning (MRL).

Files changed (1) hide show
  1. config.json +1 -0
config.json CHANGED
@@ -22,5 +22,6 @@
22
  "transformers_version": "4.39.3",
23
  "type_vocab_size": 2,
24
  "use_cache": true,
 
25
  "vocab_size": 30522
26
  }
 
22
  "transformers_version": "4.39.3",
23
  "type_vocab_size": 2,
24
  "use_cache": true,
25
+ "is_matryoshka": true,
26
  "vocab_size": 30522
27
  }