noooop0000 commited on
Commit
c8af6c1
·
verified ·
1 Parent(s): 5585c70

Use is_matryoshka to denote whether a model is compatible with Matryoshka Representation Learning (MRL).

Browse files

I come from the vllm community, and recently vllm has added [support for Matryoshka Representation Learning (MRL)](https://github.com/vllm-project/vllm/pull/16331).

Not all embeddings models support MRL. Changing the output dimension for models that do not support MRL will lead to poor results.

We hope that the open source community will adopt the terms “is_matryoshka ” or “matryoshka_dimensions ” to denote whether a model is compatible with Matryoshka Representation Learning (MRL).

Files changed (1) hide show
  1. config.json +1 -0
config.json CHANGED
@@ -24,5 +24,6 @@
24
  "transformers_version": "4.39.3",
25
  "type_vocab_size": 1,
26
  "use_cache": true,
 
27
  "vocab_size": 250002
28
  }
 
24
  "transformers_version": "4.39.3",
25
  "type_vocab_size": 1,
26
  "use_cache": true,
27
+ "is_matryoshka": true,
28
  "vocab_size": 250002
29
  }