|
--- |
|
license: cc-by-nc-4.0 |
|
library_name: gguf |
|
pipeline_tag: sentence-similarity |
|
--- |
|
GGUF quants for https://huggingface.co/Salesforce/SFR-Embedding-Mistral |
|
NOTE: This is a text embedding model used for feature extraction. |
|
|
|
As of Feb. 9, 2024 this model is no. 1 on the MTEB leaderboard. |
|
https://huggingface.co/spaces/mteb/leaderboard |
|
|
|
I have an example of how to use llama.cpp to generate embeddings for sentence similarity on my repo: |
|
https://github.com/dranger003/llama.cpp-dotnet |
|
|
|
| Layers | Context | Template | |
|
| --- | --- | --- | |
|
| <pre>32</pre> | <pre>32768</pre> | <pre>Instruct: {task_description}<br>Query: {query}</pre> | |
