Cebtenzzre
commited on
Commit
•
18d1044
1
Parent(s):
bd442cb
Compatibility with llama.cpp commit 4524290e8 (#2)
Browse files- compatiblity with llama.cpp PR 5500 (613d71b94d46d8166744aaf54169c4ded6ab5c3d)
- update README (f4146037336cfa102d70ce3f5c4f4992a038e6f7)
- update README (044c54740261a8f59971db9f2d39f1d1800f9af2)
- update README (67ba71ac19871a1d2e5a2236913d9a1878d270fc)
- README.md +3 -3
- nomic-embed-text-v1.5.Q2_K.gguf +1 -1
- nomic-embed-text-v1.5.Q3_K_L.gguf +1 -1
- nomic-embed-text-v1.5.Q3_K_M.gguf +1 -1
- nomic-embed-text-v1.5.Q3_K_S.gguf +1 -1
- nomic-embed-text-v1.5.Q4_0.gguf +1 -1
- nomic-embed-text-v1.5.Q4_K_M.gguf +1 -1
- nomic-embed-text-v1.5.Q4_K_S.gguf +1 -1
- nomic-embed-text-v1.5.Q5_0.gguf +1 -1
- nomic-embed-text-v1.5.Q5_K_M.gguf +1 -1
- nomic-embed-text-v1.5.Q5_K_S.gguf +1 -1
- nomic-embed-text-v1.5.Q6_K.gguf +1 -1
- nomic-embed-text-v1.5.Q8_0.gguf +1 -1
- nomic-embed-text-v1.5.f16.gguf +1 -1
- nomic-embed-text-v1.5.f32.gguf +1 -1
README.md
CHANGED
@@ -15,7 +15,7 @@ tags:
|
|
15 |
---
|
16 |
|
17 |
***
|
18 |
-
**
|
19 |
***
|
20 |
|
21 |
<br/>
|
@@ -31,7 +31,7 @@ This repo contains llama.cpp-compatible files for [nomic-embed-text-v1.5](https:
|
|
31 |
|
32 |
llama.cpp will default to 2048 tokens of context with these files. To use the full 8192 tokens that Nomic Embed is benchmarked on, you will have to choose a context extension method. The original model uses Dynamic NTK-Aware RoPE scaling, but that is not currently available in llama.cpp. A combination of YaRN and linear scaling is an acceptable substitute.
|
33 |
|
34 |
-
These files were converted and quantized with llama.cpp commit [
|
35 |
|
36 |
## Example `llama.cpp` Command
|
37 |
|
@@ -56,7 +56,7 @@ Compute multiple embeddings:
|
|
56 |
|
57 |
## Compatibility
|
58 |
|
59 |
-
These files are compatible with llama.cpp as commit [
|
60 |
|
61 |
|
62 |
## Provided Files
|
|
|
15 |
---
|
16 |
|
17 |
***
|
18 |
+
**Note**: For compatiblity with current llama.cpp, please download the files published on 2/15/2024. The files originally published here will fail to load.
|
19 |
***
|
20 |
|
21 |
<br/>
|
|
|
31 |
|
32 |
llama.cpp will default to 2048 tokens of context with these files. To use the full 8192 tokens that Nomic Embed is benchmarked on, you will have to choose a context extension method. The original model uses Dynamic NTK-Aware RoPE scaling, but that is not currently available in llama.cpp. A combination of YaRN and linear scaling is an acceptable substitute.
|
33 |
|
34 |
+
These files were converted and quantized with llama.cpp [PR 5500](https://github.com/ggerganov/llama.cpp/pull/5500), commit [34aa045de](https://github.com/ggerganov/llama.cpp/pull/5500/commits/34aa045de44271ff7ad42858c75739303b8dc6eb).
|
35 |
|
36 |
## Example `llama.cpp` Command
|
37 |
|
|
|
56 |
|
57 |
## Compatibility
|
58 |
|
59 |
+
These files are compatible with llama.cpp as of commit [4524290e8](https://github.com/ggerganov/llama.cpp/commit/4524290e87b8e107cc2b56e1251751546f4b9051) from 2/15/2024.
|
60 |
|
61 |
|
62 |
## Provided Files
|
nomic-embed-text-v1.5.Q2_K.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 49361088
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a25579241bc4d68d246fe9e12720dda4ed2f735d18e677a207d01d55591f6907
|
3 |
size 49361088
|
nomic-embed-text-v1.5.Q3_K_L.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 71593088
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8a1a7423f3634491a1dbd25b1c1934e90aa721ab409e5871fc82e9914d304f21
|
3 |
size 71593088
|
nomic-embed-text-v1.5.Q3_K_M.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 67169408
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:dd69e0ee67706a0dba210e5cf9051b55615231d6c6197a8b99e717bdd19586a4
|
3 |
size 67169408
|
nomic-embed-text-v1.5.Q3_K_S.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 59649152
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:5818855f9ca49f00b2b20e2d0dd32d6c7443ec10e2ee7ad657c85b94c473699c
|
3 |
size 59649152
|
nomic-embed-text-v1.5.Q4_0.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 77802880
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8d88b9d579f2dcce28f65de1ad3946453adc281d7b784f2a75afe25158136d44
|
3 |
size 77802880
|
nomic-embed-text-v1.5.Q4_K_M.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 84106624
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d4e388894e09cf3816e8b0896d81d265b55e7a9fff9ab03fe8bf4ef5e11295ac
|
3 |
size 84106624
|
nomic-embed-text-v1.5.Q4_K_S.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 78097792
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:82c99fedbec31354a2d880c9741be151aef4a20a5712b67f4ee2b088d197b77e
|
3 |
size 78097792
|
nomic-embed-text-v1.5.Q5_0.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 94888768
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d1fc6492a18f92e0662c9704f3cb457458e04f5193a1adf1f5a7304be6468559
|
3 |
size 94888768
|
nomic-embed-text-v1.5.Q5_K_M.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 99588928
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0c7930f6c4f6f29b7da5046e3a2c0832aa3f602db3de5760a95f0582dbd3d6e6
|
3 |
size 99588928
|
nomic-embed-text-v1.5.Q5_K_S.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 94888768
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:07782a46f2d36931b7ca28e4b4f1d88aea1fb3e1704a7e5fc6a8be104195bd51
|
3 |
size 94888768
|
nomic-embed-text-v1.5.Q6_K.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 113042528
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9b335d0801aded377a055257f7cf046daa48dd0bc2a7c2ea3300168c154b1fd9
|
3 |
size 113042528
|
nomic-embed-text-v1.5.Q8_0.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 146146432
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3e24342164b3d94991ba9692fdc0dd08e3fd7362e0aacc396a9a5c54a544c3b7
|
3 |
size 146146432
|
nomic-embed-text-v1.5.f16.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 274290560
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f7af6f66802f4df86eda10fe9bbcfc75c39562bed48ef6ace719a251cf1c2fdb
|
3 |
size 274290560
|
nomic-embed-text-v1.5.f32.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 547664768
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ed3a84b570c5513bfd6bfe0ed4cdc8d5a5de5c6b5029fbbc2822d59fc893c1f8
|
3 |
size 547664768
|