Cebtenzzre commited on
Commit
18d1044
1 Parent(s): bd442cb

Compatibility with llama.cpp commit 4524290e8 (#2)

Browse files

- compatiblity with llama.cpp PR 5500 (613d71b94d46d8166744aaf54169c4ded6ab5c3d)
- update README (f4146037336cfa102d70ce3f5c4f4992a038e6f7)
- update README (044c54740261a8f59971db9f2d39f1d1800f9af2)
- update README (67ba71ac19871a1d2e5a2236913d9a1878d270fc)

README.md CHANGED
@@ -15,7 +15,7 @@ tags:
15
  ---
16
 
17
  ***
18
- **Warning**: There is a llama.cpp PR [about to be merged](https://github.com/ggerganov/llama.cpp/pull/5500) that will break compatibility with these files. Keep an eye out for updates to this repo.
19
  ***
20
 
21
  <br/>
@@ -31,7 +31,7 @@ This repo contains llama.cpp-compatible files for [nomic-embed-text-v1.5](https:
31
 
32
  llama.cpp will default to 2048 tokens of context with these files. To use the full 8192 tokens that Nomic Embed is benchmarked on, you will have to choose a context extension method. The original model uses Dynamic NTK-Aware RoPE scaling, but that is not currently available in llama.cpp. A combination of YaRN and linear scaling is an acceptable substitute.
33
 
34
- These files were converted and quantized with llama.cpp commit [594fca3fe](https://github.com/ggerganov/llama.cpp/commit/594fca3fefe27b8e95cfb1656eb0e160ad15a793).
35
 
36
  ## Example `llama.cpp` Command
37
 
@@ -56,7 +56,7 @@ Compute multiple embeddings:
56
 
57
  ## Compatibility
58
 
59
- These files are compatible with llama.cpp as commit [ea9c8e114](https://github.com/ggerganov/llama.cpp/commit/ea9c8e11436ad50719987fa23a289c74b7b40d40) from 2/13/2024.
60
 
61
 
62
  ## Provided Files
 
15
  ---
16
 
17
  ***
18
+ **Note**: For compatiblity with current llama.cpp, please download the files published on 2/15/2024. The files originally published here will fail to load.
19
  ***
20
 
21
  <br/>
 
31
 
32
  llama.cpp will default to 2048 tokens of context with these files. To use the full 8192 tokens that Nomic Embed is benchmarked on, you will have to choose a context extension method. The original model uses Dynamic NTK-Aware RoPE scaling, but that is not currently available in llama.cpp. A combination of YaRN and linear scaling is an acceptable substitute.
33
 
34
+ These files were converted and quantized with llama.cpp [PR 5500](https://github.com/ggerganov/llama.cpp/pull/5500), commit [34aa045de](https://github.com/ggerganov/llama.cpp/pull/5500/commits/34aa045de44271ff7ad42858c75739303b8dc6eb).
35
 
36
  ## Example `llama.cpp` Command
37
 
 
56
 
57
  ## Compatibility
58
 
59
+ These files are compatible with llama.cpp as of commit [4524290e8](https://github.com/ggerganov/llama.cpp/commit/4524290e87b8e107cc2b56e1251751546f4b9051) from 2/15/2024.
60
 
61
 
62
  ## Provided Files
nomic-embed-text-v1.5.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:758227679b93e653eb712c442a16fcdf7d65b15a6eefd6ce8053edd7f42d82a4
3
  size 49361088
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a25579241bc4d68d246fe9e12720dda4ed2f735d18e677a207d01d55591f6907
3
  size 49361088
nomic-embed-text-v1.5.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:139edcebb55846c0c7685b57e25c9758c67f9749a1276a0e886031b9a5bc63ff
3
  size 71593088
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8a1a7423f3634491a1dbd25b1c1934e90aa721ab409e5871fc82e9914d304f21
3
  size 71593088
nomic-embed-text-v1.5.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7140b9170efe9912ec4be3f19d4492050f7be8dc9492ac99a1892bcadca30e9c
3
  size 67169408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd69e0ee67706a0dba210e5cf9051b55615231d6c6197a8b99e717bdd19586a4
3
  size 67169408
nomic-embed-text-v1.5.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5b13eb7c4ed0ec144435f2a47f49acc04ce79c3081b5bc72f5a717da0905c7a9
3
  size 59649152
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5818855f9ca49f00b2b20e2d0dd32d6c7443ec10e2ee7ad657c85b94c473699c
3
  size 59649152
nomic-embed-text-v1.5.Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:01e3f351b0c697201d6901d38b29c9e0affa06c65b040359546c822198aa8f64
3
  size 77802880
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d88b9d579f2dcce28f65de1ad3946453adc281d7b784f2a75afe25158136d44
3
  size 77802880
nomic-embed-text-v1.5.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0e3b6f681b81772c5d29b3b4f6b01c0e71ee64febba159ae182d3a238ccb63fb
3
  size 84106624
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4e388894e09cf3816e8b0896d81d265b55e7a9fff9ab03fe8bf4ef5e11295ac
3
  size 84106624
nomic-embed-text-v1.5.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1acc092631aeb6fd52009c3d2b494fbee5c474ae6275e22bebb7c7d032a71b15
3
  size 78097792
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82c99fedbec31354a2d880c9741be151aef4a20a5712b67f4ee2b088d197b77e
3
  size 78097792
nomic-embed-text-v1.5.Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ca07f2eba2354436bb0be187c6df15a1e754975f1f10f299c6513914d95a0b71
3
  size 94888768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1fc6492a18f92e0662c9704f3cb457458e04f5193a1adf1f5a7304be6468559
3
  size 94888768
nomic-embed-text-v1.5.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5b4795c9f018653bea1626d8f95cf09d0ee0fabcbc14dfdca3f7f9320b352bd3
3
  size 99588928
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0c7930f6c4f6f29b7da5046e3a2c0832aa3f602db3de5760a95f0582dbd3d6e6
3
  size 99588928
nomic-embed-text-v1.5.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c2c341f67341b9093a409710fb578b3f972f3c18ad2c8a0303cacf99529394cd
3
  size 94888768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07782a46f2d36931b7ca28e4b4f1d88aea1fb3e1704a7e5fc6a8be104195bd51
3
  size 94888768
nomic-embed-text-v1.5.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e6a20b714d35f2e2f9a1e418f08826ac9303ac998961c26c8634196658a13867
3
  size 113042528
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b335d0801aded377a055257f7cf046daa48dd0bc2a7c2ea3300168c154b1fd9
3
  size 113042528
nomic-embed-text-v1.5.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:880522894afda99389f2c979aed97c085d0f905eba61ef196307f95245754114
3
  size 146146432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e24342164b3d94991ba9692fdc0dd08e3fd7362e0aacc396a9a5c54a544c3b7
3
  size 146146432
nomic-embed-text-v1.5.f16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e4060a62a157f92458ac71dc610a8909a9ad7ba1f1b4aaa52f121e207c1f9c63
3
  size 274290560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7af6f66802f4df86eda10fe9bbcfc75c39562bed48ef6ace719a251cf1c2fdb
3
  size 274290560
nomic-embed-text-v1.5.f32.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ab33b0bd5d1d3e993c37f9f580c8a17bbb17309997096c5d88308da2c6a4fa63
3
  size 547664768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed3a84b570c5513bfd6bfe0ed4cdc8d5a5de5c6b5029fbbc2822d59fc893c1f8
3
  size 547664768