Hugging Face's logo

mradermacher
/
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI-i1-GGUF

Transformers
GGUF
English
German
German
RAG
Retrieval
Question-Answering
Summarization
Reasoning
imatrix
conversational
Model card Files
xet
Community
mradermacher commited on
Commit
36b8392
·
verified ·
1 Parent(s): 7dcd1c2

uploaded from leia

Browse files
Files changed (25) hide show
  1. .gitattributes +24 -0
  2. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ1_M.gguf +3 -0
  3. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ1_S.gguf +3 -0
  4. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ2_M.gguf +3 -0
  5. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ2_S.gguf +3 -0
  6. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ2_XS.gguf +3 -0
  7. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ2_XXS.gguf +3 -0
  8. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ3_M.gguf +3 -0
  9. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ3_S.gguf +3 -0
  10. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ3_XS.gguf +3 -0
  11. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ3_XXS.gguf +3 -0
  12. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ4_NL.gguf +3 -0
  13. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ4_XS.gguf +3 -0
  14. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q2_K.gguf +3 -0
  15. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q2_K_S.gguf +3 -0
  16. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q3_K_L.gguf +3 -0
  17. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q3_K_M.gguf +3 -0
  18. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q3_K_S.gguf +3 -0
  19. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q4_0.gguf +3 -0
  20. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q4_1.gguf +3 -0
  21. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q4_K_M.gguf +3 -0
  22. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q4_K_S.gguf +3 -0
  23. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q5_K_M.gguf +3 -0
  24. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q5_K_S.gguf +3 -0
  25. GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,27 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
47
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
48
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
49
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
50
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
52
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
53
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
54
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
55
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
56
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
59
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
60
+ GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cfb371432ab6cd6b4c7dc806f021138453eb1b3347849cda75ba0447d75ddde6
3
+ size 950143776
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c75b7cad1711501eabd6250ec5b5e9978172b24035543de50a17d67c0646fa2d
3
+ size 881724192
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2de1d8ef6e34de6eb8dbcddf5e7b7b640c109ea68d39b223452704d092995a2d
3
+ size 1349431584
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fdb5dd241db98974912f071a03b76029843f998bdc4289c761f59c968559907f
3
+ size 1258205472
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82b588a915de417d87d0167e41f771159d08938d4fda17668c9a654bdb8fee4b
3
+ size 1164839712
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f884431b215adcd8b349ba2d73fd0e0c59f90d86326ca8f14368e291fd6f5878
3
+ size 1064176416
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2209d4aaab073fda6bc189d85f368b717a02890ad2d95d4bc8d4d1c2e36a6e5f
3
+ size 1775390496
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8756bb78a0418df72935271c35ae539c6feb24564f46854afb05fc087e825346
3
+ size 1681805088
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ef6d7e9e4a6eb1fcc6f63670200f27e284a6d8e30c7af7a0f20698650b3f2d0
3
+ size 1596870432
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fdc9a96684933e3433d69f619a2497c6e612f2df81c294d97d74442c2b4c0113
3
+ size 1475260704
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8ebc6a0a1819a3a6112c98827edf912af13520493030ae5e8749ebabf78ca13
3
+ size 2176183584
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba97c07d47f171f9fb92ea7e0e8014fc1831bdff3bdbded392112113abaffeb1
3
+ size 2059859232
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd13873ed4c6dc8c959c93c4d1ce5a4e83d38540943c1f63c342889c4c142ea2
3
+ size 1446881568
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bef09bee5a124c7c580351b1c246a778f5eed33418da50b2b1375a06d9208ee9
3
+ size 1327343904
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:221a1f1aebb7f17fc124bc40bc0bd70546cdb1e10ac663b8934de4003d9fb2f7
3
+ size 2045136672
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df93a7ed1d6bab0a3556c6682b2557585b68b7a15f689309abfcb915d475128d
3
+ size 1877626656
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f3134a3ceb1ca8690ce513bfb7db4118cc1be400838ba812b867bb6573e190c
3
+ size 1681805088
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:36004fc8ad52535808b136f55cf50062e312ef612cae1ead97b676ba46315a0e
3
+ size 2182475040
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e73088485e0568722d77d17ee7db10dba731075293a68d7af2f64ffe45039cc
3
+ size 2408832288
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7171a6206d01568c09b4b7a2080fa96170dffaa48f1ac355d741af3176bc8184
3
+ size 2318920992
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80d2084dacb86a5ded8bee4735e5858e8ce6a3bf199c902ff9c6b602a962f1e7
3
+ size 2193485088
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:71e366dd79090be991b0ab445323c25734dd99e8c01b43ce8261b842715fa0c3
3
+ size 2715012384
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:573c2a13e10b413ed0932ce0b024e9becd966c2ee530ab91b55cd62b4ccafb45
3
+ size 2641480992
GRAG-PHI-3.5-MINI-4B-MERGED-HESSIAN-AI.i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2346369489b9efbb9a8c678bae22ee15526f3dbd8bfcc0943120647487ed40f6
3
+ size 3135859488