Hugging Face's logo

Lewdiculous
/
Nina-v2-7B-GGUF-IQ-Imatrix

GGUF
mistral
roleplay
sillytavern
Inference Endpoints
conversational
Model card Files Community
1
Lewdiculous commited on
Commit
07129d0
•
1 Parent(s): 140fd32

Upload 4 files

Browse files
Files changed (5) hide show
  1. .gitattributes +4 -0
  2. Nina-v2-7B-IQ4_XS-imat.gguf +3 -0
  3. Nina-v2-7B-Q5_K_M-imat.gguf +3 -0
  4. Nina-v2-7B-Q5_K_S-imat.gguf +3 -0
  5. Nina-v2-7B-Q6_K-imat.gguf +3 -0
.gitattributes CHANGED
@@ -37,3 +37,7 @@ Nina-v2-7B-F16.gguf filter=lfs diff=lfs merge=lfs -text
37
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
38
  Nina-v2-7B-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
  Nina-v2-7B-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
37
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
38
  Nina-v2-7B-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
  Nina-v2-7B-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Nina-v2-7B-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Nina-v2-7B-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Nina-v2-7B-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Nina-v2-7B-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
Nina-v2-7B-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79b245c74ae6a977c6c539317672a5172172b64e898cdb737407f2d3e6f76904
3
+ size 3907688448
Nina-v2-7B-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9388ae7ee502e5f48bfa980f004c14df969e77a091beb99de9ea9a3089068de4
3
+ size 5131409408
Nina-v2-7B-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:daff4b80326491178ffea01589f60a1d878d4cb60c2921d709df141c78f7b182
3
+ size 4997715968
Nina-v2-7B-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e5532f114635d6c56e314a7aad6b40e1fcb13951eefc3325e1227ab243715d5
3
+ size 5942065152