Hugging Face's logo

Lewdiculous
/
llama3-8B-aifeifei-1.0-GGUF-IQ-Imatrix

GGUF
Inference Endpoints
imatrix
conversational
Model card Files Community
Lewdiculous commited on
Commit
527feef
•
1 Parent(s): 6ed4560

IQ3_M IQ3_S

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. imatrix.dat +3 -0
  3. llama3-8B-aifeifei-1.0-IQ3_M-imat.gguf +3 -0
  4. llama3-8B-aifeifei-1.0-IQ3_S-imat.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ llama3-8B-aifeifei-1.0-IQ3_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
38
+ llama3-8B-aifeifei-1.0-IQ3_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:87beefcfeb42b195e07caf631291deb6af8a8e75fc8bd6b961badb679fa060ef
3
+ size 4988193
llama3-8B-aifeifei-1.0-IQ3_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a662bc2566d3d5bd0b5f8e5a49b2a53e4557102de7561a7ba6d6767ba20354e
3
+ size 3784823392
llama3-8B-aifeifei-1.0-IQ3_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1818692778ce8ad1b991dd0b59457a880655602e9e00976cf37f58db95bda9d
3
+ size 3682325088