Hugging Face's logo

MaziyarPanahi
/
SmolLM-360M-Instruct-GGUF

Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Community
1
MaziyarPanahi commited on
Commit
3b3fc49
·
verified ·
1 Parent(s): 916b2cb

cb42ad1bd0a6c9bc6c48733848e630939083901b2cab71fb70230c75e089b4b6

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. SmolLM-360M-Instruct.Q6_K.gguf +3 -0
  3. SmolLM-360M-Instruct.Q8_0.gguf +3 -0
  4. SmolLM-360M-Instruct.fp16.gguf +3 -0
.gitattributes CHANGED
@@ -42,3 +42,6 @@ SmolLM-360M-Instruct.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
  SmolLM-360M-Instruct.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
  SmolLM-360M-Instruct.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
44
  SmolLM-360M-Instruct.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
42
  SmolLM-360M-Instruct.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
  SmolLM-360M-Instruct.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
44
  SmolLM-360M-Instruct.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ SmolLM-360M-Instruct.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
46
+ SmolLM-360M-Instruct.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
47
+ SmolLM-360M-Instruct.fp16.gguf filter=lfs diff=lfs merge=lfs -text
SmolLM-360M-Instruct.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea15d9ab3abcd3f06fd008e9c3b55afa4fca72b9230ce19196d11190f7e40bb0
3
+ size 367358624
SmolLM-360M-Instruct.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:174c1c45b12da04dce7d81fc2681ca1ffae0f1e21a7607363511be92ed771cec
3
+ size 386405024
SmolLM-360M-Instruct.fp16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:268d168368f95061a61ad1ab5ba4039565d003a18bb7c647b0639ecca4833b06
3
+ size 725553600