Update README.md
Browse files
README.md
CHANGED
|
@@ -10,6 +10,8 @@ pipeline_tag: text-generation
|
|
| 10 |
tags:
|
| 11 |
- awq
|
| 12 |
- qwen2
|
|
|
|
|
|
|
| 13 |
---
|
| 14 |
|
| 15 |
AWQ 4 bit, 128 groupsize of [PowerInfer/SmallThinker-3B-Preview](https://huggingface.co/PowerInfer/SmallThinker-3B-Preview)
|
|
|
|
| 10 |
tags:
|
| 11 |
- awq
|
| 12 |
- qwen2
|
| 13 |
+
- vllm
|
| 14 |
+
- 4bit
|
| 15 |
---
|
| 16 |
|
| 17 |
AWQ 4 bit, 128 groupsize of [PowerInfer/SmallThinker-3B-Preview](https://huggingface.co/PowerInfer/SmallThinker-3B-Preview)
|