File size: 411 Bytes
031b79e 76d7f66 031b79e f24d2a4 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 |
---
datasets:
- PowerInfer/QWQ-LONGCOT-500K
- PowerInfer/LONGCOT-Refine-500K
base_model:
- PowerInfer/SmallThinker-3B-Preview
language:
- en
pipeline_tag: text-generation
tags:
- awq
- qwen2
- vllm
- 4bit
---
AWQ 4 bit, 128 groupsize of [PowerInfer/SmallThinker-3B-Preview](https://huggingface.co/PowerInfer/SmallThinker-3B-Preview)
Warning: This model seems to not work, not at least in my computer with vLLM |