---
datasets:
- PowerInfer/QWQ-LONGCOT-500K
- PowerInfer/LONGCOT-Refine-500K
base_model:
- PowerInfer/SmallThinker-3B-Preview
language:
- en
pipeline_tag: text-generation
tags:
- awq
- qwen2
- vllm
- 4bit
---

AWQ 4 bit, 128 groupsize of [PowerInfer/SmallThinker-3B-Preview](https://huggingface.co/PowerInfer/SmallThinker-3B-Preview)

Warning: This model seems to not work, not at least in my computer with vLLM