Hugging Face's logo

Lewdiculous
/
DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-GGUF-IQ-Imatrix

GGUF
English
qwen3
qwen
chatml
sillytavern
roleplay
conversational
reasoning
thinking
imatrix
Model card Files Community
1
DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-GGUF-IQ-Imatrix
File size: 947 Bytes 
358a777
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
266c86d
358a777
 
 
266c86d
358a777
fbc1842
 
 
 
358a777
0593974
358a777
 
 
fbc1842
 
358a777
 
 
fbc1842
358a777
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
 
---
language:
- en
base_model:
- ArliAI/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small
tags:
- qwen3
- qwen
- chatml
- sillytavern
- roleplay
- conversational
- reasoning
- thinking
license: apache-2.0
---

<!--
- presets
- mistral
-->

<!--
> [!WARNING]
> **Uploading...** <br>
> Card will be updated later.
-->

My **GGUF-Imatrix** quants of [**DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small**](https://huggingface.co/ArliAI/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small). <br>

![model-mascot](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/K4al_bzXJAQkefaEN3IYN.jpeg)

> [!NOTE]
> **Prompt format:** <br>
> ChatML
>
> **Note:** <br>
> Set the additional settings as per the instructions in the image at the end of the card to use the thinking setup. [[1]](https://files.catbox.moe/3jky2q.jpg) <br>
> ![example 1](https://files.catbox.moe/fteelh.jpg)

# Reasoning setup in SillyTavern:

![reasoning-settings](https://files.catbox.moe/3jky2q.jpg)