prithivMLmods commited on
Commit
9fdacc1
·
verified ·
1 Parent(s): 858ff3f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +26 -1
README.md CHANGED
@@ -9,4 +9,29 @@ library_name: transformers
9
  tags:
10
  - text-generation-inference
11
  - code
12
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
  tags:
10
  - text-generation-inference
11
  - code
12
+ ---
13
+
14
+ # **Theta-Crucis-0.6B-Turbo1-GGUF**
15
+
16
+ > **Theta-Crucis-0.6B-Turbo1** is a compact, high-performance model designed for **code generation**, **technical reasoning**, and **structured output tasks**. Fine-tuned from **Qwen3-0.6B** using the **Mixture of Thoughts (MoT)** dataset with an emphasis on **code expert clusters**, this model delivers agile and accurate coding assistance in low-resource environments. At only **0.6B parameters**, it offers strong fluency in programming, structured syntax, and technical language generation.
17
+
18
+ ## Model File
19
+
20
+ | File Name | Size | Format | Description |
21
+ |--------------------------------------------|--------|---------------|------------------------------------------|
22
+ | Theta-Crucis-0.6B-Turbo1.BF16.gguf | 1.2 GB | GGUF (BF16) | BFloat16 precision model file |
23
+ | Theta-Crucis-0.6B-Turbo1.F32.gguf | 2.39 GB| GGUF (F32) | Float32 precision model file |
24
+ | Theta-Crucis-0.6B-Turbo1.Q4_K_M.gguf | 397 MB | GGUF (Q4_K_M) | 4-bit quantized model file |
25
+ | Theta-Crucis-0.6B-Turbo1.Q5_K_M.gguf | 444 MB | GGUF (Q5_K_M) | 5-bit quantized model file |
26
+ | Theta-Crucis-0.6B-Turbo1.Q8_0.gguf | 639 MB | GGUF (Q8_0) | 8-bit quantized model file |
27
+ | config.json | 31 B | JSON | Configuration file |
28
+ | .gitattributes | 1.88 kB| Text | Git attributes configuration |
29
+
30
+ ## Quants Usage
31
+
32
+ (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
33
+
34
+ Here is a handy graph by ikawrakow comparing some lower-quality quant
35
+ types (lower is better):
36
+
37
+ ![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)