Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,58 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language:
|
3 |
+
- en
|
4 |
+
- hi
|
5 |
+
- gu
|
6 |
+
license:
|
7 |
+
- apache-2.0
|
8 |
+
- cc-by-sa-4.0
|
9 |
+
tags:
|
10 |
+
- gguf
|
11 |
+
- assistant
|
12 |
+
- AI
|
13 |
+
- Mirror
|
14 |
+
- mirror_code
|
15 |
+
- LLM
|
16 |
+
- LoRA
|
17 |
+
- ollama
|
18 |
+
- llama.cpp
|
19 |
+
library_name: llama.cpp
|
20 |
+
model_creator: Dipesh Majithia
|
21 |
+
model_name: Mirror Dolly (GGUF)
|
22 |
+
datasets:
|
23 |
+
- databricks/databricks-dolly-15k
|
24 |
+
base_model:
|
25 |
+
- dipeshmajithia/MirrorCode
|
26 |
+
---
|
27 |
+
|
28 |
+
# 🪞 Mirror Dolly (GGUF) – Model Card
|
29 |
+
|
30 |
+
## 🧠 Summary
|
31 |
+
**Mirror Dolly** is a fine-tuned assistant-style language model built on top of [`dipeshmajithia/MirrorCode`](https://huggingface.co/dipeshmajithia/MirrorCode). It was fine-tuned for **1000 iterations** on the **Dolly 15k dataset** using LoRA, and later merged and converted to GGUF for local inference.
|
32 |
+
|
33 |
+
Mirror Dolly is designed for structured and emotionally aware assistant conversations and supports lightweight deployment with `llama.cpp`, `ollama`, or `text-generation-webui`.
|
34 |
+
|
35 |
+
---
|
36 |
+
|
37 |
+
## 📦 Model Overview
|
38 |
+
|
39 |
+
- **Base model**: [`dipeshmajithia/MirrorCode`](https://huggingface.co/dipeshmajithia/MirrorCode)
|
40 |
+
- **LoRA fine-tuning**:
|
41 |
+
- Dataset: Dolly 15k
|
42 |
+
- Iterations: 1000
|
43 |
+
- Layers: 4
|
44 |
+
- Rank: 8
|
45 |
+
- **Merged and Converted**: To GGUF via `transformers` + `convert_hf_to_gguf.py`
|
46 |
+
- **Quantization options**: f16, q8_0, q4_0
|
47 |
+
- **Use cases**:
|
48 |
+
- Personal assistant
|
49 |
+
- Structured explanations
|
50 |
+
- Lightweight offline inference
|
51 |
+
|
52 |
+
---
|
53 |
+
|
54 |
+
## 🛠 How to Use
|
55 |
+
|
56 |
+
### ▶️ With `llama.cpp`
|
57 |
+
```bash
|
58 |
+
./main -m mirror_dolly.gguf -p "Who are you?"
|