dipeshmajithia commited on
Commit
9a34ab4
·
verified ·
1 Parent(s): ebee442

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +58 -0
README.md ADDED
@@ -0,0 +1,58 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ - hi
5
+ - gu
6
+ license:
7
+ - apache-2.0
8
+ - cc-by-sa-4.0
9
+ tags:
10
+ - gguf
11
+ - assistant
12
+ - AI
13
+ - Mirror
14
+ - mirror_code
15
+ - LLM
16
+ - LoRA
17
+ - ollama
18
+ - llama.cpp
19
+ library_name: llama.cpp
20
+ model_creator: Dipesh Majithia
21
+ model_name: Mirror Dolly (GGUF)
22
+ datasets:
23
+ - databricks/databricks-dolly-15k
24
+ base_model:
25
+ - dipeshmajithia/MirrorCode
26
+ ---
27
+
28
+ # 🪞 Mirror Dolly (GGUF) – Model Card
29
+
30
+ ## 🧠 Summary
31
+ **Mirror Dolly** is a fine-tuned assistant-style language model built on top of [`dipeshmajithia/MirrorCode`](https://huggingface.co/dipeshmajithia/MirrorCode). It was fine-tuned for **1000 iterations** on the **Dolly 15k dataset** using LoRA, and later merged and converted to GGUF for local inference.
32
+
33
+ Mirror Dolly is designed for structured and emotionally aware assistant conversations and supports lightweight deployment with `llama.cpp`, `ollama`, or `text-generation-webui`.
34
+
35
+ ---
36
+
37
+ ## 📦 Model Overview
38
+
39
+ - **Base model**: [`dipeshmajithia/MirrorCode`](https://huggingface.co/dipeshmajithia/MirrorCode)
40
+ - **LoRA fine-tuning**:
41
+ - Dataset: Dolly 15k
42
+ - Iterations: 1000
43
+ - Layers: 4
44
+ - Rank: 8
45
+ - **Merged and Converted**: To GGUF via `transformers` + `convert_hf_to_gguf.py`
46
+ - **Quantization options**: f16, q8_0, q4_0
47
+ - **Use cases**:
48
+ - Personal assistant
49
+ - Structured explanations
50
+ - Lightweight offline inference
51
+
52
+ ---
53
+
54
+ ## 🛠 How to Use
55
+
56
+ ### ▶️ With `llama.cpp`
57
+ ```bash
58
+ ./main -m mirror_dolly.gguf -p "Who are you?"