Nondzu commited on
Commit
0eca161
1 Parent(s): 9ef9315

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -2
README.md CHANGED
@@ -1,8 +1,16 @@
1
  ---
2
  license: apache-2.0
3
  ---
 
4
 
5
- Prompt template: Alpaca
 
 
 
 
 
 
 
6
  ```
7
  Below is an instruction that describes a task. Write a response that appropriately completes the request.
8
 
@@ -13,7 +21,7 @@ Below is an instruction that describes a task. Write a response that appropriate
13
  ```
14
 
15
  [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
16
- settings:
17
  ```
18
  base_model: mistralai/Mistral-7B-Instruct-v0.1
19
  base_model_config: mistralai/Mistral-7B-Instruct-v0.1
 
1
  ---
2
  license: apache-2.0
3
  ---
4
+ # Mistral-7B-code-16k-qlora
5
 
6
+ I'm excited to announce the release of a new model called Mistral-7B-code-16k-qlora. This small and fast model shows a lot of promise for supporting coding or acting as a copilot. I'm currently looking for people to help me test it out!
7
+
8
+ ## Additional Information
9
+
10
+ This model was trained on 3x RTX 3090 in my homelab, using around 130kWh for approximately 23 cents, which is equivalent to around $30 for electricity.
11
+
12
+
13
+ ## Prompt template: Alpaca
14
  ```
15
  Below is an instruction that describes a task. Write a response that appropriately completes the request.
16
 
 
21
  ```
22
 
23
  [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
24
+ ## Settings:
25
  ```
26
  base_model: mistralai/Mistral-7B-Instruct-v0.1
27
  base_model_config: mistralai/Mistral-7B-Instruct-v0.1