Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,5 @@
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
library_name: peft
|
|
@@ -7,7 +9,7 @@ datasets:
|
|
| 7 |
- jondurbin/airoboros-2.2.1
|
| 8 |
inference: false
|
| 9 |
pipeline_tag: text-generation
|
| 10 |
-
base_model: mistralai/Mistral-7B-
|
| 11 |
---
|
| 12 |
|
| 13 |
<div align="center">
|
|
@@ -22,13 +24,13 @@ The Mistral-7B-Instruct-v0.1 Large Language Model (LLM) is a pretrained generati
|
|
| 22 |
|
| 23 |
## Model Details
|
| 24 |
|
| 25 |
-
This model was built via parameter-efficient finetuning of [mistralai/Mistral-7B-
|
| 26 |
|
| 27 |
- **Developed by:** Daniel Furman
|
| 28 |
- **Model type:** Decoder-only
|
| 29 |
- **Language(s) (NLP):** English
|
| 30 |
- **License:** Apache 2.0
|
| 31 |
-
- **Finetuned from model:** [mistralai/Mistral-7B-
|
| 32 |
|
| 33 |
## Model Sources
|
| 34 |
|
|
@@ -225,4 +227,5 @@ dryanfurman at gmail
|
|
| 225 |
|
| 226 |
## Framework versions
|
| 227 |
|
| 228 |
-
- PEFT 0.6.0.dev0
|
|
|
|
|
|
| 1 |
+
Mistral-7B-Instruct-v0.1
|
| 2 |
+
|
| 3 |
---
|
| 4 |
license: apache-2.0
|
| 5 |
library_name: peft
|
|
|
|
| 9 |
- jondurbin/airoboros-2.2.1
|
| 10 |
inference: false
|
| 11 |
pipeline_tag: text-generation
|
| 12 |
+
base_model: mistralai/Mistral-7B-v0.1
|
| 13 |
---
|
| 14 |
|
| 15 |
<div align="center">
|
|
|
|
| 24 |
|
| 25 |
## Model Details
|
| 26 |
|
| 27 |
+
This model was built via parameter-efficient finetuning of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the [jondurbin/airoboros-2.2.1](https://huggingface.co/datasets/jondurbin/airoboros-2.2.1). Finetuning was executed on 1x A100 (40 GB SXM) for roughly 3 hours.
|
| 28 |
|
| 29 |
- **Developed by:** Daniel Furman
|
| 30 |
- **Model type:** Decoder-only
|
| 31 |
- **Language(s) (NLP):** English
|
| 32 |
- **License:** Apache 2.0
|
| 33 |
+
- **Finetuned from model:** [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1)
|
| 34 |
|
| 35 |
## Model Sources
|
| 36 |
|
|
|
|
| 227 |
|
| 228 |
## Framework versions
|
| 229 |
|
| 230 |
+
- PEFT 0.6.0.dev0
|
| 231 |
+
-
|