Updating model files
Browse files
README.md
CHANGED
@@ -8,6 +8,17 @@ tags:
|
|
8 |
- llm-foundry
|
9 |
inference: false
|
10 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
11 |
|
12 |
# MPT-7B-Instruct GGML
|
13 |
|
@@ -59,13 +70,24 @@ bin/mpt -m /path/to/mpt7b-instruct.ggmlv3.q4_0.bin -t 8 -n 512 -p "Write a story
|
|
59 |
|
60 |
Please see the ggml repo for other build options.
|
61 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
62 |
# Original model card: MPT-7B-Instruct
|
63 |
|
64 |
|
65 |
# MPT-7B-Instruct
|
66 |
|
67 |
MPT-7B-Instruct is a model for short-form instruction following.
|
68 |
-
It is built by finetuning [MPT-7B](https://huggingface.co/spaces/mosaicml/mpt-7b) on a [dataset](https://huggingface.co/datasets/sam-mosaic/dolly_hhrlhf) derived from the [Databricks Dolly-15k](https://huggingface.co/datasets/databricks/databricks-dolly-15k) and the [Anthropic Helpful and Harmless (HH-RLHF)](https://huggingface.co/datasets/Anthropic/hh-rlhf) datasets.
|
69 |
* License: _CC-By-SA-3.0_
|
70 |
* [Demo on Hugging Face Spaces](https://huggingface.co/spaces/mosaicml/mpt-7b-instruct)
|
71 |
|
@@ -108,7 +130,7 @@ model = transformers.AutoModelForCausalLM.from_pretrained(
|
|
108 |
trust_remote_code=True
|
109 |
)
|
110 |
```
|
111 |
-
Note: This model requires that `trust_remote_code=True` be passed to the `from_pretrained` method.
|
112 |
This is because we use a custom `MPT` model architecture that is not yet part of the Hugging Face `transformers` package.
|
113 |
`MPT` includes options for many training efficiency features such as [FlashAttention](https://arxiv.org/pdf/2205.14135.pdf), [ALiBi](https://arxiv.org/abs/2108.12409), [QK LayerNorm](https://arxiv.org/abs/2010.04245), and more.
|
114 |
|
|
|
8 |
- llm-foundry
|
9 |
inference: false
|
10 |
---
|
11 |
+
<div style="width: 100%;">
|
12 |
+
<img src="https://i.imgur.com/EBdldam.jpg" alt="TheBlokeAI" style="width: 100%; min-width: 400px; display: block; margin: auto;">
|
13 |
+
</div>
|
14 |
+
<div style="display: flex; justify-content: space-between; width: 100%;">
|
15 |
+
<div style="display: flex; flex-direction: column; align-items: flex-start;">
|
16 |
+
<p><a href="https://discord.gg/UBgz4VXf">Chat & support: my new Discord server</a></p>
|
17 |
+
</div>
|
18 |
+
<div style="display: flex; flex-direction: column; align-items: flex-end;">
|
19 |
+
<p><a href="https://www.patreon.com/TheBlokeAI">Want to contribute? Patreon coming soon!</a></p>
|
20 |
+
</div>
|
21 |
+
</div>
|
22 |
|
23 |
# MPT-7B-Instruct GGML
|
24 |
|
|
|
70 |
|
71 |
Please see the ggml repo for other build options.
|
72 |
|
73 |
+
## Want to support my work?
|
74 |
+
|
75 |
+
I've had a lot of people ask if they can contribute. I love providing models and helping people, but it is starting to rack up pretty big cloud computing bills.
|
76 |
+
|
77 |
+
So if you're able and willing to contribute, it'd be most gratefully received and will help me to keep providing models, and work on various AI projects.
|
78 |
+
|
79 |
+
Donaters will get priority support on any and all AI/LLM/model questions, and I'll gladly quantise any model you'd like to try.
|
80 |
+
|
81 |
+
* Patreon: coming soon! (just awaiting approval)
|
82 |
+
* Ko-Fi: https://ko-fi.com/TheBlokeAI
|
83 |
+
* Discord: https://discord.gg/UBgz4VXf
|
84 |
# Original model card: MPT-7B-Instruct
|
85 |
|
86 |
|
87 |
# MPT-7B-Instruct
|
88 |
|
89 |
MPT-7B-Instruct is a model for short-form instruction following.
|
90 |
+
It is built by finetuning [MPT-7B](https://huggingface.co/spaces/mosaicml/mpt-7b) on a [dataset](https://huggingface.co/datasets/sam-mosaic/dolly_hhrlhf) derived from the [Databricks Dolly-15k](https://huggingface.co/datasets/databricks/databricks-dolly-15k) and the [Anthropic Helpful and Harmless (HH-RLHF)](https://huggingface.co/datasets/Anthropic/hh-rlhf) datasets.
|
91 |
* License: _CC-By-SA-3.0_
|
92 |
* [Demo on Hugging Face Spaces](https://huggingface.co/spaces/mosaicml/mpt-7b-instruct)
|
93 |
|
|
|
130 |
trust_remote_code=True
|
131 |
)
|
132 |
```
|
133 |
+
Note: This model requires that `trust_remote_code=True` be passed to the `from_pretrained` method.
|
134 |
This is because we use a custom `MPT` model architecture that is not yet part of the Hugging Face `transformers` package.
|
135 |
`MPT` includes options for many training efficiency features such as [FlashAttention](https://arxiv.org/pdf/2205.14135.pdf), [ALiBi](https://arxiv.org/abs/2108.12409), [QK LayerNorm](https://arxiv.org/abs/2010.04245), and more.
|
136 |
|