Update README.md
Browse files
README.md
CHANGED
|
@@ -6,7 +6,9 @@ pipeline_tag: text-generation
|
|
| 6 |
library_name: transformers
|
| 7 |
---
|
| 8 |
|
| 9 |
-
**This is a model missing the LM head, caused by an unfortunate bug in checkpoint saving. We are releasing with for research purposes to try and reconstruct an LM head
|
|
|
|
|
|
|
| 10 |
|
| 11 |
<img src="https://huggingface.co/datasets/allenai/blog-images/resolve/main/tulu3/Tulu3-logo.png" alt="Tulu 3 banner" width="800" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
|
| 12 |
|
|
|
|
| 6 |
library_name: transformers
|
| 7 |
---
|
| 8 |
|
| 9 |
+
**This is a model missing the LM head, caused by an unfortunate bug in checkpoint saving. We are releasing with for research purposes to try and reconstruct an LM head.**
|
| 10 |
+
|
| 11 |
+
This could be in principle be done for any model, but is more exciting for a model by which recovering the weights would be a notable, SOTA model.
|
| 12 |
|
| 13 |
<img src="https://huggingface.co/datasets/allenai/blog-images/resolve/main/tulu3/Tulu3-logo.png" alt="Tulu 3 banner" width="800" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
|
| 14 |
|