Update README.md
Browse files
README.md
CHANGED
@@ -41,7 +41,7 @@ co2_eq_emissions:
|
|
41 |
|
42 |
Large language models (LLMs) have significantly advanced natural language processing, but their progress has yet to be equal across languages. While most LLMs are trained in high-resource languages like English, multilingual models generally underperform monolingual ones. Additionally, aspects of their multilingual foundation sometimes restrict the byproducts they produce, like computational demands and licensing regimes. Hence, we developed the _TeenyTinyLlama_ pair: two compact models for Brazilian Portuguese text generation.
|
43 |
|
44 |
-
Read our preprint on [ArXiv](
|
45 |
|
46 |
## Details
|
47 |
|
@@ -207,8 +207,8 @@ All the shown results are the higher accuracy scores achieved on the respective
|
|
207 |
@misc{correa24ttllama,
|
208 |
title = {TeenyTinyLlama: open-source tiny language models trained in Brazilian Portuguese},
|
209 |
author = {Corr{\^e}a, Nicholas Kluge and Falk, Sophia and Fatimah, Shiza and Sen, Aniket and De Oliveira, Nythamar},
|
210 |
-
journal={arXiv},
|
211 |
-
year
|
212 |
}
|
213 |
|
214 |
```
|
|
|
41 |
|
42 |
Large language models (LLMs) have significantly advanced natural language processing, but their progress has yet to be equal across languages. While most LLMs are trained in high-resource languages like English, multilingual models generally underperform monolingual ones. Additionally, aspects of their multilingual foundation sometimes restrict the byproducts they produce, like computational demands and licensing regimes. Hence, we developed the _TeenyTinyLlama_ pair: two compact models for Brazilian Portuguese text generation.
|
43 |
|
44 |
+
Read our preprint on [ArXiv](https://arxiv.org/abs/2401.16640).
|
45 |
|
46 |
## Details
|
47 |
|
|
|
207 |
@misc{correa24ttllama,
|
208 |
title = {TeenyTinyLlama: open-source tiny language models trained in Brazilian Portuguese},
|
209 |
author = {Corr{\^e}a, Nicholas Kluge and Falk, Sophia and Fatimah, Shiza and Sen, Aniket and De Oliveira, Nythamar},
|
210 |
+
journal={arXiv preprint arXiv:2401.16640},
|
211 |
+
year={2024}
|
212 |
}
|
213 |
|
214 |
```
|