Commit
·
09ab827
1
Parent(s):
cfaea12
Update README.md
Browse files
README.md
CHANGED
@@ -21,7 +21,7 @@ AraBERTv0.2-Twitter-base/large are two new models for Arabic dialects and tweets
|
|
21 |
|
22 |
The two new models have had emojies added to their vocabulary in addition to common words that weren't at first present. The pre-training was done with a max sentence length of 64 only for 1 epoch.
|
23 |
|
24 |
-
**AraBERT** is an Arabic pretrained
|
25 |
|
26 |
|
27 |
## Other Models
|
|
|
21 |
|
22 |
The two new models have had emojies added to their vocabulary in addition to common words that weren't at first present. The pre-training was done with a max sentence length of 64 only for 1 epoch.
|
23 |
|
24 |
+
**AraBERT** is an Arabic pretrained language model based on [Google's BERT architechture](https://github.com/google-research/bert). AraBERT uses the same BERT-Base config. More details are available in the [AraBERT Paper](https://arxiv.org/abs/2003.00104) and in the [AraBERT Meetup](https://github.com/WissamAntoun/pydata_khobar_meetup)
|
25 |
|
26 |
|
27 |
## Other Models
|