pytorch jax roberta masked-lm el transformers fill-mask
.gitattributes README.md config.json flax_model.msgpack merges.txt pytorch_model.bin training_args.bin vocab.json
---
language: el
widget:
 - text: "μπαινω στο <mask> και τι να δω."
---

#  Α lite RoBERTa fill mask model trained mostly in greek tweets


The training dataset of this model  consists of 23 million tweets in Greek, of approximately 5000 users in total, spanning from 2008 to 2018.
The model has been trained to support the work for the paper [Multimodal Hate Speech Detection in Greek Social Media (preprint v1)](https://www.preprints.org/manuscript/202103.0390/v1 ) 


## Load the pretrained model

```python
from transformers import AutoTokenizer, AutoModel

tokenizer = AutoTokenizer.from_pretrained("Konstantinos/BERTaTweetGR")
model = AutoModel.from_pretrained("Konstantinos/BERTaTweetGR")
```
