readme: ---
  language: 
    - es
  
  tags:
    - twitter
    - sentiment-analysis
  
  ---
  # Sentiment Analysis in Spanish
  ## robertuito-sentiment-analysis
  
  Repository: [https://github.com/pysentimiento/pysentimiento/](https://github.com/finiteautomata/pysentimiento/)
  
  
  Model trained with TASS 2020 corpus (around ~5k tweets) of several dialects of Spanish. Base model is [RoBERTuito](https://github.com/pysentimiento/robertuito), a RoBERTa model trained in Spanish tweets.
  
  Uses `POS`, `NEG`, `NEU` labels.
  
  
  ## Results
  
  Results for the four tasks evaluated in `pysentimiento`. Results are expressed as Macro F1 scores
  
  
  | model         | emotion       | hate_speech   | irony         | sentiment     |
  |:--------------|:--------------|:--------------|:--------------|:--------------|
  | robertuito    | 0.560 ± 0.010 | 0.759 ± 0.007 | 0.739 ± 0.005 | 0.705 ± 0.003 |
  | roberta       | 0.527 ± 0.015 | 0.741 ± 0.012 | 0.721 ± 0.008 | 0.670 ± 0.006 |
  | bertin        | 0.524 ± 0.007 | 0.738 ± 0.007 | 0.713 ± 0.012 | 0.666 ± 0.005 |
  | beto_uncased  | 0.532 ± 0.012 | 0.727 ± 0.016 | 0.701 ± 0.007 | 0.651 ± 0.006 |
  | beto_cased    | 0.516 ± 0.012 | 0.724 ± 0.012 | 0.705 ± 0.009 | 0.662 ± 0.005 |
  | mbert_uncased | 0.493 ± 0.010 | 0.718 ± 0.011 | 0.681 ± 0.010 | 0.617 ± 0.003 |
  | biGRU         | 0.264 ± 0.007 | 0.592 ± 0.018 | 0.631 ± 0.011 | 0.585 ± 0.011 |
  
  
  Note that for Hate Speech, these are the results for Semeval 2019, Task 5 Subtask B
  
  ## Citation
  
  If you use this model in your research, please cite pysentimiento and RoBERTuito papers:
  
  ```
  @misc{perez2021pysentimiento,
        title={pysentimiento: A Python Toolkit for Sentiment Analysis and SocialNLP tasks},
        author={Juan Manuel Pérez and Juan Carlos Giudici and Franco Luque},
        year={2021},
        eprint={2106.09462},
        archivePrefix={arXiv},
        primaryClass={cs.CL}
  }
  @misc{perez2021robertuito,
        title={RoBERTuito: a pre-trained language model for social media text in Spanish},
        author={Juan Manuel Pérez and Damián A. Furman and Laura Alonso Alemany and Franco Luque},
        year={2021},
        eprint={2111.09453},
        archivePrefix={arXiv},
        primaryClass={cs.CL}
  }
  ```