readme: ---
  language: 
    - da
  
  tags:
  - climate change
  - climate-classifier
  - political quotes
  - klimabert
  
  ---
  
  # Identifying and Analysing political quotes from the Danish Parliament related to climate change using NLP
  **KlimaBERT**, a sequence-classifier fine-tuned to predict whether political quotes are climate-related. When predicting the positive class 1, "climate-related", the model achieves a F1-score of 0.97, Precision of 0.97, and Recall of 0.97. The negative class, 0, is defined as "non-climate-related".
  
  KlimaBERT is fine-tuned using the pre-trained DaBERT-uncased model, on a training set of 1.000 manually labelled data-points. The training set contains both political quotes and summaries of bills from the [Danish Parliament](https://www.ft.dk/).
  
  The model is created to identify political quotes related to climate change, and performs best on official texts from the Danish Parliament.
  
  ### Fine-tuning
  To fine-tune a model similar to KlimaBERT, follow the [fine-tuning notebooks](https://github.com/jonahank/Vote-Prediction-Model/tree/main/climate_classifier)
  
  ### References
  BERT:
  Devlin, J., M.-W. Chang, K. Lee, and K. Toutanova (2018). Bert: Pre-training of deep
  bidirectional transformers for language understanding.
  https://arxiv.org/abs/1810.04805
  
  DaBERT:
  Certainly (2021). Certainly has trained the most advanced danish bert model to date.
  https://www.certainly.io/blog/danish-bert-model/.
  
  ### Acknowledgements
  The resources are created through the work of my Master's thesis, so I would like to thank my supervisors [Leon Derczynski](https://www.derczynski.com/itu/) and [Vedran Sekara](https://vedransekara.github.io/) for the great support throughout the project! And a HUGE thanks to [Gustav Gyrst](https://github.com/Gyrst) for great sparring and co-development of the tools you find in this repo. 
  
  
  ### Contact
  For any further help, questions, comments etc. feel free to contact the author Jonathan Kristensen on [LinedIn](https://www.linkedin.com/in/jonathan-kristensen-444a96104) or by creating a "discussion" on this model's page.
  