readme: ---
  license: cc-by-4.0
  ---
  `cyT5-small` is a light-weight (alpha-version) Welsh T5 model extracted from the `google/mt5-small` model and fine-tuned only on the [Welsh summarization dataset](https://huggingface.co/datasets/ignatius/welsh_summarization).
  
   
  **Citation:**
  [Introducing the Welsh Text Summarisation Dataset and Baseline Systems](https://arxiv.org/abs/2205.02545).
  
  ```
  @article{ezeani2022introducing,
    title={Introducing the Welsh text summarisation dataset and baseline systems},
    author={Ezeani, Ignatius and El-Haj, Mahmoud and Morris, Jonathan and Knight, Dawn},
    journal={arXiv preprint arXiv:2205.02545},
    year={2022}
  }
  ```
  Further developments are ongoing and will update will be shared soon.