transformers pytorch t5 text2text-generation dataset:ignatius/welsh_summarization arxiv:2205.02545 license:cc-by-4.0 autotrain_compatible text-generation-inference endpoints_compatible region:us
---
datasets: ignatius/welsh_summarization
license: cc-by-4.0
---
`cyT5-small` is a light-weight (alpha-version) Welsh T5 model extracted from the `google/mt5-small` model and fine-tuned only on the [Welsh summarization dataset](https://huggingface.co/datasets/ignatius/welsh_summarization).

 
**Citation:**
[Introducing the Welsh Text Summarisation Dataset and Baseline Systems](https://arxiv.org/abs/2205.02545).

```
@article{ezeani2022introducing,
  title={Introducing the Welsh text summarisation dataset and baseline systems},
  author={Ezeani, Ignatius and El-Haj, Mahmoud and Morris, Jonathan and Knight, Dawn},
  journal={arXiv preprint arXiv:2205.02545},
  year={2022}
}
```
Further developments are ongoing and will update will be shared soon.