pytorch tf roberta masked-lm cs arxiv:2105.11314 transformers Czech RoBERTa ÚFAL license:cc-by-nc-4.0 fill-mask
.gitattributes LICENSE README.md config.json merges.txt pytorch_model.bin tf_model.h5 tokenizer_config.json vocab.json
---
language: "cs"
tags:
- Czech
- RoBERTa
- ÚFAL
license: "cc-by-nc-4.0"
---

# RobeCzech model

RobeCzech is a monolingual RoBERTa language representation model trained on Czech data.

RobeCzech model is released publicly at [LINDAT](https://hdl.handle.net/11234/1-3691) and [Hugging Face](https://huggingface.co/ufal/robeczech-base).

Please cite the corresponding publication:
- Milan Straka, Jakub Náplava, Jana Straková and David Samuel: Czech RoBERTa, a monolingual contextualized language representation model. Accepted to TSD 2021.

Preprint of the paper is available at https://arxiv.org/abs/2105.11314.
