pytorch tf jax bert masked-lm ko transformers fill-mask
.gitattributes README.md config.json flax_model.msgpack pytorch_model.bin tf_model.h5 tokenizer_config.json vocab.txt
---
language: ko
---

# Bert base model for Korean

* 70GB Korean text dataset and 42000 lower-cased subwords are used
* Check the model performance and other language models for Korean in [github](https://github.com/kiyoungkim1/LM-kor)

```python
from transformers import BertTokenizerFast, BertModel

tokenizer_bert = BertTokenizerFast.from_pretrained("kykim/bert-kor-base")
model_bert = BertModel.from_pretrained("kykim/bert-kor-base")
```