pytorch tf jax bert no transformers license:cc-by 4.0 norwegian fill-mask pipeline_tag:fill-mask
.gitattributes README.md config.json flax_model.msgpack nblogo_2.png pytorch_model.bin special_tokens_map.json tf_model.h5 tokenizer_config.json vocab.txt
---
language: no
license: CC-BY 4.0
tags:
- norwegian
- bert
thumbnail: nblogo_3.png
pipeline_tag: fill-mask
widget:
- text: "På biblioteket kan du låne [MASK]."
---
- **Release 1.1** (March 11, 2021)
- **Release 1.0** (January 13, 2021)

# NB-BERT-base

## Description

NB-BERT-base is a general BERT-base model built on the large digital collection at the National Library of Norway.

This model is based on the same structure as [BERT Cased multilingual model](https://github.com/google-research/bert/blob/master/multilingual.md), and is trained on a wide variety of Norwegian text (both bokmål and nynorsk) from the last 200 years.

## Intended use & limitations

The 1.1 version of the model is general, and should be fine-tuned for any particular use. Some fine-tuning sets may be found on GitHub, see

* https://github.com/NBAiLab/notram

## Training data

The model is trained on a wide variety of text. The training set is described on

* https://github.com/NBAiLab/notram

## More information

For more information on the model, see

https://github.com/NBAiLab/notram
