pytorch jax bert sv transformers
.gitattributes README.md config.json flax_model.msgpack model.ckpt-1000000.data-00000-of-00001 model.ckpt-1000000.index model.ckpt-1000000.meta model.ckpt-1110000.data-00000-of-00001 model.ckpt-1110000.index model.ckpt-1110000.meta model.ckpt-990000.data-00000-of-00001 model.ckpt-990000.index model.ckpt-990000.meta model.ckpt-992500.data-00000-of-00001 model.ckpt-992500.index model.ckpt-992500.meta model.ckpt-995000.data-00000-of-00001 model.ckpt-995000.index model.ckpt-995000.meta model.ckpt-997500.data-00000-of-00001 model.ckpt-997500.index model.ckpt-997500.meta pytorch_model.bin vocab.txt
---
language: sv
---

# BERTSSON Models

The models are trained on:
- Government Text
- Swedish Literature
- Swedish News

Corpus size: Roughly 6B tokens.

The following models are currently available:

- **bertsson** - A BERT base model trained with the same hyperparameters as first published by Google.

All models are cased and trained with whole word masking.

Stay tuned for evaluations. 
