readme: ---
  language: sv
  ---
  
  # BERTSSON Models
  
  The models are trained on:
  - Government Text
  - Swedish Literature
  - Swedish News
  
  Corpus size: Roughly 6B tokens.
  
  The following models are currently available:
  
  - **bertsson** - A BERT base model trained with the same hyperparameters as first published by Google.
  
  All models are cased and trained with whole word masking.
  
  Stay tuned for evaluations. 
  