readme: ---
  language: 
  - da
  license: apache-2.0
  ---
  ## daT5-base
  A smaller version of [Google's mt5-base](https://huggingface.co/google/mt5-base) model, where the original model is reduced to only include Danish embeddings.
  
  ## How to use
  ```python
  from transformers import AutoTokenizer, AutoModel
  tokenizer = AutoTokenizer.from_pretrained("emillykkejensen/daT5-base")
  model = AutoModel.from_pretrained("emillykkejensen/daT5-base")
  ```
  
  ## Further reading
  
  [Gist](https://gist.github.com/emillykkejensen/8bf1b323495efc7252dee966e6bc1b5c) showing (in Danish) how the embeddings are extracted
  
  [Article](https://towardsdatascience.com/how-to-adapt-a-multilingual-t5-model-for-a-single-language-b9f94f3d9c90) explaining how to do it by [David Dale](https://huggingface.co/cointegrated)
  
  ## Also check out
  [daT5-large](https://huggingface.co/emillykkejensen/daT5-large)