readme: ---
  language: 
    - pt
  ---
  
  This model was distilled from [BERTimbau](https://huggingface.co/neuralmind/bert-base-portuguese-cased)
  
  ## Usage
  
  ```python
  from transformers import AutoTokenizer  # Or BertTokenizer
  from transformers import AutoModelForPreTraining  # Or BertForPreTraining for loading pretraining heads
  from transformers import AutoModel  # or BertModel, for BERT without pretraining heads
  model = AutoModelForPreTraining.from_pretrained('adalbertojunior/distilbert-portuguese-cased')
  tokenizer = AutoTokenizer.from_pretrained('adalbertojunior/distilbert-portuguese-cased', do_lower_case=False)
  ```
  You should fine tune it on your own data.
  
  It can achieve accuracy up to 99% relative to the original BERTimbau in some tasks.