readme: ---
  license: mit
  ---
  
  # Sparse BERT mini model (uncased)
  
  Finetuned model pruned to 1:4 structured sparsity.
  The model is a pruned version of the [BERT mini model](https://huggingface.co/prajjwal1/bert-mini).
  
  ## Intended Use
  
  The model can be used for inference with sparsity optimization.
  For further details on the model and its usage will be soon available.
  
  ## Evaluation Results
  We get the following results on the sst2 tasks development set:
  
  | Task | SST-2 (Acc) |
  |------|-------------|
  |      |     87.2    |
  Better than dense [bert mini](https://huggingface.co/M-FAC/bert-mini-finetuned-sst2) which is 84.74%.
  