🌟 Transformer Lite
# 🌟 New model addition

## Model description

Part of the abstract :

> In this paper, we present an efficient mobile NLP architecture, Lite Transformer to
facilitate deploying mobile NLP applications on edge devices. [...] brings consistent improvement over the vanilla transformer on three well-established language
tasks: machine translation, abstractive summarization, and language modeling. [...] Notably, Lite Transformer outperforms the AutoML-based Evolved
Transformer by 0.5 higher BLEU for the mobile NLP setting without the costly
architecture search that requires more than 250 GPU years

## Open source status

* [x] the model implementation is available: [Repository](https://github.com/mit-han-lab/lite-transformer)
* [x] the model weights are available: [In the README](https://github.com/mit-han-lab/lite-transformer#models)
* [x] who are the authors: @Michaelvll

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
