A small model for CTRL 
# 🚀 Feature request

A smaller version of the pre-trained model CTRL, related to the stack overflow question;
[https://stackoverflow.com/questions/60142937/huggingface-transformers-for-text-generation-with-ctrl]

## Motivation

I've been trying to generate text using CTRL and I run to a memory insufficiency, since it is a large model. And was wondering whether there would be a small version of CTRL like a Distill version like some of the other transformer models do.

cc'ing @keskarnitish on this issue just in case!<|||||>Thank you, @julien-c.<|||||>hi, any update on this?<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
