text: Title: [Feature Request] Diet Experts in Transformer
  Body: Is there a specific reason why the ```diet_experts``` haven't made it to ```transformer.py``` yet.
  They're already used in ```super_lm``` and ```attention_lm_moe.py```.