readme: ---
  language: 
    - en
  tags:
  - text generation
  - pytorch
  - causal-lm
  license: apache-2.0
  ---
  # ReGPT-125M-200G
  This model was trained on GPT-Neo-125M with [Mengzi Retrieval LM](https://github.com/Langboat/mengzi-retrieval-lm). 
  
  For more details, please refer to this [document](https://github.com/Langboat/mengzi-retrieval-lm/blob/main/README.md).
  
  # How to use
  You have to use a forked transformers: https://github.com/Langboat/transformers
  ```python
  from transformers import Re_gptForCausalLM
  model = Re_gptForCausalLM.from_pretrained('Langboat/ReGPT-125M-200G')
  ```
  