readme: ---
  license: bigscience-openrail-m
  ---
  
  This is last Megatron-Deepspeed checkpoint dump for this model:  https://huggingface.co/HuggingFaceM4/gpt2-deep-1b56-ratio-33/
  
  To convert to HF `transformers` format using https://github.com/bigscience-workshop/Megatron-DeepSpeed
  
  ```
  cd Megatron-DeepSpeed
  PYTHONPATH=. tools/convert_checkpoint/deepspeed_to_transformers.py \
  --input_folder global_step298611 \
  --output_folder narrow-gpt2-298611
  ```