Script to convert huggingface models to deepspeed/megatron checkpoints
Do we have a script to convert the huggingface pretrained models on the server to deepspeed/megatron style model checkpoints?
We don't at the moment. You can probably try to reverse the existing conversion scripts.

@tjruwase (Deepspeed) has been working on doing various conversions between Meg-LM, Meg-DS and HF Transformers:
https://github.com/bigscience-workshop/Megatron-DeepSpeed/pull/239
so perhaps it'd fit there the best, but it's a slow going, as we keep asking Tunji to work on other things every time we try to go back to work on the checkpoints<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md) are likely to be ignored.<|||||>Hi there. 
Just wondering any updates of the conversion from HF models to DS models. 
Thanks! 