save all custom files in the meanwhile
### Feature request

Many models in your huggingface hub have their custom files, like [mpt](https://huggingface.co/mosaicml/mpt-7b-instruct). However, your `save_pretrained` func can't save them all. Is it possible to save all of them at the same time?

### Motivation

It's pretty useful when you fine-tune the model and want to save it in a new directory.

### Your contribution

no
Hi @JaheimLee, thanks for raising this issue. 

Which files specifically are being referred to when you say "custom files"? <|||||>> Hi @JaheimLee, thanks for raising this issue.
> 
> Which files specifically are being referred to when you say "custom files"?

Like the model files which is not merged into transformers. For example:
https://huggingface.co/mosaicml/mpt-7b-instruct/blob/main/configuration_mpt.py
https://huggingface.co/mosaicml/mpt-7b-instruct/blob/main/adapt_tokenizer.py
https://huggingface.co/mosaicml/mpt-7b-instruct/blob/main/modeling_mpt.py
...<|||||>The `save_pretrained` function indicates a reference to the original repo so that you get the updates they push there automatically. You can still use your model with `from_pretrained` and push it to the Hub, and it will always work and keep the latest code version from their side.

If you really want the modeling files to make changes, you can find them all in the cache: `~/.cache/huggingface/hub/models--mosaicml--mpt-7b-instruct`.<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md) are likely to be ignored.