Unexpect behaviour
I have a base model and a lora model trained. And a new model which save with merge_and_unload()

But the saved model loaded always got OOM, is that normal? This should't happen in my opiiopn.

the saved model is same size aas 7B

![image](https://github.com/huggingface/transformers/assets/21303438/a588f3fb-00fc-4d2c-8dd6-8f7d138d42ca)


and the script I load model are same.
cc @younesbelkada and @pacman100 
But they won't be able to help you without seeing a reproducer of the issue.<|||||>this is very weired, I wish I could post a reproducible code here but this could only be done by opensource all my code which is limited due to policy. However, I think merged lora and the basemodel should be likely the same, why they could even get OOM, could be any possible reason?<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md) are likely to be ignored.