[trainer] release tmp memory in checkpoint load
As discovered in https://github.com/huggingface/transformers/issues/12680#issuecomment-880194562 we had a model-size memory leak on loading checkpoint. @sgugger  found a fix which is what this this PR is.

@sgugger 