[deepspeed] fix resume from checkpoint
This PR fixes a bug that most likely somehow got exposed (not caused) by https://github.com/huggingface/transformers/pull/11318 - surprisingly the same test worked just fine before that other PR.

@sgugger


Indeed. I removed it during merge.  Thank you for the reminder, @sgugger 