[wip] [deepspeed] nvme test hanging experiment
Debugging https://github.com/huggingface/transformers/issues/12715

This PR is trying to revert to the last known to work version 0.4.2.


Continued in https://github.com/huggingface/transformers/pull/12721