I’m not sure to understand the use case.
It seems you would like to load the state_dict to a single GPU machine, but in your code you are wrapping the model again in DDP.
Would creating the model, loading the state_dict, and pushing the model to the single GPU not work?