How did you define your current model?
If both submodules are instances of nn.Sequential, you could recreate them separately outside of your current model and just load the state_dicts into them.
If your modules and forward is more complicated, you could still redefine the submodules, but would most likely have to filter out unwanted keys from the state_dict of the complete model before loading it into the submodels.