Yes, this should be possible.
You could create a “parent model” and pass or initialize the submodels in its __init__ method.
In the forward just call each submodel with the corresponding data and concatenate their outputs afterwards.
This won’t create any issues regarding backpropagation.