Thank you, you write the idea properly  and that make sense to me  I will start working on it.
P.S. do you already have  any similar example  or could you give me a dummy one at least?
Getting 5 seperate trained models as .pth file is ok. But for the later steps,
removing the last classification layer, concatenate and add a classifier head on top of their concatenated outputs ? just to be sure.