Thanks for your suggestion. Do you know if Pytorch would run some optimization in the background thus leading to parallelization in your suggestion ?
By reading it/not being perfect on Pytorch background optims I fear that it would eventually run the models in a sequence (like a for loop would) rather than in parallel.
The goal is to have time_parallel(model 1, …, model k) << time_unary(model 1) + … + time_unary(model k).