Hi all,
If I only want to run forward() with same inputs and different weights in parallel, then merge the output after all forward() is done. How can I do this in Pytorch? It looks like I might be able to use cuda stream? https://pytorch.org/docs/stable/notes/cuda.html#cuda-streams 23 But I’m not sure if this is the right way to go. Is there a more efficient way to do this?
Thank you all.