I am developing a deep learning framework where there are multiple neural networks included in my framework design.
Is there any method in PyTorch that I could run multiple neural networks parallel?
Currently, I have my multiple models listed and trained sequentially, but ideally, I wish to make these models to be trained parallelly. For example, I wish to train model A and model B together. Then, the intermediate results will be consumed by model C and model D. Then, the results from model C and model D will be consumed by model F to generate the final results.
Any idea?