Hello Piotr, I was wondering if PyTorch internally parallelizes the forward pass of given two models here (actor() and critic()). I am trying to build something similar where I have two models which are not capable of using the whole GPU (as far as I noticed it uses 4 GiB of 32 GiB when I checked with nvidia-smi command).
That’s why I want to train two models in single GPU and hopefully have a decent speed compared to sequentially training two models.
To achieve my goal, I have initialized those two models in a nn.Module child class and called them in the forward in seperate lines but the duration was even longer than twice the duration a single training takes. Can you point me in the right direction to achieve my goal?