@SimonW @apaszke,
Thanks! Turns out multiprocess seems to be what I’m looking for. I checked out few tutorials regarding manager. Will give it a try.
I had a doubt though, would i need to specify GPUs or does the multiprocessing module automatically take care of distributing processes across it? Also, can I use the pool class? Will pytorch throw an error if I try to map to too many processes?