@dylandjian Why are you running the same GPU from multiple processes? Typically GPUs will run faster if they are just doing one thing at a time, and in case, AFAIK, will only run a single kernel at a time. Is the multiprocessing because there is a substantial cpu component to deal with, eg some kind of preprocessing on each batch or similar?