If you are using pytorch dataloader it’s not desirable to send inputs to gpu in the loader as it preloads several batches and may occupy lot of memory.  Besides in not sure if multiprocessing allows ti do that