No, I haven’ tried yet. So in that case, you mean to perform linear layer compuations on a CPU or a single GPU?
Also, is there any suggestions on the number of workers which should be used. I am using 16 workers and have 10 GPUS. There can also be a possibility that GPU’s are  not having continuous stream of data available all the time, if the multiprocessing queue speed is less than the batch computation.