Sure, but keep in mind the way to use multi-GPU depends on the application. You might be interested in the DataParallel 118 module, or you can spread it over multiple GPUs by passing an additional argument to .cuda() call - .cuda(1) will place the tensor/module on 2nd GPU.