If you have multiple devices, you can use a for loop and call each model separately with the corresponding input.
Since CUDA operations are executed asynchronously, all devices will be used at the same time.
However, if you are dealing with a single device, note that each CUDA call will be added to a queue and the device will most likely be busy with the single model.