You could push a single model to the device, perform the forward pass to get the prediction, and push it back to the host using a loop like:
models = [...] # define a list of all models on the CPU

input = ... # get your input
for model in models:
    model.to('cuda')
    pred = model(input)
    model.to('cpu')