Hi Everyone,
I am unable to find any documentation on how to set multiple GPUs for inference.
In python the following can be done:


device = torch.device(“cuda” if torch.cuda.is_available() else “cpu”)
model = CreateModel()
model= nn.DataParallel(model)
model.to(device)


However for C++ I can’t find the equivalent or any documentation.
torch::nn does not contain either DataParallel or DistributedDataParallel
Any help is appreciated, thanks!