So just to be sure here: If I call
torch::NoGradGuard guard;
torch::Tensor prediction = model->forward(features);
from multiple parallel threads. Are these inferences going to interfere with each other? The forward is defined as in the above code…