Hi,
The CUDA api is asynchronous by default, this means that if you do
out1 = net1(in1)
out2 = net2(in2)

This will run in parrallel on the gpu if it can (enough compute available).
So I would expect no improvement by using multithreading on a single GPU