Could you give me some advise?Thanks very much

  
    
    
    Help on using stream in multithread to accelerate C++
  
  
    I need some help about using stream in multithread to accelerate my computation. Could you help me and give me some advise? 
my problem: 
the time killed by using multithread and multistreams is seem to using serial loop. it doesn’t speed up. 
my codes: 
I used a thread-pool with 10 threads. I add my task into threads. In thread task funciton, I get a free GPUStream and do some job in this GPUStream. 
the thread task is as follow: 
void* task_thread(void** arg) 
{ 
auto options = torch::TensorOp…