@leimao
Yes, it doesn’t. It use the default stream in this case. But you can use your own stream by tweaking this line right?
‘https://github.com/pytorch/extension-cpp/blob/master/cuda/lltm_cuda_kernel.cu#L120 5’
You can assign CUDA stream in the bracket as the 4th parameter (3rd parameter is 0).