I’m facing the same issue.
I’m running on jupyter notebook, the first call to torch.randn(10).cuda() takes a long loooong time to complete (~7 min), but subsequent calls behave normally.
I’m posting a screenshoot of the stack when interrupting the kernel.

cuda_slow.png1071×433 44 KB