facpalm. Sorry, I’m not sure how I missed torch.cuda.init() in the docs.
About the timing: this was just my quick and dirty method to show the difference between the initial startup and the following runs. I do not use this to actually profile my code.