Yeah, the fact that traced modules are loaded back onto the CPU by default was explained at the developer conference. It’s somewhere in https://www.facebook.com/pytorch/videos/482401942168584/ 20 if you’re interested.
How to move them from CPU to CUDA in python is well documented. C++ seems to have slipped through the net.