I think the philosophy is to compile your model using PyTorch’s JIT and then loading it in CPP.
But, you can always redesign your architecture in CPP using the torch::nn namespace and then load a text-serialized version of the weights.