Make sure to use the same input (e.g. torch.ones) in the same shape and call model.eval() for the Python and C++ application.
Also, check the output shapes and see, if there is any difference.
If you are still getting different outputs, try to scale down the problem, e.g. by using a standad ResNet without any manipulations.