I want to deploy pytorch YOLO model in windows c++ environment.
The  environment is libtorch1.4-debug + vs2017 + cuda10.1,
the c++ inference code can run successfully, but it takes about 0.16s for
an input image, as a comparison, the time is 0.03s in python environment.
And i also found that the GPU usage rate is rather low, any ideas on how to solve this problem?