Env: C++, cuda9, self compiled libtorch from souce(1.1.0a0+deadf3b), tracing model
Problem: libtorch spends lots of time in reloading the model if I change the input size during inference(In fact, it seems the same in python). If I don’t change the input size, it will get fast inference after the first time-consuming input. What can I do to accelerate the inference if I need to change the input size all the time?