ptrblck:

overhead


Thank you very much, but I still have two question ：

I use the libtorch  with the option ‘USE_CUDA = OFF’. I don’t know whether the libtorch will allocate cuda memory or not ?
If JIT is optimizing the model and its graph in the first iterations , Why the libtorch take some time at the beginning in the second iterations ?  you can see the consume time in the performance analysis chart .

Have a good day, thanks.