Hello,
So am using pytorch to make inference (using Resnet50), I have been constrained to run it on CPU - so I have no option.
To my surprise and confusion the python version makes inference in ~0.25 secs. However the libtorch version takes ~0.7 secs.
Please suggestions will be appreciated as am really new to this, and please GPU is a no no in this scenario we are specifically asked to do it on CPU.