Hi, All
I found a interesting problem during pytorch framework inference. my val set include 100 images(1920x1080), I want to check forward time for every image, so I do preprocess for every image, and insert to list, then I open a loop to test forward time, I found, if I run 25 images once, then it’s time cost same as one image inference time, like below, just 1st time cost much time. next images cost very little time. anybody know what’s the reason?
Time: 0.4107s
Time: 0.0010s
Time: 0.0006s
Time: 0.0007s
Time: 0.0007s
Time: 0.0008s
Time: 0.0006s
Time: 0.0007s
Time: 0.0006s
Time: 0.0006s
Time: 0.0006s
Time: 0.0006s