The execution time of CPU models is subject to the CPU load at that moment (e.g. if there are background tasks running on the OS, the execution time is longer).
Also we recommend setting a few of OpenMP environment variables for optimal CPU performance: https://github.com/mingfeima/convnet-benchmarks/blob/master/pytorch/run.sh#L16-L25 72.