exclude jit time from the speed metric calculation of evaluation and …
…prediction

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

@sgugger @jianan-gu  please have a review<|||||>_The documentation is not available anymore as the PR was closed or merged._<|||||>@sgugger done, please have a review of it.