Speed benchmark on VGG16
I am testing pytorch’s speed on a simple VGG16 benchmark and I have noticed the following timings: Do these timings sound reasonable and is there a reason why Iteration 1 is much faster than the rest ? System specs: Thanks !
tdeboissiere
Also, you’re measuring the time of CUDA copies, but using pinned memory and async transfers would be faster than the simplest approach.
apaszke
Thanks! Can you point me to the documentation to re-implement the benchmark with pinned memory and async transfers ?
tdeboissiere
apaszke