The running time on gpu in testing (batch_size=1) is similar to in training(batch_size=128).
However using the same model on tensorflow, the running time on gpu in testing with 1 batch is faster than in training with 128 batch.
And running time on pytorch is faster than tensorflow in training but slower so much in testing.
It makes me very confuse😂, because in RL, I have to sample data.But it is so slowly!
This case is in Pytorch1.0.0 with Cuda10.