I agree with you. I have tried to push my whole validation one time onto the GPU  and then push each batch one (bacth size is 100)at a time onto the GPU, the result shows what you have said is correct, the former is exactly faster than the latter