Yes! As @ptrblck said, make sure that you are not tracking unnecessary variables for backward. I’m supposing that you are testing a larger image/data than training data. But if each single slice of your network output can be fit into a GPU, this is certainly doable.