No, you don’t need to use the no_grad() wrapper during the evaluation phase. While it would reduce the memory usage by avoiding to store intermediate tensors needed to calculate the gradients, it’s a performance improvement and won’t change the functionality otherwise.