Nevermind, I fixed it. It was missing model.eval(). It is correctly recognizing standalone test images and training images. But still making errors on the images downloaded from google. Can this be possible since the images from google belong to different distribution?