Yeah I think that you should apply normalization to your test image if your model is trained on normalized inputs because then your model may be experiencing some strange input at test time and which may not be so good for the task that you are upto.