My network use batch norm in each layer. during training and validation the error is very law. Once I move to testing and apply model.eval() the error is very high. knowing that if I’m using the model no in eval() mode result are much better.
I tried to test using the same batch size as the training and testing on one batch size, both of them are better than using average values learned from training by using eval() mode. theoretically I can’t use this way and I can’t justify, Any solution please ?