Hey guys,
I have a question. I don’t want to post any code right now but I can if you need it to help me.
I made a conv nn. No fc layers etc. Just conv (I don’t know if that is relevant). I train the network on 10 instances (mapping of some 20x20 pixels images onto another 20x20 pixels) and I run a batch of 10 instances at once.
The error of the network is great. So I run all the 10 input instances from the training set through the network (one batch of 10 instances). The results are what I expected. Then I run only one instance through the network (1 batch with 1 instance) and the result is way different, completely wrong from when the same instance was passed through the network in a batch of 10.
Is this normal or is something wrong? I’m completely flabbergasted.
EDIT: I’m using batch norm if that matters.