Solved by ptrblck in post #18 
              
              
                I’m unsure how the kernel size is related to the input shape of the batchnorm layer. 
However, if the input contains only a single value for each channel (as is the case here), you won’t be able to use batchnorm layers in training mode, since they need to calculate the stats from the input. 
Since i…