Solved by ptrblck in post #2 
              
              
                Yes, but the propsed method might still work “good enough” for the tutorial.  

I think you should be able to find a proper explaination in Goodfellow et al., Deep Learning and I’m sure Bishop, Pattern Recognition and Machine Learning explains it as well (which is also a general recommendation to t…