Solved by ptrblck in post #2 
              
              
                You could check the stddev and variance of the resulting tensor and make sure it has a unit variance (=1), which is the purpose of this normalization/standardization step. 
I’m not familiar with the TF implementation and don’t know what internally is used.