Solved by ptrblck in post #2 
              
              
                As described in the docs: 

The mean and standard-deviation are calculated per-dimension separately for each object in a mini-batch. 

so I think this is expected as your the stats would be calculated from each sample in the temporal dimension, which won’t be possible for a single value (the stddev …