Hi, I think it’s a matter of digging into source code. If I’m not wrong it performs sample-wise mean. Later it averages. In addition, weights are multiplied batch-wise (I think). How are you setting those parameters?