Yes, if you don’t track the running stats, the batch statistics will be used during train and eval, which also means that your result will be dependent on the current batch.
The affine parameters are independent of the running stats and will still be learned.