If track_running_stats is set to True, the vanilla batch norm is used, i.e. the batch statistics are stored furing training in running_mean and running_var. Setting the model to evaluation mode, will use these statistics for all validation samples.
Setting track_running_stats to False will use the batch statistics even in evaluation mode of the current batch.