The documentation for track_running_stats in BatchNorm2D specifies that setting track_running_stats=False will results in stats being computer during runtime as well.
Does this mean that the result will be dependent on the specifics of each batch, even if I call model.eval()? And how does this play together with the affine parameters of the BatchNorm2D layer?