I have also noticed this, but when I tried the following simple test, I got an error:
import torch
import torch.nn as nn
module = nn.BatchNorm2d(3, track_running_stats=False)
---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
 in ()
**      1 import torch**
**      2 import torch.nn as nn**
----> 3 module = nn.BatchNorm2d(3, track_running_stats=False)
TypeError: init() got an unexpected keyword argument ‘track_running_stats’