Yangmin:

But the bn layer keep changning running_mean and running_var during training even though I freezed them with module.eval().


That shouldn’t be the case. Could you post a minimal, executable code snippet showing this behavior, please?