Solved by IlyaOvodov in post #3 
              
              
                For those who seek a solution and not snobbish mentoring: 
def replace_bn(m, name):
    for attr_str in dir(m):
        target_attr = getattr(m, attr_str)
        if type(target_attr) == torch.nn.BatchNorm2d:
            print('replaced: ', name, attr_str)
            setattr(m, attr_str, Synchroniz…