I am using batch norm in my network. For each epoch in training, I will perform evaluate loss in validation set. Will the batch norm statistic in train() mode maintain in next epoch because I want to train these statistic? Thanks
for epoch in range of (100):
     net.train()
     loss=...
     loss.backward()
     optimizer.step()
     #Evaluate in validation set
     with torch.no_grad():
            for val in valloader:
                images, targets= val
                net.eval()
      ...