to validate your claim,  can you check the equality of weights before and after passing the forward function once, by printing them?
Also check the running_mean, running_var, num_batches_tracked of batch norm layers.