You could call .eval() on all batch norm layers in your model after passing x1 to the model and before using x2. After it just reset these layers to .train() again.
If you don’t use any dropout layers, you could also just call model.eval()/.train().