once the model is in .eval() mode, the BatchSize should not matter. This is weird.
If you give a script that I can run and reproduce this, I’m happy to look into it. I think it’s just a user-error somewhere.