Yes, you can use different batch sizes and the batch size during evaluation (after calling model.eval()) will not affect the validation results.
Are you using larger inputs during the validation or why do you have to reduce the batch size by 128x?