Yes, your understanding is correct.
In the default setup:

training: normalize input with input_stats and update running_stats with input_stats using momentum formula
evaluation: use running_stats to normalize input

You can of course change this behavior by setting track_running_stats=False, which would also use the input_stats during evaluation.
The affine parameters are independent from this behavior.