Setting affine=False will remove the gamma and beta terms from the calculation, thus only using the running mean and var. So that’s basically, what you want.
I don’t know, how Caffe works, but setting the learning rate to 0 is something different in my opinion, since you still could have the gamma and beta terms with constant (random) values.