I am sorrry  but what do you mean freezing weights at test phase? I think usually the weight will not change considering that there is no backward operation at test phase. The weight will only change when there is an optimizer together with a backward operation.