If you register the hook on your parameter directly, because the parameter does not change, you should register it only once for the whole training. Otherwise you add a new hook everytime and you will have many hooks.