I don’t fully understand the use case of changing an activation and “restart” the network, as the activation wouldn’t be used, if you reset the model training.
In any case, you should manipulate the activation in the forward hook, if you want to pass the changed activation to the next layers.