In your last example you are adding the Tanh twice.
Passing it to the __init__ of the parent class will already add it to the Modules.
See the __init__ definition in the source code 15.
The second assignment as self.activation = activation will add another Tanh to the model.