Hi,
Is there a way to define some layers only for the training stage?
I know there is a self.training flag which can be used in the forward() function. However, when the layers are defined in __init__(), the self.training is always True. So, I can’t use self.triaining in the __init__() function.