Solved by anis016 in post #2 
              
              
                maybe these should clear you out. 


By default all the modules are initialized to train mode (self.training = True). Also be aware that some layers have different behavior during train/and evaluation (like BatchNorm, Dropout) so setting it matters. 


Dropout works as a regularization for preventin…