Solved by mmisiur in post #4 
              
              
                In validation phase we care mostly about the general performance of the model rather than the loss. During training phase tracking training loss is very useful to see how the model actually process the data, but what is most important loss is strictly tied to backpropagation and updating weights, th…