Did you randomly split the data import the training and validation sets or are you using data e.g. from other data domains?



 banikr:

Why is validation loss decreasing when I use the Optimizer functions?


If your validation loss decreasing even though you don’t call optimizer.step()?