I have a feed forward NN that I want to train several times and the get the best model.
For that I am doing something like:
#read data and store in Variable.

# Define model and train it.
for n in times_to_train:
     model = define_model()
     train()

My problem is that the performance is quite different when I use this loop and when I train one model a time (instead of using the for loop, execute the code several times).
My question is. Should I clear any variable or restart something before training inside the loop?
Thank you very much!