Solved by ptrblck in post #2 
              
              
                Yes, you are resetting the hyperparameters and are training a new model in each iteration. 


k-fold CV gives you a better “unbiased” estimate of the generalization performance of your model. 


@rasbt explains this techniques here and also compares it to other hold-out methods. 
Often you would u…