I also wonder if this contant saving and loading of parameters somehow interfere with the optimization in a manner that I am unaware of, because separating these parameters get me worse results than before.