Yes! I think that is where problem maybe in!  I create a list before train the model. And when the indicator ‘update’ is True, I will append some parameters of the model to this list.
But I really need to save these parameters. Is there another solutions to avoid setting the retrain_graph=True so that the model wouldn’t require dozens of memories as in the first round?