Hi @liyz15
Thanks for the explaination once again ! 
But what do you  suggest me to do in my case where, i have to freeze layers after some epochs of training ?
Do you suggest me to define a new optimizer after freezing the layers of the model ?