After cloning the model, you would probably need to recreate the optimizer, if not already done.
Feel free to post a minimal executable code snippet, in case you get stuck, so that we could have a look at it.