Unfortunately, I don’t know how Keras “kernels” work.
You could either create a new optimizer with a subset of the parameters or try to reset the running stats.
Alternatively, you could try to set the .grad attributes to None for all “frozen” parameters and check, if they would still be updated (I haven’t tested this approach in the latest release and it’s quite hacky so don’t rely on it, please).