I followed what you suggested and got this.

Capture.PNG765×760 31.7 KB

The bigger model created this huge spike on top of the old model’s memory block. I am not sure how this model can ‘fit’ into the old memory. Usually, I just restart the kernel to clear the memory. Is there a way to avoid this big spike when training a modified model?