Could you give an example of a model, which uses little memory and another one of a model which uses more memory?
I’m not sure to understand the question completely, but since each layer will use its own parameters, the more layers you are creating the more memory will be used.