Hi,
Yes having more parameters makes your model more memory hungry.
If you still want to be able to use the same network, a solution would be to reduce the batch size, this way the intermediary computations will be smaller and will use less memory.