The GPU has 11gb ram.
I just try to optimize the cost function (loss), there is no neural network part in my solution, so I do not think I am storing any activations or weights, unless I am misunderstanding how it works. (which might be likely…)
How do I go about solving this problem? Mini-batching? I am new in this field, any hints, ideas or nudges would be a huge help!