Hmmm…
C is 100x3.000.000
Your outgoing matrix is 3000x3.000.000
I mean, each of those numbers is a float32, which requries around 4 byte.
If you need to perform and save inner parameters to backprop…
Makes sense