It seems that DL libraries load the whole model onto the gpu. To reduce memory gpu memory usage could I not load each matrix multiply into the gpu one at time?
I know there will be speed ineffiencies though. How would I go about this? Do I just manually call .cpu() or .cuda() after each operation?
Thanks.