thanks
let’s say we have some classical CNN, with each layer being the application of some conv relu batchnorm thing.
In that case, there would be a tensor of activations that is saved at each layer for batchprop, or  is some smarter thing that is done to save memory ?
These are all pretty stupid questions, but it turns out I can’t readily find information on that topic