Hello.
I am training a large network which comsumes large gpu memory.
Is there any stratey to reduce the memory by squeeze the conv-bn-relu operation?
If we treat these operation as one functional, then many intermediate results have no need to be cached.
Any suggestion ?
Thanks!