I am working on a model now and it takes 8GB momory on forward pass (It uses onling MaxPool3d and Conv3d layers). So if I use call backward function, the memory explode to 16 gigs right? Any tips on how to reduce memory usage (apart from reducing memory)?
I can make reduce_grad = false for inputs maybe but thats very less significant, are there some other tricks?