Solved by albanD in post #2 
              
              
                Hi, 
The memory consumption is doubled most likely because both outputs are saved. 
Indeed, to compute the backward of the convolution, we need to know what was the output. So if you do two of them, we need to know both outputs.