Hi. Thanks for the reponse! I tried inplace=True, and it solved the memory increase in out = relu(out). However, the memory issue in out = maxpool(out) persists. Any way to resolve this like the activation case? Pooling should reduce the memory consumption in our case.