Hi,
Setting this to False means that no gradient are needed and so all the autograd state does not need to be saved for this part of the net. So it will reduce the memory consumption of the model (and slightly speed it up).