Hi,
It will make a small difference in memory in case you don’t use gradients. If you use gradients, most of these tensors are kept around for the backward pass anyway.
Speed wise, these should not be any difference.