Even though relu doesn’t use parameters, the intermediate tensors might be stored, if they are needed to calculate the gradients in the backward pass.
The output of conv1 would require gradients, if the gradient calculation wasn’t disabled for the code block, so could you double check if the AutoGradMode is indeed set to false for this calculation?