Yes, the intermediate tensors will be removed after the backward() operation is done, if retain_graph=True is not used.
This is also the reason, why a second backward() call right after the first one will raise an error (if the intermediate tensors were needed to calculate the gradients).