How to freeze a few layers in t5 model  during fine-tuning
In PyTorch, this is very easy, like so:

```
from transformers import T5ForConditionalGeneration

model = T5ForConditionalGeneration.from_pretrained("t5-base")
for name, param in model.named_parameters():
     if name == "...":
        param.requires_grad = False
```<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/master/CONTRIBUTING.md) are likely to be ignored.