Fine Tune GPT-NEO 2.7B
Hello to everyone, is there a script to fine tune this new model?

Thanks
Did you try to use `run_clm.py`?<|||||>@LysandreJik Yea, it's working. But i cannot fine-tune it using "GPU" in colab and the "TPU" gives me this error ```exception: process 0 terminated with signal SIGKILL```, I tried the solutions in the issues but still  <|||||>SIGKILL is probably an out of memory error, meaning you're running out of RAM. I'm not entirely sure colab gives you the hardware necessary to do such big trainings, even when using DeepSpeed.<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/master/CONTRIBUTING.md) are likely to be ignored.