Which is better ?
I want to train a GPT-J-6B model on Arabic dataset but i am facing an important question.
Should i train the model from scratch or fine tune it on the new language … which is better ?
You should use the [forums](https://discuss.huggingface.co/) to discuss this, as we keep issues for bugs and feature requests only.<|||||>@MohamedAliRashad did you ask it on the forum?
If yes, can you provide the link?
thanks.<|||||>@srulikbd 
Found similar questions not answered or recommended the training from scratch part but knew it is impossible because it requires huge amount of computation. <|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/master/CONTRIBUTING.md) are likely to be ignored.